-- Logs begin at Tue 2021-12-14 12:19:37 UTC, end at Tue 2021-12-14 13:20:19 UTC. -- Dec 14 12:49:59.611823 dv-cinder-784477-10-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Dec 14 12:49:59.619325 dv-cinder-784477-10-iscsi devstack@n-api.service[101657]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Dec 14 12:49:59.624932 dv-cinder-784477-10-iscsi devstack@n-api.service[101657]: *** Starting uWSGI 2.0.18-debian (64bit) on [Tue Dec 14 12:49:59 2021] *** Dec 14 12:49:59.624932 dv-cinder-784477-10-iscsi devstack@n-api.service[101657]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Dec 14 12:49:59.624932 dv-cinder-784477-10-iscsi devstack@n-api.service[101657]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Dec 14 12:49:59.624932 dv-cinder-784477-10-iscsi devstack@n-api.service[101657]: nodename: dv-cinder-784477-10-iscsi Dec 14 12:49:59.624932 dv-cinder-784477-10-iscsi devstack@n-api.service[101657]: machine: x86_64 Dec 14 12:49:59.624932 dv-cinder-784477-10-iscsi devstack@n-api.service[101657]: clock source: unix Dec 14 12:49:59.624932 dv-cinder-784477-10-iscsi devstack@n-api.service[101657]: pcre jit disabled Dec 14 12:49:59.624932 dv-cinder-784477-10-iscsi devstack@n-api.service[101657]: detected number of CPU cores: 4 Dec 14 12:49:59.624932 dv-cinder-784477-10-iscsi devstack@n-api.service[101657]: current working directory: / Dec 14 12:49:59.624932 dv-cinder-784477-10-iscsi devstack@n-api.service[101657]: detected binary path: /usr/bin/uwsgi-core Dec 14 12:49:59.624932 dv-cinder-784477-10-iscsi devstack@n-api.service[101657]: your processes number limit is 47680 Dec 14 12:49:59.624932 dv-cinder-784477-10-iscsi devstack@n-api.service[101657]: your memory page size is 4096 bytes Dec 14 12:49:59.624932 dv-cinder-784477-10-iscsi devstack@n-api.service[101657]: detected max file descriptor number: 2048 Dec 14 12:49:59.624932 dv-cinder-784477-10-iscsi devstack@n-api.service[101657]: lock engine: pthread robust mutexes Dec 14 12:49:59.624932 dv-cinder-784477-10-iscsi devstack@n-api.service[101657]: thunder lock: enabled Dec 14 12:49:59.624932 dv-cinder-784477-10-iscsi devstack@n-api.service[101657]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Dec 14 12:49:59.624932 dv-cinder-784477-10-iscsi devstack@n-api.service[101657]: Python version: 3.8.10 (default, Sep 28 2021, 16:10:42) [GCC 9.3.0] Dec 14 12:49:59.666454 dv-cinder-784477-10-iscsi devstack@n-api.service[101657]: Python main interpreter initialized at 0x558214a779c0 Dec 14 12:49:59.666454 dv-cinder-784477-10-iscsi devstack@n-api.service[101657]: python threads support enabled Dec 14 12:49:59.666454 dv-cinder-784477-10-iscsi devstack@n-api.service[101657]: your server socket listen backlog is limited to 100 connections Dec 14 12:49:59.666454 dv-cinder-784477-10-iscsi devstack@n-api.service[101657]: your mercy for graceful operations on workers is 90 seconds Dec 14 12:49:59.666774 dv-cinder-784477-10-iscsi devstack@n-api.service[101657]: mapped 403077 bytes (393 KB) for 2 cores Dec 14 12:49:59.666869 dv-cinder-784477-10-iscsi devstack@n-api.service[101657]: *** Operational MODE: preforking *** Dec 14 12:49:59.667137 dv-cinder-784477-10-iscsi devstack@n-api.service[101657]: *** uWSGI is running in multiple interpreter mode *** Dec 14 12:49:59.667137 dv-cinder-784477-10-iscsi devstack@n-api.service[101657]: spawned uWSGI master process (pid: 101657) Dec 14 12:49:59.667302 dv-cinder-784477-10-iscsi systemd[1]: Started Devstack devstack@n-api.service. Dec 14 12:49:59.670020 dv-cinder-784477-10-iscsi devstack@n-api.service[101657]: spawned uWSGI worker 1 (pid: 101658, cores: 1) Dec 14 12:49:59.670020 dv-cinder-784477-10-iscsi devstack@n-api.service[101657]: spawned uWSGI worker 2 (pid: 101659, cores: 1) Dec 14 12:49:59.670020 dv-cinder-784477-10-iscsi devstack@n-api.service[101657]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Dec 14 12:50:01.363446 dv-cinder-784477-10-iscsi devstack@n-api.service[101658]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Dec 14 12:50:01.363446 dv-cinder-784477-10-iscsi devstack@n-api.service[101658]: from cryptography.utils import int_from_bytes Dec 14 12:50:01.364136 dv-cinder-784477-10-iscsi devstack@n-api.service[101658]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Dec 14 12:50:01.364136 dv-cinder-784477-10-iscsi devstack@n-api.service[101658]: from cryptography.utils import int_from_bytes Dec 14 12:50:01.364354 dv-cinder-784477-10-iscsi devstack@n-api.service[101659]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Dec 14 12:50:01.364354 dv-cinder-784477-10-iscsi devstack@n-api.service[101659]: from cryptography.utils import int_from_bytes Dec 14 12:50:01.364808 dv-cinder-784477-10-iscsi devstack@n-api.service[101659]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Dec 14 12:50:01.364808 dv-cinder-784477-10-iscsi devstack@n-api.service[101659]: from cryptography.utils import int_from_bytes Dec 14 12:50:03.897810 dv-cinder-784477-10-iscsi devstack@n-api.service[101659]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=101659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Dec 14 12:50:03.898390 dv-cinder-784477-10-iscsi devstack@n-api.service[101659]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=101659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Dec 14 12:50:03.898489 dv-cinder-784477-10-iscsi devstack@n-api.service[101658]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=101658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Dec 14 12:50:03.898855 dv-cinder-784477-10-iscsi devstack@n-api.service[101659]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=101659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Dec 14 12:50:03.898956 dv-cinder-784477-10-iscsi devstack@n-api.service[101658]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=101658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Dec 14 12:50:03.899049 dv-cinder-784477-10-iscsi devstack@n-api.service[101659]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=101659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Dec 14 12:50:03.899130 dv-cinder-784477-10-iscsi devstack@n-api.service[101659]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=101659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Dec 14 12:50:03.899214 dv-cinder-784477-10-iscsi devstack@n-api.service[101658]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=101658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Dec 14 12:50:03.899520 dv-cinder-784477-10-iscsi devstack@n-api.service[101659]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=101659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 12:50:03.899665 dv-cinder-784477-10-iscsi devstack@n-api.service[101658]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=101658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Dec 14 12:50:03.899768 dv-cinder-784477-10-iscsi devstack@n-api.service[101658]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=101658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Dec 14 12:50:03.899855 dv-cinder-784477-10-iscsi devstack@n-api.service[101659]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=101659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 12:50:03.900155 dv-cinder-784477-10-iscsi devstack@n-api.service[101658]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=101658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 12:50:03.900302 dv-cinder-784477-10-iscsi devstack@n-api.service[101659]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=101659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 12:50:03.900461 dv-cinder-784477-10-iscsi devstack@n-api.service[101659]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=101659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 12:50:03.900595 dv-cinder-784477-10-iscsi devstack@n-api.service[101658]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=101658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 12:50:03.900760 dv-cinder-784477-10-iscsi devstack@n-api.service[101658]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=101658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 12:50:03.900885 dv-cinder-784477-10-iscsi devstack@n-api.service[101659]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=101659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 12:50:03.901111 dv-cinder-784477-10-iscsi devstack@n-api.service[101658]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=101658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 12:50:03.901210 dv-cinder-784477-10-iscsi devstack@n-api.service[101659]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=101659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 12:50:03.901431 dv-cinder-784477-10-iscsi devstack@n-api.service[101659]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=101659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 12:50:03.901533 dv-cinder-784477-10-iscsi devstack@n-api.service[101658]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=101658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 12:50:03.901737 dv-cinder-784477-10-iscsi devstack@n-api.service[101658]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=101658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 12:50:03.901832 dv-cinder-784477-10-iscsi devstack@n-api.service[101659]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=101659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 12:50:03.902055 dv-cinder-784477-10-iscsi devstack@n-api.service[101658]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=101658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 12:50:03.902147 dv-cinder-784477-10-iscsi devstack@n-api.service[101659]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=101659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 12:50:03.902318 dv-cinder-784477-10-iscsi devstack@n-api.service[101659]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=101659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 12:50:03.902415 dv-cinder-784477-10-iscsi devstack@n-api.service[101658]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=101658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 12:50:03.902636 dv-cinder-784477-10-iscsi devstack@n-api.service[101659]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=101659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 12:50:03.902728 dv-cinder-784477-10-iscsi devstack@n-api.service[101658]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=101658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 12:50:03.902933 dv-cinder-784477-10-iscsi devstack@n-api.service[101658]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=101658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 12:50:03.903028 dv-cinder-784477-10-iscsi devstack@n-api.service[101659]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-784477-10-iscsi {{(pid=101659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 12:50:03.903246 dv-cinder-784477-10-iscsi devstack@n-api.service[101658]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=101658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 12:50:03.903333 dv-cinder-784477-10-iscsi devstack@n-api.service[101659]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=101659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 12:50:03.903564 dv-cinder-784477-10-iscsi devstack@n-api.service[101659]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=101659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 12:50:03.903654 dv-cinder-784477-10-iscsi devstack@n-api.service[101658]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-784477-10-iscsi {{(pid=101658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 12:50:03.903876 dv-cinder-784477-10-iscsi devstack@n-api.service[101659]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=101659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 12:50:03.903975 dv-cinder-784477-10-iscsi devstack@n-api.service[101658]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=101658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 12:50:03.904180 dv-cinder-784477-10-iscsi devstack@n-api.service[101658]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=101658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 12:50:03.904271 dv-cinder-784477-10-iscsi devstack@n-api.service[101659]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=101659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 12:50:03.904488 dv-cinder-784477-10-iscsi devstack@n-api.service[101659]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=101659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 12:50:03.904580 dv-cinder-784477-10-iscsi devstack@n-api.service[101658]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=101658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 12:50:03.904801 dv-cinder-784477-10-iscsi devstack@n-api.service[101658]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=101658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 12:50:03.904981 dv-cinder-784477-10-iscsi devstack@n-api.service[101659]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=101659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 12:50:03.905128 dv-cinder-784477-10-iscsi devstack@n-api.service[101658]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=101658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 12:50:03.905223 dv-cinder-784477-10-iscsi devstack@n-api.service[101659]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=101659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 12:50:03.905450 dv-cinder-784477-10-iscsi devstack@n-api.service[101658]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=101658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 12:50:03.905624 dv-cinder-784477-10-iscsi devstack@n-api.service[101659]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=101659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 12:50:03.905741 dv-cinder-784477-10-iscsi devstack@n-api.service[101658]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=101658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 12:50:03.906836 dv-cinder-784477-10-iscsi devstack@n-api.service[101659]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=101659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 12:50:03.906939 dv-cinder-784477-10-iscsi devstack@n-api.service[101658]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=101658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 12:50:03.907025 dv-cinder-784477-10-iscsi devstack@n-api.service[101659]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=101659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 12:50:03.907099 dv-cinder-784477-10-iscsi devstack@n-api.service[101658]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=101658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 12:50:03.907181 dv-cinder-784477-10-iscsi devstack@n-api.service[101659]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=101659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 12:50:03.907258 dv-cinder-784477-10-iscsi devstack@n-api.service[101658]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=101658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 12:50:03.907325 dv-cinder-784477-10-iscsi devstack@n-api.service[101659]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=101659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 12:50:03.907396 dv-cinder-784477-10-iscsi devstack@n-api.service[101658]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=101658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 12:50:03.907466 dv-cinder-784477-10-iscsi devstack@n-api.service[101659]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=101659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 12:50:03.907537 dv-cinder-784477-10-iscsi devstack@n-api.service[101658]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=101658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 12:50:03.907613 dv-cinder-784477-10-iscsi devstack@n-api.service[101659]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=101659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 12:50:03.907778 dv-cinder-784477-10-iscsi devstack@n-api.service[101658]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=101658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 12:50:03.907925 dv-cinder-784477-10-iscsi devstack@n-api.service[101659]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=101659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 12:50:03.908080 dv-cinder-784477-10-iscsi devstack@n-api.service[101658]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=101658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 12:50:03.908236 dv-cinder-784477-10-iscsi devstack@n-api.service[101659]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=101659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 12:50:03.908399 dv-cinder-784477-10-iscsi devstack@n-api.service[101658]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=101658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 12:50:03.908562 dv-cinder-784477-10-iscsi devstack@n-api.service[101659]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=101659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 12:50:03.908706 dv-cinder-784477-10-iscsi devstack@n-api.service[101658]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=101658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 12:50:03.908901 dv-cinder-784477-10-iscsi devstack@n-api.service[101659]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=101659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 12:50:03.909059 dv-cinder-784477-10-iscsi devstack@n-api.service[101658]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=101658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 12:50:03.909302 dv-cinder-784477-10-iscsi devstack@n-api.service[101659]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-784477-10-iscsi {{(pid=101659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 12:50:03.909427 dv-cinder-784477-10-iscsi devstack@n-api.service[101658]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=101658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 12:50:03.909627 dv-cinder-784477-10-iscsi devstack@n-api.service[101659]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=101659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 12:50:03.909756 dv-cinder-784477-10-iscsi devstack@n-api.service[101658]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-784477-10-iscsi {{(pid=101658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 12:50:03.909938 dv-cinder-784477-10-iscsi devstack@n-api.service[101659]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=101659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 12:50:03.910065 dv-cinder-784477-10-iscsi devstack@n-api.service[101658]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=101658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 12:50:03.910256 dv-cinder-784477-10-iscsi devstack@n-api.service[101659]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=101659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 12:50:03.910380 dv-cinder-784477-10-iscsi devstack@n-api.service[101658]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=101658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 12:50:03.910662 dv-cinder-784477-10-iscsi devstack@n-api.service[101658]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=101658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 12:50:03.910785 dv-cinder-784477-10-iscsi devstack@n-api.service[101659]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=101659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 12:50:03.910982 dv-cinder-784477-10-iscsi devstack@n-api.service[101659]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=101659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 12:50:03.911105 dv-cinder-784477-10-iscsi devstack@n-api.service[101658]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=101658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 12:50:03.911308 dv-cinder-784477-10-iscsi devstack@n-api.service[101659]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=101659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 12:50:03.911432 dv-cinder-784477-10-iscsi devstack@n-api.service[101658]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=101658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 12:50:03.911603 dv-cinder-784477-10-iscsi devstack@n-api.service[101659]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=101659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 12:50:03.911728 dv-cinder-784477-10-iscsi devstack@n-api.service[101658]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=101658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 12:50:03.911967 dv-cinder-784477-10-iscsi devstack@n-api.service[101659]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=101659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 12:50:03.912097 dv-cinder-784477-10-iscsi devstack@n-api.service[101658]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=101658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 12:50:03.912226 dv-cinder-784477-10-iscsi devstack@n-api.service[101659]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=101659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 12:50:03.912360 dv-cinder-784477-10-iscsi devstack@n-api.service[101658]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=101658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 12:50:03.912536 dv-cinder-784477-10-iscsi devstack@n-api.service[101659]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=101659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 12:50:03.912667 dv-cinder-784477-10-iscsi devstack@n-api.service[101658]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=101658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 12:50:03.912872 dv-cinder-784477-10-iscsi devstack@n-api.service[101659]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=101659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 12:50:03.913004 dv-cinder-784477-10-iscsi devstack@n-api.service[101658]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=101658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 12:50:03.913205 dv-cinder-784477-10-iscsi devstack@n-api.service[101659]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=101659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 12:50:03.913344 dv-cinder-784477-10-iscsi devstack@n-api.service[101658]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=101658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 12:50:03.913523 dv-cinder-784477-10-iscsi devstack@n-api.service[101658]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=101658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 12:50:03.913646 dv-cinder-784477-10-iscsi devstack@n-api.service[101659]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=101659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 12:50:03.913822 dv-cinder-784477-10-iscsi devstack@n-api.service[101659]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=101659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 12:50:03.913953 dv-cinder-784477-10-iscsi devstack@n-api.service[101658]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=101658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 12:50:03.914134 dv-cinder-784477-10-iscsi devstack@n-api.service[101659]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=101659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 12:50:03.914270 dv-cinder-784477-10-iscsi devstack@n-api.service[101658]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=101658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 12:50:03.914438 dv-cinder-784477-10-iscsi devstack@n-api.service[101658]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=101658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 12:50:03.914562 dv-cinder-784477-10-iscsi devstack@n-api.service[101659]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=101659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 12:50:03.914746 dv-cinder-784477-10-iscsi devstack@n-api.service[101658]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=101658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 12:50:03.914880 dv-cinder-784477-10-iscsi devstack@n-api.service[101659]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=101659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 12:50:03.915047 dv-cinder-784477-10-iscsi devstack@n-api.service[101659]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=101659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 12:50:03.915186 dv-cinder-784477-10-iscsi devstack@n-api.service[101658]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=101658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 12:50:03.915351 dv-cinder-784477-10-iscsi devstack@n-api.service[101659]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=101659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 12:50:03.915487 dv-cinder-784477-10-iscsi devstack@n-api.service[101658]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=101658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 12:50:03.915610 dv-cinder-784477-10-iscsi devstack@n-api.service[101659]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=101659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 12:50:03.915730 dv-cinder-784477-10-iscsi devstack@n-api.service[101658]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=101658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 12:50:03.915887 dv-cinder-784477-10-iscsi devstack@n-api.service[101658]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=101658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 12:50:03.916011 dv-cinder-784477-10-iscsi devstack@n-api.service[101659]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=101659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 12:50:03.916198 dv-cinder-784477-10-iscsi devstack@n-api.service[101658]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=101658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 12:50:03.916330 dv-cinder-784477-10-iscsi devstack@n-api.service[101659]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=101659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 12:50:03.916503 dv-cinder-784477-10-iscsi devstack@n-api.service[101658]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=101658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 12:50:03.916640 dv-cinder-784477-10-iscsi devstack@n-api.service[101659]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=101659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 12:50:03.916826 dv-cinder-784477-10-iscsi devstack@n-api.service[101658]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=101658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 12:50:03.916972 dv-cinder-784477-10-iscsi devstack@n-api.service[101659]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=101659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 12:50:03.917108 dv-cinder-784477-10-iscsi devstack@n-api.service[101659]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=101659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 12:50:03.917229 dv-cinder-784477-10-iscsi devstack@n-api.service[101658]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=101658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 12:50:03.917357 dv-cinder-784477-10-iscsi devstack@n-api.service[101659]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=101659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 12:50:03.917497 dv-cinder-784477-10-iscsi devstack@n-api.service[101658]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=101658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 12:50:03.917627 dv-cinder-784477-10-iscsi devstack@n-api.service[101658]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=101658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 12:50:03.917755 dv-cinder-784477-10-iscsi devstack@n-api.service[101659]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=101659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 12:50:03.917939 dv-cinder-784477-10-iscsi devstack@n-api.service[101658]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=101658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 12:50:03.918066 dv-cinder-784477-10-iscsi devstack@n-api.service[101659]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(tenant)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=101659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 12:50:03.918252 dv-cinder-784477-10-iscsi devstack@n-api.service[101659]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=101659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 12:50:03.918387 dv-cinder-784477-10-iscsi devstack@n-api.service[101658]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(tenant)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=101658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 12:50:03.918559 dv-cinder-784477-10-iscsi devstack@n-api.service[101658]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=101658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 12:50:03.918682 dv-cinder-784477-10-iscsi devstack@n-api.service[101659]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=101659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 12:50:03.918867 dv-cinder-784477-10-iscsi devstack@n-api.service[101658]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=101658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 12:50:03.919012 dv-cinder-784477-10-iscsi devstack@n-api.service[101659]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=101659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 12:50:03.919215 dv-cinder-784477-10-iscsi devstack@n-api.service[101659]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=101659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 12:50:03.919344 dv-cinder-784477-10-iscsi devstack@n-api.service[101658]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=101658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 12:50:03.919465 dv-cinder-784477-10-iscsi devstack@n-api.service[101658]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=101658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 12:50:03.919582 dv-cinder-784477-10-iscsi devstack@n-api.service[101659]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=101659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 12:50:03.919757 dv-cinder-784477-10-iscsi devstack@n-api.service[101658]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=101658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 12:50:03.919891 dv-cinder-784477-10-iscsi devstack@n-api.service[101659]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=101659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 12:50:03.920063 dv-cinder-784477-10-iscsi devstack@n-api.service[101659]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=101659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 12:50:03.920186 dv-cinder-784477-10-iscsi devstack@n-api.service[101658]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=101658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 12:50:03.920366 dv-cinder-784477-10-iscsi devstack@n-api.service[101658]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=101658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 12:50:03.920495 dv-cinder-784477-10-iscsi devstack@n-api.service[101659]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=101659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 12:50:03.920670 dv-cinder-784477-10-iscsi devstack@n-api.service[101658]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=101658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 12:50:03.920803 dv-cinder-784477-10-iscsi devstack@n-api.service[101659]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=101659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 12:50:03.921012 dv-cinder-784477-10-iscsi devstack@n-api.service[101658]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=101658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 12:50:03.921144 dv-cinder-784477-10-iscsi devstack@n-api.service[101659]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=101659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 12:50:03.921325 dv-cinder-784477-10-iscsi devstack@n-api.service[101658]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=101658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 12:50:03.921449 dv-cinder-784477-10-iscsi devstack@n-api.service[101659]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=101659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 12:50:03.921634 dv-cinder-784477-10-iscsi devstack@n-api.service[101659]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=101659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 12:50:03.921768 dv-cinder-784477-10-iscsi devstack@n-api.service[101658]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=101658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 12:50:03.921938 dv-cinder-784477-10-iscsi devstack@n-api.service[101658]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=101658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 12:50:03.922072 dv-cinder-784477-10-iscsi devstack@n-api.service[101659]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=101659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 12:50:03.922256 dv-cinder-784477-10-iscsi devstack@n-api.service[101658]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=101658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 12:50:03.922386 dv-cinder-784477-10-iscsi devstack@n-api.service[101659]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.49 {{(pid=101659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 12:50:03.922579 dv-cinder-784477-10-iscsi devstack@n-api.service[101659]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.49 {{(pid=101659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 12:50:03.922714 dv-cinder-784477-10-iscsi devstack@n-api.service[101658]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.49 {{(pid=101658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 12:50:03.922945 dv-cinder-784477-10-iscsi devstack@n-api.service[101659]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=101659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 12:50:03.923083 dv-cinder-784477-10-iscsi devstack@n-api.service[101658]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.49 {{(pid=101658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 12:50:03.923253 dv-cinder-784477-10-iscsi devstack@n-api.service[101658]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=101658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 12:50:03.923383 dv-cinder-784477-10-iscsi devstack@n-api.service[101659]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=101659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 12:50:03.923591 dv-cinder-784477-10-iscsi devstack@n-api.service[101658]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=101658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 12:50:03.923733 dv-cinder-784477-10-iscsi devstack@n-api.service[101659]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=101659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 12:50:03.923898 dv-cinder-784477-10-iscsi devstack@n-api.service[101659]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=101659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 12:50:03.924029 dv-cinder-784477-10-iscsi devstack@n-api.service[101658]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=101658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 12:50:03.924207 dv-cinder-784477-10-iscsi devstack@n-api.service[101658]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=101658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 12:50:03.924653 dv-cinder-784477-10-iscsi devstack@n-api.service[101659]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=101659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 12:50:03.924872 dv-cinder-784477-10-iscsi devstack@n-api.service[101659]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=101659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 12:50:03.925017 dv-cinder-784477-10-iscsi devstack@n-api.service[101658]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=101658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 12:50:03.925188 dv-cinder-784477-10-iscsi devstack@n-api.service[101659]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=101659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 12:50:03.925313 dv-cinder-784477-10-iscsi devstack@n-api.service[101658]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=101658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 12:50:03.925493 dv-cinder-784477-10-iscsi devstack@n-api.service[101658]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=101658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 12:50:03.925616 dv-cinder-784477-10-iscsi devstack@n-api.service[101659]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=101659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 12:50:03.925798 dv-cinder-784477-10-iscsi devstack@n-api.service[101658]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=101658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 12:50:03.925933 dv-cinder-784477-10-iscsi devstack@n-api.service[101659]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=101659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 12:50:03.926104 dv-cinder-784477-10-iscsi devstack@n-api.service[101658]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=101658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 12:50:03.926227 dv-cinder-784477-10-iscsi devstack@n-api.service[101659]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=101659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 12:50:03.926421 dv-cinder-784477-10-iscsi devstack@n-api.service[101658]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=101658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 12:50:03.926552 dv-cinder-784477-10-iscsi devstack@n-api.service[101659]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=101659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 12:50:03.926733 dv-cinder-784477-10-iscsi devstack@n-api.service[101659]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=101659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 12:50:03.926864 dv-cinder-784477-10-iscsi devstack@n-api.service[101658]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=101658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 12:50:03.926985 dv-cinder-784477-10-iscsi devstack@n-api.service[101659]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=101659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 12:50:03.927113 dv-cinder-784477-10-iscsi devstack@n-api.service[101658]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=101658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 12:50:03.927273 dv-cinder-784477-10-iscsi devstack@n-api.service[101659]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=101659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 12:50:03.927407 dv-cinder-784477-10-iscsi devstack@n-api.service[101658]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=101658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 12:50:03.927568 dv-cinder-784477-10-iscsi devstack@n-api.service[101658]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=101658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 12:50:03.927691 dv-cinder-784477-10-iscsi devstack@n-api.service[101659]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=101659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 12:50:03.927870 dv-cinder-784477-10-iscsi devstack@n-api.service[101658]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=101658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 12:50:03.927995 dv-cinder-784477-10-iscsi devstack@n-api.service[101659]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=101659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 12:50:03.928179 dv-cinder-784477-10-iscsi devstack@n-api.service[101659]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=101659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 12:50:03.928303 dv-cinder-784477-10-iscsi devstack@n-api.service[101658]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=101658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 12:50:03.928484 dv-cinder-784477-10-iscsi devstack@n-api.service[101658]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=101658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 12:50:03.928616 dv-cinder-784477-10-iscsi devstack@n-api.service[101659]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=101659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 12:50:03.928791 dv-cinder-784477-10-iscsi devstack@n-api.service[101658]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=101658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 12:50:03.928937 dv-cinder-784477-10-iscsi devstack@n-api.service[101659]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=101659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 12:50:03.929118 dv-cinder-784477-10-iscsi devstack@n-api.service[101659]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=101659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 12:50:03.929338 dv-cinder-784477-10-iscsi devstack@n-api.service[101658]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=101658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 12:50:03.929477 dv-cinder-784477-10-iscsi devstack@n-api.service[101658]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=101658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 12:50:03.929597 dv-cinder-784477-10-iscsi devstack@n-api.service[101659]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=101659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 12:50:03.929717 dv-cinder-784477-10-iscsi devstack@n-api.service[101658]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=101658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 12:50:03.929837 dv-cinder-784477-10-iscsi devstack@n-api.service[101659]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=101659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 12:50:03.929995 dv-cinder-784477-10-iscsi devstack@n-api.service[101658]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=101658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 12:50:03.930126 dv-cinder-784477-10-iscsi devstack@n-api.service[101659]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=101659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 12:50:03.930301 dv-cinder-784477-10-iscsi devstack@n-api.service[101658]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=101658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 12:50:03.930427 dv-cinder-784477-10-iscsi devstack@n-api.service[101659]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=101659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 12:50:03.930608 dv-cinder-784477-10-iscsi devstack@n-api.service[101658]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=101658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 12:50:03.930733 dv-cinder-784477-10-iscsi devstack@n-api.service[101659]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=101659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 12:50:03.930913 dv-cinder-784477-10-iscsi devstack@n-api.service[101659]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=101659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 12:50:03.931052 dv-cinder-784477-10-iscsi devstack@n-api.service[101658]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=101658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 12:50:03.931212 dv-cinder-784477-10-iscsi devstack@n-api.service[101658]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=101658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 12:50:03.931336 dv-cinder-784477-10-iscsi devstack@n-api.service[101659]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=101659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 12:50:03.931518 dv-cinder-784477-10-iscsi devstack@n-api.service[101658]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=101658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 12:50:03.931642 dv-cinder-784477-10-iscsi devstack@n-api.service[101659]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=101659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 12:50:03.931819 dv-cinder-784477-10-iscsi devstack@n-api.service[101658]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=101658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 12:50:03.931957 dv-cinder-784477-10-iscsi devstack@n-api.service[101659]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=101659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 12:50:03.932121 dv-cinder-784477-10-iscsi devstack@n-api.service[101658]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=101658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 12:50:03.932253 dv-cinder-784477-10-iscsi devstack@n-api.service[101659]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=101659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 12:50:03.932440 dv-cinder-784477-10-iscsi devstack@n-api.service[101658]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=101658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 12:50:03.932571 dv-cinder-784477-10-iscsi devstack@n-api.service[101659]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=101659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 12:50:03.932747 dv-cinder-784477-10-iscsi devstack@n-api.service[101659]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=101659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 12:50:03.932938 dv-cinder-784477-10-iscsi devstack@n-api.service[101658]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=101658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 12:50:03.933076 dv-cinder-784477-10-iscsi devstack@n-api.service[101658]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=101658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 12:50:03.933205 dv-cinder-784477-10-iscsi devstack@n-api.service[101659]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=101659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 12:50:03.933367 dv-cinder-784477-10-iscsi devstack@n-api.service[101658]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=101658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 12:50:03.933495 dv-cinder-784477-10-iscsi devstack@n-api.service[101659]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=101659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 12:50:03.933674 dv-cinder-784477-10-iscsi devstack@n-api.service[101659]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=101659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 12:50:03.933810 dv-cinder-784477-10-iscsi devstack@n-api.service[101658]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=101658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 12:50:03.933977 dv-cinder-784477-10-iscsi devstack@n-api.service[101658]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=101658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 12:50:03.934107 dv-cinder-784477-10-iscsi devstack@n-api.service[101659]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=101659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 12:50:03.934288 dv-cinder-784477-10-iscsi devstack@n-api.service[101659]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=101659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 12:50:03.934420 dv-cinder-784477-10-iscsi devstack@n-api.service[101658]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=101658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 12:50:03.934591 dv-cinder-784477-10-iscsi devstack@n-api.service[101658]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=101658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 12:50:03.934724 dv-cinder-784477-10-iscsi devstack@n-api.service[101659]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=101659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 12:50:03.934896 dv-cinder-784477-10-iscsi devstack@n-api.service[101658]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=101658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 12:50:03.935019 dv-cinder-784477-10-iscsi devstack@n-api.service[101659]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=101659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 12:50:03.935203 dv-cinder-784477-10-iscsi devstack@n-api.service[101659]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=101659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 12:50:03.935331 dv-cinder-784477-10-iscsi devstack@n-api.service[101658]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=101658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 12:50:03.935505 dv-cinder-784477-10-iscsi devstack@n-api.service[101658]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=101658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 12:50:03.935637 dv-cinder-784477-10-iscsi devstack@n-api.service[101659]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=101659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 12:50:03.935809 dv-cinder-784477-10-iscsi devstack@n-api.service[101658]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=101658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 12:50:03.935984 dv-cinder-784477-10-iscsi devstack@n-api.service[101659]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=101659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 12:50:03.936107 dv-cinder-784477-10-iscsi devstack@n-api.service[101659]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=101659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 12:50:03.936226 dv-cinder-784477-10-iscsi devstack@n-api.service[101658]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=101658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 12:50:03.936408 dv-cinder-784477-10-iscsi devstack@n-api.service[101659]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=101659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 12:50:03.936607 dv-cinder-784477-10-iscsi devstack@n-api.service[101658]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=101658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 12:50:03.936737 dv-cinder-784477-10-iscsi devstack@n-api.service[101658]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=101658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 12:50:03.936877 dv-cinder-784477-10-iscsi devstack@n-api.service[101659]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=101659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 12:50:03.937039 dv-cinder-784477-10-iscsi devstack@n-api.service[101658]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=101658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 12:50:03.937179 dv-cinder-784477-10-iscsi devstack@n-api.service[101659]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=101659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 12:50:03.937338 dv-cinder-784477-10-iscsi devstack@n-api.service[101658]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=101658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 12:50:03.937472 dv-cinder-784477-10-iscsi devstack@n-api.service[101659]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=101659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 12:50:03.937642 dv-cinder-784477-10-iscsi devstack@n-api.service[101658]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=101658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 12:50:03.937767 dv-cinder-784477-10-iscsi devstack@n-api.service[101659]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=101659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 12:50:03.937949 dv-cinder-784477-10-iscsi devstack@n-api.service[101659]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=101659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 12:50:03.938078 dv-cinder-784477-10-iscsi devstack@n-api.service[101658]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=101658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 12:50:03.938253 dv-cinder-784477-10-iscsi devstack@n-api.service[101658]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=101658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 12:50:03.938376 dv-cinder-784477-10-iscsi devstack@n-api.service[101659]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=101659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 12:50:03.938585 dv-cinder-784477-10-iscsi devstack@n-api.service[101659]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=101659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 12:50:03.938718 dv-cinder-784477-10-iscsi devstack@n-api.service[101658]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=101658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 12:50:03.938885 dv-cinder-784477-10-iscsi devstack@n-api.service[101658]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=101658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 12:50:03.939015 dv-cinder-784477-10-iscsi devstack@n-api.service[101659]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=101659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 12:50:03.939189 dv-cinder-784477-10-iscsi devstack@n-api.service[101659]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=101659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 12:50:03.939328 dv-cinder-784477-10-iscsi devstack@n-api.service[101658]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=101658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 12:50:03.939516 dv-cinder-784477-10-iscsi devstack@n-api.service[101658]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=101658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 12:50:03.939641 dv-cinder-784477-10-iscsi devstack@n-api.service[101659]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=101659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 12:50:03.939762 dv-cinder-784477-10-iscsi devstack@n-api.service[101658]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=101658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 12:50:03.939885 dv-cinder-784477-10-iscsi devstack@n-api.service[101659]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=101659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 12:50:03.940061 dv-cinder-784477-10-iscsi devstack@n-api.service[101658]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=101658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 12:50:03.940193 dv-cinder-784477-10-iscsi devstack@n-api.service[101659]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=101659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 12:50:03.940361 dv-cinder-784477-10-iscsi devstack@n-api.service[101659]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=101659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 12:50:03.940492 dv-cinder-784477-10-iscsi devstack@n-api.service[101658]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=101658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 12:50:03.940653 dv-cinder-784477-10-iscsi devstack@n-api.service[101658]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=101658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 12:50:03.940777 dv-cinder-784477-10-iscsi devstack@n-api.service[101659]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=101659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 12:50:03.941006 dv-cinder-784477-10-iscsi devstack@n-api.service[101658]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=101658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 12:50:03.941132 dv-cinder-784477-10-iscsi devstack@n-api.service[101659]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=101659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 12:50:03.941326 dv-cinder-784477-10-iscsi devstack@n-api.service[101658]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=101658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 12:50:03.941459 dv-cinder-784477-10-iscsi devstack@n-api.service[101659]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=101659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 12:50:03.941634 dv-cinder-784477-10-iscsi devstack@n-api.service[101659]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=101659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 12:50:03.941771 dv-cinder-784477-10-iscsi devstack@n-api.service[101658]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=101658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 12:50:03.941938 dv-cinder-784477-10-iscsi devstack@n-api.service[101658]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=101658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 12:50:03.942066 dv-cinder-784477-10-iscsi devstack@n-api.service[101659]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=101659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 12:50:03.942243 dv-cinder-784477-10-iscsi devstack@n-api.service[101658]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=101658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 12:50:03.942367 dv-cinder-784477-10-iscsi devstack@n-api.service[101659]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=101659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 12:50:03.942560 dv-cinder-784477-10-iscsi devstack@n-api.service[101658]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=101658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 12:50:03.942698 dv-cinder-784477-10-iscsi devstack@n-api.service[101659]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=101659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:50:03.942892 dv-cinder-784477-10-iscsi devstack@n-api.service[101658]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=101658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:50:03.943018 dv-cinder-784477-10-iscsi devstack@n-api.service[101659]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=101659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:50:03.943222 dv-cinder-784477-10-iscsi devstack@n-api.service[101658]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=101658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:50:03.943346 dv-cinder-784477-10-iscsi devstack@n-api.service[101659]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=101659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:50:03.943538 dv-cinder-784477-10-iscsi devstack@n-api.service[101659]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=101659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:50:03.943673 dv-cinder-784477-10-iscsi devstack@n-api.service[101658]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=101658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:50:03.943868 dv-cinder-784477-10-iscsi devstack@n-api.service[101658]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=101658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:50:03.943992 dv-cinder-784477-10-iscsi devstack@n-api.service[101659]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=101659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:50:03.944199 dv-cinder-784477-10-iscsi devstack@n-api.service[101658]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=101658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:50:03.944331 dv-cinder-784477-10-iscsi devstack@n-api.service[101659]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=101659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:50:03.944515 dv-cinder-784477-10-iscsi devstack@n-api.service[101659]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=101659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:50:03.944639 dv-cinder-784477-10-iscsi devstack@n-api.service[101658]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=101658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:50:03.944830 dv-cinder-784477-10-iscsi devstack@n-api.service[101659]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=101659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:50:03.944975 dv-cinder-784477-10-iscsi devstack@n-api.service[101658]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=101658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:50:03.945162 dv-cinder-784477-10-iscsi devstack@n-api.service[101658]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=101658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:50:03.945296 dv-cinder-784477-10-iscsi devstack@n-api.service[101659]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=101659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:50:03.945475 dv-cinder-784477-10-iscsi devstack@n-api.service[101658]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=101658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:50:03.945609 dv-cinder-784477-10-iscsi devstack@n-api.service[101659]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=101659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:50:03.945786 dv-cinder-784477-10-iscsi devstack@n-api.service[101659]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=101659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:50:03.945908 dv-cinder-784477-10-iscsi devstack@n-api.service[101658]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=101658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:50:03.946095 dv-cinder-784477-10-iscsi devstack@n-api.service[101658]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=101658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:50:03.946225 dv-cinder-784477-10-iscsi devstack@n-api.service[101659]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=101659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:50:03.946403 dv-cinder-784477-10-iscsi devstack@n-api.service[101658]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=101658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:50:03.946528 dv-cinder-784477-10-iscsi devstack@n-api.service[101659]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=101659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:50:03.946711 dv-cinder-784477-10-iscsi devstack@n-api.service[101658]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=101658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:50:03.946835 dv-cinder-784477-10-iscsi devstack@n-api.service[101659]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=101659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:50:03.947028 dv-cinder-784477-10-iscsi devstack@n-api.service[101658]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=101658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:50:03.947151 dv-cinder-784477-10-iscsi devstack@n-api.service[101659]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=101659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:50:03.947345 dv-cinder-784477-10-iscsi devstack@n-api.service[101658]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=101658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:50:03.947471 dv-cinder-784477-10-iscsi devstack@n-api.service[101659]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=101659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:50:03.947663 dv-cinder-784477-10-iscsi devstack@n-api.service[101659]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=101659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:50:03.947796 dv-cinder-784477-10-iscsi devstack@n-api.service[101658]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=101658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:50:03.947978 dv-cinder-784477-10-iscsi devstack@n-api.service[101658]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=101658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:50:03.948109 dv-cinder-784477-10-iscsi devstack@n-api.service[101659]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=101659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:50:03.948293 dv-cinder-784477-10-iscsi devstack@n-api.service[101658]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=101658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:50:03.948418 dv-cinder-784477-10-iscsi devstack@n-api.service[101659]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=101659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:50:03.948605 dv-cinder-784477-10-iscsi devstack@n-api.service[101659]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=101659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:50:03.948727 dv-cinder-784477-10-iscsi devstack@n-api.service[101658]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=101658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:50:03.948926 dv-cinder-784477-10-iscsi devstack@n-api.service[101658]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=101658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:50:03.949061 dv-cinder-784477-10-iscsi devstack@n-api.service[101659]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=101659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:50:03.949240 dv-cinder-784477-10-iscsi devstack@n-api.service[101658]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=101658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:50:03.949370 dv-cinder-784477-10-iscsi devstack@n-api.service[101659]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=101659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:50:03.949575 dv-cinder-784477-10-iscsi devstack@n-api.service[101658]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=101658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:50:03.949709 dv-cinder-784477-10-iscsi devstack@n-api.service[101659]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=101659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:50:03.949883 dv-cinder-784477-10-iscsi devstack@n-api.service[101659]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=101659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:50:03.949997 dv-cinder-784477-10-iscsi devstack@n-api.service[101658]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=101658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:50:03.950189 dv-cinder-784477-10-iscsi devstack@n-api.service[101658]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=101658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:50:03.950295 dv-cinder-784477-10-iscsi devstack@n-api.service[101659]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=101659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:50:03.950528 dv-cinder-784477-10-iscsi devstack@n-api.service[101658]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=101658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:50:03.950626 dv-cinder-784477-10-iscsi devstack@n-api.service[101659]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=101659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:50:03.950864 dv-cinder-784477-10-iscsi devstack@n-api.service[101659]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=101659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:50:03.950967 dv-cinder-784477-10-iscsi devstack@n-api.service[101658]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=101658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:50:03.951185 dv-cinder-784477-10-iscsi devstack@n-api.service[101658]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=101658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:50:03.951281 dv-cinder-784477-10-iscsi devstack@n-api.service[101659]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=101659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:50:03.951499 dv-cinder-784477-10-iscsi devstack@n-api.service[101659]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=101659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:50:03.951594 dv-cinder-784477-10-iscsi devstack@n-api.service[101658]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=101658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:50:03.951809 dv-cinder-784477-10-iscsi devstack@n-api.service[101658]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=101658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:50:03.951913 dv-cinder-784477-10-iscsi devstack@n-api.service[101659]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=101659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:50:03.952127 dv-cinder-784477-10-iscsi devstack@n-api.service[101659]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=101659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:50:03.952234 dv-cinder-784477-10-iscsi devstack@n-api.service[101658]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=101658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:50:03.952435 dv-cinder-784477-10-iscsi devstack@n-api.service[101658]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=101658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:50:03.952536 dv-cinder-784477-10-iscsi devstack@n-api.service[101659]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=101659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:50:03.952746 dv-cinder-784477-10-iscsi devstack@n-api.service[101658]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=101658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:50:03.952881 dv-cinder-784477-10-iscsi devstack@n-api.service[101659]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=101659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:50:03.953081 dv-cinder-784477-10-iscsi devstack@n-api.service[101658]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=101658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:50:03.953178 dv-cinder-784477-10-iscsi devstack@n-api.service[101659]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=101659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:50:03.953404 dv-cinder-784477-10-iscsi devstack@n-api.service[101658]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=101658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:50:03.953491 dv-cinder-784477-10-iscsi devstack@n-api.service[101659]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=101659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:50:03.953718 dv-cinder-784477-10-iscsi devstack@n-api.service[101659]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=101659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:50:03.953823 dv-cinder-784477-10-iscsi devstack@n-api.service[101658]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=101658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:50:03.954083 dv-cinder-784477-10-iscsi devstack@n-api.service[101658]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=101658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:50:03.954169 dv-cinder-784477-10-iscsi devstack@n-api.service[101659]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=101659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:50:03.954423 dv-cinder-784477-10-iscsi devstack@n-api.service[101658]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=101658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:50:03.954511 dv-cinder-784477-10-iscsi devstack@n-api.service[101659]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=101659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:50:03.954737 dv-cinder-784477-10-iscsi devstack@n-api.service[101658]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=101658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:50:03.954833 dv-cinder-784477-10-iscsi devstack@n-api.service[101659]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=101659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:50:03.955045 dv-cinder-784477-10-iscsi devstack@n-api.service[101659]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=101659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:50:03.955139 dv-cinder-784477-10-iscsi devstack@n-api.service[101658]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=101658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:50:03.955357 dv-cinder-784477-10-iscsi devstack@n-api.service[101658]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=101658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:50:03.955451 dv-cinder-784477-10-iscsi devstack@n-api.service[101659]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=101659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:50:03.955661 dv-cinder-784477-10-iscsi devstack@n-api.service[101659]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=101659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:50:03.955758 dv-cinder-784477-10-iscsi devstack@n-api.service[101658]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=101658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:50:03.955963 dv-cinder-784477-10-iscsi devstack@n-api.service[101658]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=101658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:50:03.956049 dv-cinder-784477-10-iscsi devstack@n-api.service[101659]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=101659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:50:03.956266 dv-cinder-784477-10-iscsi devstack@n-api.service[101659]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=101659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:50:03.956352 dv-cinder-784477-10-iscsi devstack@n-api.service[101658]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=101658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:50:03.956565 dv-cinder-784477-10-iscsi devstack@n-api.service[101658]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=101658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:50:03.956652 dv-cinder-784477-10-iscsi devstack@n-api.service[101659]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=101659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:50:03.956903 dv-cinder-784477-10-iscsi devstack@n-api.service[101658]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=101658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:50:03.956999 dv-cinder-784477-10-iscsi devstack@n-api.service[101659]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=101659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:50:03.957234 dv-cinder-784477-10-iscsi devstack@n-api.service[101659]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=101659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:50:03.957384 dv-cinder-784477-10-iscsi devstack@n-api.service[101658]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=101658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:50:03.957520 dv-cinder-784477-10-iscsi devstack@n-api.service[101658]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=101658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:50:03.957648 dv-cinder-784477-10-iscsi devstack@n-api.service[101659]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=101659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:50:03.957853 dv-cinder-784477-10-iscsi devstack@n-api.service[101658]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=101658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:50:03.957978 dv-cinder-784477-10-iscsi devstack@n-api.service[101659]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=101659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:50:03.958161 dv-cinder-784477-10-iscsi devstack@n-api.service[101658]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=101658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:50:03.958294 dv-cinder-784477-10-iscsi devstack@n-api.service[101659]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=101659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:50:03.958471 dv-cinder-784477-10-iscsi devstack@n-api.service[101659]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=101659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:50:03.958595 dv-cinder-784477-10-iscsi devstack@n-api.service[101658]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=101658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:50:03.958777 dv-cinder-784477-10-iscsi devstack@n-api.service[101658]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=101658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:50:03.958909 dv-cinder-784477-10-iscsi devstack@n-api.service[101659]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=101659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:50:03.959081 dv-cinder-784477-10-iscsi devstack@n-api.service[101658]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=101658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:50:03.959283 dv-cinder-784477-10-iscsi devstack@n-api.service[101659]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=101659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:50:03.959417 dv-cinder-784477-10-iscsi devstack@n-api.service[101659]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=101659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:50:03.959544 dv-cinder-784477-10-iscsi devstack@n-api.service[101658]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=101658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:50:03.959758 dv-cinder-784477-10-iscsi devstack@n-api.service[101659]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=101659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:50:03.959883 dv-cinder-784477-10-iscsi devstack@n-api.service[101658]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=101658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:50:03.960004 dv-cinder-784477-10-iscsi devstack@n-api.service[101658]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=101658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:50:03.960134 dv-cinder-784477-10-iscsi devstack@n-api.service[101659]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=101659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:50:03.960294 dv-cinder-784477-10-iscsi devstack@n-api.service[101658]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=101658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:50:03.960429 dv-cinder-784477-10-iscsi devstack@n-api.service[101659]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=101659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:50:03.960605 dv-cinder-784477-10-iscsi devstack@n-api.service[101659]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=101659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:50:03.960728 dv-cinder-784477-10-iscsi devstack@n-api.service[101658]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=101658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:50:03.960926 dv-cinder-784477-10-iscsi devstack@n-api.service[101658]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=101658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:50:03.961049 dv-cinder-784477-10-iscsi devstack@n-api.service[101659]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=101659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:50:03.961239 dv-cinder-784477-10-iscsi devstack@n-api.service[101658]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=101658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:50:03.961371 dv-cinder-784477-10-iscsi devstack@n-api.service[101659]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=101659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:50:03.961545 dv-cinder-784477-10-iscsi devstack@n-api.service[101658]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=101658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:50:03.961671 dv-cinder-784477-10-iscsi devstack@n-api.service[101659]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=101659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:50:03.961850 dv-cinder-784477-10-iscsi devstack@n-api.service[101658]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=101658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:50:03.961975 dv-cinder-784477-10-iscsi devstack@n-api.service[101659]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=101659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:50:03.962161 dv-cinder-784477-10-iscsi devstack@n-api.service[101659]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=101659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:50:03.962283 dv-cinder-784477-10-iscsi devstack@n-api.service[101658]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=101658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:50:03.962469 dv-cinder-784477-10-iscsi devstack@n-api.service[101658]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=101658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:50:03.962592 dv-cinder-784477-10-iscsi devstack@n-api.service[101659]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=101659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:50:03.962780 dv-cinder-784477-10-iscsi devstack@n-api.service[101658]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=101658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:50:03.962914 dv-cinder-784477-10-iscsi devstack@n-api.service[101659]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=101659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:50:03.963091 dv-cinder-784477-10-iscsi devstack@n-api.service[101658]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=101658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:50:03.963222 dv-cinder-784477-10-iscsi devstack@n-api.service[101659]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=101659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:50:03.963411 dv-cinder-784477-10-iscsi devstack@n-api.service[101659]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=101659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:50:03.963534 dv-cinder-784477-10-iscsi devstack@n-api.service[101658]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=101658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:50:03.963727 dv-cinder-784477-10-iscsi devstack@n-api.service[101659]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=101659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:50:03.963853 dv-cinder-784477-10-iscsi devstack@n-api.service[101658]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=101658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:50:03.964033 dv-cinder-784477-10-iscsi devstack@n-api.service[101658]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=101658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:50:03.964156 dv-cinder-784477-10-iscsi devstack@n-api.service[101659]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=101659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:50:03.964366 dv-cinder-784477-10-iscsi devstack@n-api.service[101658]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=101658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:50:03.964503 dv-cinder-784477-10-iscsi devstack@n-api.service[101659]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=101659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:50:03.964677 dv-cinder-784477-10-iscsi devstack@n-api.service[101659]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=101659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:50:03.964800 dv-cinder-784477-10-iscsi devstack@n-api.service[101658]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=101658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:50:03.965014 dv-cinder-784477-10-iscsi devstack@n-api.service[101658]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=101658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:50:03.965137 dv-cinder-784477-10-iscsi devstack@n-api.service[101659]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=101659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:50:03.965341 dv-cinder-784477-10-iscsi devstack@n-api.service[101658]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=101658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:50:03.965483 dv-cinder-784477-10-iscsi devstack@n-api.service[101659]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=101659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:50:03.965658 dv-cinder-784477-10-iscsi devstack@n-api.service[101659]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=101659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:50:03.965781 dv-cinder-784477-10-iscsi devstack@n-api.service[101658]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=101658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:50:03.965967 dv-cinder-784477-10-iscsi devstack@n-api.service[101659]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=101659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:50:03.966090 dv-cinder-784477-10-iscsi devstack@n-api.service[101658]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=101658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:50:03.966266 dv-cinder-784477-10-iscsi devstack@n-api.service[101658]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=101658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:50:03.966397 dv-cinder-784477-10-iscsi devstack@n-api.service[101659]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=101659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:50:03.966577 dv-cinder-784477-10-iscsi devstack@n-api.service[101658]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=101658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:50:03.966702 dv-cinder-784477-10-iscsi devstack@n-api.service[101659]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=101659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:50:03.966881 dv-cinder-784477-10-iscsi devstack@n-api.service[101658]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=101658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:50:03.967007 dv-cinder-784477-10-iscsi devstack@n-api.service[101659]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=101659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:50:03.967186 dv-cinder-784477-10-iscsi devstack@n-api.service[101659]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=101659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:50:03.967309 dv-cinder-784477-10-iscsi devstack@n-api.service[101658]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=101658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:50:03.967487 dv-cinder-784477-10-iscsi devstack@n-api.service[101658]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=101658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:50:03.967617 dv-cinder-784477-10-iscsi devstack@n-api.service[101659]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=101659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:50:03.967793 dv-cinder-784477-10-iscsi devstack@n-api.service[101659]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=101659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:50:03.967916 dv-cinder-784477-10-iscsi devstack@n-api.service[101658]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=101658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:50:03.968095 dv-cinder-784477-10-iscsi devstack@n-api.service[101658]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=101658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:50:03.968217 dv-cinder-784477-10-iscsi devstack@n-api.service[101659]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=101659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:50:03.968398 dv-cinder-784477-10-iscsi devstack@n-api.service[101659]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=101659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:50:03.968526 dv-cinder-784477-10-iscsi devstack@n-api.service[101658]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=101658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:50:03.968696 dv-cinder-784477-10-iscsi devstack@n-api.service[101658]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=101658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:50:03.968818 dv-cinder-784477-10-iscsi devstack@n-api.service[101659]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=101659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:50:03.969024 dv-cinder-784477-10-iscsi devstack@n-api.service[101658]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=101658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:50:03.969152 dv-cinder-784477-10-iscsi devstack@n-api.service[101659]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=101659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:50:03.969328 dv-cinder-784477-10-iscsi devstack@n-api.service[101658]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=101658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:50:03.969452 dv-cinder-784477-10-iscsi devstack@n-api.service[101659]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=101659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:50:03.969697 dv-cinder-784477-10-iscsi devstack@n-api.service[101659]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=101659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:50:03.969897 dv-cinder-784477-10-iscsi devstack@n-api.service[101658]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=101658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:50:03.970034 dv-cinder-784477-10-iscsi devstack@n-api.service[101658]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=101658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:50:03.970156 dv-cinder-784477-10-iscsi devstack@n-api.service[101659]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=101659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:50:03.970298 dv-cinder-784477-10-iscsi devstack@n-api.service[101658]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=101658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:50:03.970422 dv-cinder-784477-10-iscsi devstack@n-api.service[101659]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=101659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:50:03.970641 dv-cinder-784477-10-iscsi devstack@n-api.service[101658]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=101658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:50:03.970765 dv-cinder-784477-10-iscsi devstack@n-api.service[101659]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=101659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:50:03.970943 dv-cinder-784477-10-iscsi devstack@n-api.service[101658]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=101658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:50:03.971068 dv-cinder-784477-10-iscsi devstack@n-api.service[101659]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=101659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:50:03.971282 dv-cinder-784477-10-iscsi devstack@n-api.service[101659]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=101659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:50:03.971403 dv-cinder-784477-10-iscsi devstack@n-api.service[101658]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=101658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:50:03.971583 dv-cinder-784477-10-iscsi devstack@n-api.service[101658]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=101658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:50:03.971709 dv-cinder-784477-10-iscsi devstack@n-api.service[101659]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=101659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:50:03.971922 dv-cinder-784477-10-iscsi devstack@n-api.service[101658]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=101658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:50:03.972046 dv-cinder-784477-10-iscsi devstack@n-api.service[101659]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=101659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:50:03.972254 dv-cinder-784477-10-iscsi devstack@n-api.service[101658]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=101658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:50:03.972377 dv-cinder-784477-10-iscsi devstack@n-api.service[101659]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=101659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:50:03.972571 dv-cinder-784477-10-iscsi devstack@n-api.service[101658]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=101658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:50:03.972707 dv-cinder-784477-10-iscsi devstack@n-api.service[101659]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=101659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:50:03.972906 dv-cinder-784477-10-iscsi devstack@n-api.service[101659]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=101659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:50:03.973033 dv-cinder-784477-10-iscsi devstack@n-api.service[101658]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=101658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:50:03.973217 dv-cinder-784477-10-iscsi devstack@n-api.service[101658]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=101658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:50:03.973340 dv-cinder-784477-10-iscsi devstack@n-api.service[101659]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=101659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:50:03.973531 dv-cinder-784477-10-iscsi devstack@n-api.service[101659]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=101659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:50:03.973665 dv-cinder-784477-10-iscsi devstack@n-api.service[101658]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=101658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:50:03.973844 dv-cinder-784477-10-iscsi devstack@n-api.service[101658]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=101658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:50:03.973967 dv-cinder-784477-10-iscsi devstack@n-api.service[101659]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=101659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:50:03.974156 dv-cinder-784477-10-iscsi devstack@n-api.service[101658]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=101658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:50:03.974290 dv-cinder-784477-10-iscsi devstack@n-api.service[101659]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=101659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:50:03.974467 dv-cinder-784477-10-iscsi devstack@n-api.service[101659]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=101659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:50:03.974598 dv-cinder-784477-10-iscsi devstack@n-api.service[101658]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=101658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:50:03.974775 dv-cinder-784477-10-iscsi devstack@n-api.service[101658]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=101658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:50:03.974899 dv-cinder-784477-10-iscsi devstack@n-api.service[101659]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=101659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:50:03.975093 dv-cinder-784477-10-iscsi devstack@n-api.service[101659]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=101659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:50:03.975226 dv-cinder-784477-10-iscsi devstack@n-api.service[101658]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=101658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:50:03.975400 dv-cinder-784477-10-iscsi devstack@n-api.service[101658]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=101658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:50:03.975542 dv-cinder-784477-10-iscsi devstack@n-api.service[101659]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=101659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:50:03.975714 dv-cinder-784477-10-iscsi devstack@n-api.service[101659]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=101659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:50:03.975844 dv-cinder-784477-10-iscsi devstack@n-api.service[101658]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=101658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:50:03.976022 dv-cinder-784477-10-iscsi devstack@n-api.service[101658]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=101658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:50:03.976144 dv-cinder-784477-10-iscsi devstack@n-api.service[101659]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=101659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:50:03.976345 dv-cinder-784477-10-iscsi devstack@n-api.service[101659]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=101659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:50:03.976469 dv-cinder-784477-10-iscsi devstack@n-api.service[101658]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=101658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:50:03.976651 dv-cinder-784477-10-iscsi devstack@n-api.service[101658]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=101658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:50:03.976774 dv-cinder-784477-10-iscsi devstack@n-api.service[101659]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=101659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:50:03.976987 dv-cinder-784477-10-iscsi devstack@n-api.service[101659]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=101659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:50:03.977111 dv-cinder-784477-10-iscsi devstack@n-api.service[101658]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=101658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:50:03.977290 dv-cinder-784477-10-iscsi devstack@n-api.service[101658]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=101658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:50:03.977407 dv-cinder-784477-10-iscsi devstack@n-api.service[101659]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=101659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:50:03.977599 dv-cinder-784477-10-iscsi devstack@n-api.service[101658]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=101658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:50:03.977759 dv-cinder-784477-10-iscsi devstack@n-api.service[101659]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=101659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:50:03.977939 dv-cinder-784477-10-iscsi devstack@n-api.service[101658]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=101658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:50:03.978073 dv-cinder-784477-10-iscsi devstack@n-api.service[101659]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=101659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:50:03.978262 dv-cinder-784477-10-iscsi devstack@n-api.service[101659]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=101659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:50:03.978392 dv-cinder-784477-10-iscsi devstack@n-api.service[101658]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=101658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:50:03.978575 dv-cinder-784477-10-iscsi devstack@n-api.service[101658]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=101658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:50:03.978708 dv-cinder-784477-10-iscsi devstack@n-api.service[101659]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=101659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:50:03.978886 dv-cinder-784477-10-iscsi devstack@n-api.service[101659]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=101659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:50:03.979009 dv-cinder-784477-10-iscsi devstack@n-api.service[101658]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=101658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:50:03.979195 dv-cinder-784477-10-iscsi devstack@n-api.service[101658]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=101658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:50:03.979318 dv-cinder-784477-10-iscsi devstack@n-api.service[101659]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=101659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:50:03.979504 dv-cinder-784477-10-iscsi devstack@n-api.service[101659]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=101659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:50:03.979627 dv-cinder-784477-10-iscsi devstack@n-api.service[101658]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=101658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:50:03.979810 dv-cinder-784477-10-iscsi devstack@n-api.service[101658]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=101658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:50:03.980032 dv-cinder-784477-10-iscsi devstack@n-api.service[101659]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=101659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:50:03.980157 dv-cinder-784477-10-iscsi devstack@n-api.service[101659]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=101659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:50:03.980275 dv-cinder-784477-10-iscsi devstack@n-api.service[101658]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=101658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:50:03.980416 dv-cinder-784477-10-iscsi devstack@n-api.service[101658]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=101658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:50:03.980545 dv-cinder-784477-10-iscsi devstack@n-api.service[101659]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=101659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:50:03.980723 dv-cinder-784477-10-iscsi devstack@n-api.service[101658]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=101658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:50:03.980877 dv-cinder-784477-10-iscsi devstack@n-api.service[101659]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=101659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:50:03.981062 dv-cinder-784477-10-iscsi devstack@n-api.service[101659]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=101659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:50:03.981192 dv-cinder-784477-10-iscsi devstack@n-api.service[101658]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=101658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:50:03.981382 dv-cinder-784477-10-iscsi devstack@n-api.service[101659]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=101659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:50:03.981508 dv-cinder-784477-10-iscsi devstack@n-api.service[101658]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=101658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:50:03.981692 dv-cinder-784477-10-iscsi devstack@n-api.service[101659]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=101659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:50:03.981825 dv-cinder-784477-10-iscsi devstack@n-api.service[101658]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=101658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:50:03.982016 dv-cinder-784477-10-iscsi devstack@n-api.service[101659]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=101659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:50:03.982173 dv-cinder-784477-10-iscsi devstack@n-api.service[101658]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=101658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:50:03.982327 dv-cinder-784477-10-iscsi devstack@n-api.service[101659]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=101659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:50:03.982452 dv-cinder-784477-10-iscsi devstack@n-api.service[101658]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=101658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:50:03.982640 dv-cinder-784477-10-iscsi devstack@n-api.service[101658]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=101658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:50:03.982772 dv-cinder-784477-10-iscsi devstack@n-api.service[101659]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=101659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:50:03.982945 dv-cinder-784477-10-iscsi devstack@n-api.service[101659]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=101659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:50:03.983068 dv-cinder-784477-10-iscsi devstack@n-api.service[101658]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=101658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:50:03.983250 dv-cinder-784477-10-iscsi devstack@n-api.service[101658]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=101658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:50:03.983372 dv-cinder-784477-10-iscsi devstack@n-api.service[101659]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=101659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:50:03.983562 dv-cinder-784477-10-iscsi devstack@n-api.service[101658]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=101658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:50:03.983696 dv-cinder-784477-10-iscsi devstack@n-api.service[101659]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=101659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:50:03.983892 dv-cinder-784477-10-iscsi devstack@n-api.service[101658]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=101658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:50:03.984025 dv-cinder-784477-10-iscsi devstack@n-api.service[101659]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=101659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:50:03.984203 dv-cinder-784477-10-iscsi devstack@n-api.service[101659]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=101659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:50:03.984333 dv-cinder-784477-10-iscsi devstack@n-api.service[101658]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=101658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:50:03.984518 dv-cinder-784477-10-iscsi devstack@n-api.service[101659]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=101659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:50:03.984644 dv-cinder-784477-10-iscsi devstack@n-api.service[101658]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=101658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:50:03.984828 dv-cinder-784477-10-iscsi devstack@n-api.service[101658]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=101658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:50:03.985005 dv-cinder-784477-10-iscsi devstack@n-api.service[101659]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=101659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:50:03.985169 dv-cinder-784477-10-iscsi devstack@n-api.service[101659]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=101659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:50:03.985304 dv-cinder-784477-10-iscsi devstack@n-api.service[101658]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=101658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:50:03.985507 dv-cinder-784477-10-iscsi devstack@n-api.service[101658]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=101658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:50:03.985638 dv-cinder-784477-10-iscsi devstack@n-api.service[101659]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=101659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:50:03.985817 dv-cinder-784477-10-iscsi devstack@n-api.service[101658]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=101658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:50:03.985943 dv-cinder-784477-10-iscsi devstack@n-api.service[101659]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=101659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:50:03.986124 dv-cinder-784477-10-iscsi devstack@n-api.service[101659]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=101659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:50:03.986246 dv-cinder-784477-10-iscsi devstack@n-api.service[101658]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=101658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:50:03.986426 dv-cinder-784477-10-iscsi devstack@n-api.service[101658]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=101658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:50:03.986557 dv-cinder-784477-10-iscsi devstack@n-api.service[101659]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=101659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:50:03.986729 dv-cinder-784477-10-iscsi devstack@n-api.service[101658]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=101658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:50:03.986855 dv-cinder-784477-10-iscsi devstack@n-api.service[101659]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=101659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:50:03.987051 dv-cinder-784477-10-iscsi devstack@n-api.service[101658]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=101658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:50:03.987196 dv-cinder-784477-10-iscsi devstack@n-api.service[101659]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=101659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:50:03.987328 dv-cinder-784477-10-iscsi devstack@n-api.service[101658]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=101658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:50:03.987456 dv-cinder-784477-10-iscsi devstack@n-api.service[101659]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=101659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:50:03.987630 dv-cinder-784477-10-iscsi devstack@n-api.service[101658]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=101658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:50:03.987762 dv-cinder-784477-10-iscsi devstack@n-api.service[101659]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=101659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:50:03.987938 dv-cinder-784477-10-iscsi devstack@n-api.service[101659]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=101659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:50:03.988141 dv-cinder-784477-10-iscsi devstack@n-api.service[101658]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=101658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:50:03.988270 dv-cinder-784477-10-iscsi devstack@n-api.service[101658]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=101658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:50:03.988397 dv-cinder-784477-10-iscsi devstack@n-api.service[101659]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=101659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:50:03.988523 dv-cinder-784477-10-iscsi devstack@n-api.service[101658]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=101658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:50:03.988644 dv-cinder-784477-10-iscsi devstack@n-api.service[101659]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=101659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:50:03.988829 dv-cinder-784477-10-iscsi devstack@n-api.service[101658]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=101658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:50:03.988992 dv-cinder-784477-10-iscsi devstack@n-api.service[101659]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=101659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:50:03.989154 dv-cinder-784477-10-iscsi devstack@n-api.service[101658]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=101658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:50:03.989279 dv-cinder-784477-10-iscsi devstack@n-api.service[101659]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=101659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:50:03.989456 dv-cinder-784477-10-iscsi devstack@n-api.service[101658]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=101658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:50:03.989586 dv-cinder-784477-10-iscsi devstack@n-api.service[101659]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=101659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:50:03.989767 dv-cinder-784477-10-iscsi devstack@n-api.service[101658]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=101658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:50:03.989902 dv-cinder-784477-10-iscsi devstack@n-api.service[101659]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=101659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:50:03.990113 dv-cinder-784477-10-iscsi devstack@n-api.service[101659]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=101659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:50:03.990243 dv-cinder-784477-10-iscsi devstack@n-api.service[101658]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=101658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:50:03.990401 dv-cinder-784477-10-iscsi devstack@n-api.service[101658]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=101658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:50:03.990519 dv-cinder-784477-10-iscsi devstack@n-api.service[101659]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=101659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:50:03.990680 dv-cinder-784477-10-iscsi devstack@n-api.service[101658]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=101658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:50:03.990812 dv-cinder-784477-10-iscsi devstack@n-api.service[101659]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=101659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:50:03.991004 dv-cinder-784477-10-iscsi devstack@n-api.service[101658]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=101658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:50:03.991130 dv-cinder-784477-10-iscsi devstack@n-api.service[101659]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=101659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:50:03.991308 dv-cinder-784477-10-iscsi devstack@n-api.service[101659]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=101659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:50:03.991430 dv-cinder-784477-10-iscsi devstack@n-api.service[101658]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=101658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:50:03.991609 dv-cinder-784477-10-iscsi devstack@n-api.service[101658]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=101658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:50:03.991732 dv-cinder-784477-10-iscsi devstack@n-api.service[101659]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=101659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:50:03.991931 dv-cinder-784477-10-iscsi devstack@n-api.service[101658]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=101658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:50:03.992055 dv-cinder-784477-10-iscsi devstack@n-api.service[101659]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=101659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:50:03.992237 dv-cinder-784477-10-iscsi devstack@n-api.service[101659]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=101659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:50:03.992366 dv-cinder-784477-10-iscsi devstack@n-api.service[101658]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=101658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:50:03.992538 dv-cinder-784477-10-iscsi devstack@n-api.service[101658]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=101658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:50:03.992660 dv-cinder-784477-10-iscsi devstack@n-api.service[101659]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=101659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:50:03.992842 dv-cinder-784477-10-iscsi devstack@n-api.service[101658]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=101658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:50:03.993006 dv-cinder-784477-10-iscsi devstack@n-api.service[101659]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=101659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:50:03.993169 dv-cinder-784477-10-iscsi devstack@n-api.service[101658]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=101658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:50:03.993305 dv-cinder-784477-10-iscsi devstack@n-api.service[101659]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=101659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:50:03.993509 dv-cinder-784477-10-iscsi devstack@n-api.service[101659]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=101659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:50:03.993632 dv-cinder-784477-10-iscsi devstack@n-api.service[101658]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=101658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:50:03.993818 dv-cinder-784477-10-iscsi devstack@n-api.service[101659]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=101659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:50:03.993943 dv-cinder-784477-10-iscsi devstack@n-api.service[101658]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=101658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:50:03.994119 dv-cinder-784477-10-iscsi devstack@n-api.service[101658]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=101658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:50:03.994242 dv-cinder-784477-10-iscsi devstack@n-api.service[101659]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=101659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:50:03.994435 dv-cinder-784477-10-iscsi devstack@n-api.service[101658]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=101658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:50:03.994560 dv-cinder-784477-10-iscsi devstack@n-api.service[101659]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=101659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:50:03.994746 dv-cinder-784477-10-iscsi devstack@n-api.service[101659]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=101659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:50:03.994868 dv-cinder-784477-10-iscsi devstack@n-api.service[101658]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=101658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:50:03.995052 dv-cinder-784477-10-iscsi devstack@n-api.service[101658]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=101658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:50:03.995187 dv-cinder-784477-10-iscsi devstack@n-api.service[101659]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=101659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:50:03.995360 dv-cinder-784477-10-iscsi devstack@n-api.service[101659]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=101659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:50:03.995483 dv-cinder-784477-10-iscsi devstack@n-api.service[101658]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=101658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:50:03.995666 dv-cinder-784477-10-iscsi devstack@n-api.service[101658]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=101658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:50:03.995796 dv-cinder-784477-10-iscsi devstack@n-api.service[101659]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=101659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:50:03.995974 dv-cinder-784477-10-iscsi devstack@n-api.service[101658]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=101658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:50:03.996108 dv-cinder-784477-10-iscsi devstack@n-api.service[101659]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=101659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:50:03.996291 dv-cinder-784477-10-iscsi devstack@n-api.service[101659]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=101659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:50:03.996415 dv-cinder-784477-10-iscsi devstack@n-api.service[101658]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=101658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:50:03.996601 dv-cinder-784477-10-iscsi devstack@n-api.service[101659]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=101659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:50:03.996725 dv-cinder-784477-10-iscsi devstack@n-api.service[101658]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=101658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:50:03.996925 dv-cinder-784477-10-iscsi devstack@n-api.service[101658]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=101658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:50:03.997062 dv-cinder-784477-10-iscsi devstack@n-api.service[101659]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=101659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:50:03.997240 dv-cinder-784477-10-iscsi devstack@n-api.service[101659]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=101659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:50:03.997371 dv-cinder-784477-10-iscsi devstack@n-api.service[101658]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=101658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:50:03.997552 dv-cinder-784477-10-iscsi devstack@n-api.service[101658]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=101658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:50:03.997674 dv-cinder-784477-10-iscsi devstack@n-api.service[101659]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=101659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:50:03.997863 dv-cinder-784477-10-iscsi devstack@n-api.service[101658]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=101658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:50:03.997996 dv-cinder-784477-10-iscsi devstack@n-api.service[101659]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=101659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:50:03.998175 dv-cinder-784477-10-iscsi devstack@n-api.service[101658]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=101658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:50:03.998300 dv-cinder-784477-10-iscsi devstack@n-api.service[101659]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=101659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:50:03.998485 dv-cinder-784477-10-iscsi devstack@n-api.service[101659]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=101659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:50:03.998607 dv-cinder-784477-10-iscsi devstack@n-api.service[101658]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=101658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:50:03.998797 dv-cinder-784477-10-iscsi devstack@n-api.service[101658]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=101658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:50:03.998920 dv-cinder-784477-10-iscsi devstack@n-api.service[101659]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=101659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:50:03.999106 dv-cinder-784477-10-iscsi devstack@n-api.service[101659]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=101659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:50:03.999234 dv-cinder-784477-10-iscsi devstack@n-api.service[101658]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=101658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:50:03.999411 dv-cinder-784477-10-iscsi devstack@n-api.service[101659]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=101659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:50:03.999536 dv-cinder-784477-10-iscsi devstack@n-api.service[101658]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=101658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:50:03.999710 dv-cinder-784477-10-iscsi devstack@n-api.service[101658]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=101658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:50:03.999833 dv-cinder-784477-10-iscsi devstack@n-api.service[101659]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=101659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:50:04.000028 dv-cinder-784477-10-iscsi devstack@n-api.service[101658]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=101658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:50:04.000167 dv-cinder-784477-10-iscsi devstack@n-api.service[101659]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=101659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:50:04.000351 dv-cinder-784477-10-iscsi devstack@n-api.service[101658]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=101658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:50:04.000619 dv-cinder-784477-10-iscsi devstack@n-api.service[101659]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=101659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:50:04.000940 dv-cinder-784477-10-iscsi devstack@n-api.service[101658]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=101658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:50:04.001082 dv-cinder-784477-10-iscsi devstack@n-api.service[101659]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=101659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:50:04.001305 dv-cinder-784477-10-iscsi devstack@n-api.service[101658]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=101658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:50:04.001436 dv-cinder-784477-10-iscsi devstack@n-api.service[101659]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=101659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:50:04.001620 dv-cinder-784477-10-iscsi devstack@n-api.service[101658]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=101658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:50:04.001752 dv-cinder-784477-10-iscsi devstack@n-api.service[101659]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=101659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:50:04.001936 dv-cinder-784477-10-iscsi devstack@n-api.service[101658]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=101658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:50:04.002062 dv-cinder-784477-10-iscsi devstack@n-api.service[101659]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=101659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:50:04.002255 dv-cinder-784477-10-iscsi devstack@n-api.service[101658]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=101658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:50:04.002380 dv-cinder-784477-10-iscsi devstack@n-api.service[101659]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=101659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:50:04.002573 dv-cinder-784477-10-iscsi devstack@n-api.service[101658]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=101658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:50:04.002708 dv-cinder-784477-10-iscsi devstack@n-api.service[101659]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=101659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:50:04.002901 dv-cinder-784477-10-iscsi devstack@n-api.service[101658]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=101658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:50:04.003025 dv-cinder-784477-10-iscsi devstack@n-api.service[101659]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=101659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:50:04.003217 dv-cinder-784477-10-iscsi devstack@n-api.service[101659]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=101659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:50:04.003339 dv-cinder-784477-10-iscsi devstack@n-api.service[101658]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=101658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:50:04.003524 dv-cinder-784477-10-iscsi devstack@n-api.service[101659]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=101659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:50:04.003658 dv-cinder-784477-10-iscsi devstack@n-api.service[101658]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=101658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:50:04.003829 dv-cinder-784477-10-iscsi devstack@n-api.service[101658]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=101658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:50:04.003951 dv-cinder-784477-10-iscsi devstack@n-api.service[101659]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=101659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:50:04.004135 dv-cinder-784477-10-iscsi devstack@n-api.service[101659]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=101659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:50:04.004257 dv-cinder-784477-10-iscsi devstack@n-api.service[101658]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=101658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:50:04.004435 dv-cinder-784477-10-iscsi devstack@n-api.service[101658]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=101658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:50:04.004571 dv-cinder-784477-10-iscsi devstack@n-api.service[101659]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=101659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:50:04.004736 dv-cinder-784477-10-iscsi devstack@n-api.service[101658]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=101658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:50:04.004884 dv-cinder-784477-10-iscsi devstack@n-api.service[101659]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=101659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:50:04.005066 dv-cinder-784477-10-iscsi devstack@n-api.service[101659]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=101659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:50:04.005189 dv-cinder-784477-10-iscsi devstack@n-api.service[101658]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=101658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:50:04.005365 dv-cinder-784477-10-iscsi devstack@n-api.service[101658]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=101658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:50:04.005505 dv-cinder-784477-10-iscsi devstack@n-api.service[101659]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=101659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:50:04.005667 dv-cinder-784477-10-iscsi devstack@n-api.service[101659]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=101659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:50:04.005801 dv-cinder-784477-10-iscsi devstack@n-api.service[101658]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=101658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:50:04.005964 dv-cinder-784477-10-iscsi devstack@n-api.service[101658]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=101658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:50:04.006086 dv-cinder-784477-10-iscsi devstack@n-api.service[101659]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=101659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:50:04.006267 dv-cinder-784477-10-iscsi devstack@n-api.service[101659]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=101659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:50:04.006397 dv-cinder-784477-10-iscsi devstack@n-api.service[101658]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=101658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:50:04.006564 dv-cinder-784477-10-iscsi devstack@n-api.service[101658]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=101658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:50:04.006686 dv-cinder-784477-10-iscsi devstack@n-api.service[101659]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=101659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:50:04.006865 dv-cinder-784477-10-iscsi devstack@n-api.service[101658]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=101658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:50:04.006989 dv-cinder-784477-10-iscsi devstack@n-api.service[101659]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=101659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:50:04.007186 dv-cinder-784477-10-iscsi devstack@n-api.service[101659]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=101659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:50:04.007326 dv-cinder-784477-10-iscsi devstack@n-api.service[101658]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=101658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:50:04.007492 dv-cinder-784477-10-iscsi devstack@n-api.service[101658]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=101658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:50:04.007630 dv-cinder-784477-10-iscsi devstack@n-api.service[101659]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=101659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:50:04.007797 dv-cinder-784477-10-iscsi devstack@n-api.service[101659]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=101659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:50:04.007928 dv-cinder-784477-10-iscsi devstack@n-api.service[101658]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=101658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:50:04.008097 dv-cinder-784477-10-iscsi devstack@n-api.service[101658]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=101658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:50:04.008226 dv-cinder-784477-10-iscsi devstack@n-api.service[101659]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=101659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:50:04.008403 dv-cinder-784477-10-iscsi devstack@n-api.service[101659]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=101659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:50:04.008538 dv-cinder-784477-10-iscsi devstack@n-api.service[101658]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=101658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:50:04.008702 dv-cinder-784477-10-iscsi devstack@n-api.service[101658]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=101658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:50:04.008823 dv-cinder-784477-10-iscsi devstack@n-api.service[101659]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=101659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:50:04.009049 dv-cinder-784477-10-iscsi devstack@n-api.service[101658]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=101658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:50:04.009174 dv-cinder-784477-10-iscsi devstack@n-api.service[101659]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=101659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:50:04.009356 dv-cinder-784477-10-iscsi devstack@n-api.service[101659]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=101659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:50:04.009491 dv-cinder-784477-10-iscsi devstack@n-api.service[101658]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=101658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:50:04.009655 dv-cinder-784477-10-iscsi devstack@n-api.service[101658]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=101658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:50:04.009778 dv-cinder-784477-10-iscsi devstack@n-api.service[101659]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=101659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:50:04.009957 dv-cinder-784477-10-iscsi devstack@n-api.service[101659]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=101659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:50:04.010080 dv-cinder-784477-10-iscsi devstack@n-api.service[101658]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=101658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:50:04.010260 dv-cinder-784477-10-iscsi devstack@n-api.service[101658]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=101658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:50:04.010465 dv-cinder-784477-10-iscsi devstack@n-api.service[101659]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=101659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:50:04.010589 dv-cinder-784477-10-iscsi devstack@n-api.service[101659]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=101659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:50:04.010715 dv-cinder-784477-10-iscsi devstack@n-api.service[101658]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=101658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:50:04.010894 dv-cinder-784477-10-iscsi devstack@n-api.service[101658]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=101658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:50:04.011021 dv-cinder-784477-10-iscsi devstack@n-api.service[101659]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=101659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:50:04.011238 dv-cinder-784477-10-iscsi devstack@n-api.service[101658]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=101658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:50:04.011368 dv-cinder-784477-10-iscsi devstack@n-api.service[101659]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=101659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:50:04.011568 dv-cinder-784477-10-iscsi devstack@n-api.service[101658]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=101658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:50:04.011700 dv-cinder-784477-10-iscsi devstack@n-api.service[101659]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=101659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:50:04.011886 dv-cinder-784477-10-iscsi devstack@n-api.service[101659]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=101659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:50:04.012016 dv-cinder-784477-10-iscsi devstack@n-api.service[101658]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=101658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:50:04.012225 dv-cinder-784477-10-iscsi devstack@n-api.service[101659]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=101659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:50:04.012355 dv-cinder-784477-10-iscsi devstack@n-api.service[101658]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=101658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:50:04.012485 dv-cinder-784477-10-iscsi devstack@n-api.service[101658]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=101658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:50:04.012605 dv-cinder-784477-10-iscsi devstack@n-api.service[101659]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=101659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:50:04.012797 dv-cinder-784477-10-iscsi devstack@n-api.service[101658]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=101658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:50:04.012963 dv-cinder-784477-10-iscsi devstack@n-api.service[101659]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=101659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:50:04.013127 dv-cinder-784477-10-iscsi devstack@n-api.service[101658]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=101658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:50:04.013251 dv-cinder-784477-10-iscsi devstack@n-api.service[101659]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=101659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:50:04.013430 dv-cinder-784477-10-iscsi devstack@n-api.service[101659]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=101659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:50:04.013546 dv-cinder-784477-10-iscsi devstack@n-api.service[101658]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=101658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:50:04.013738 dv-cinder-784477-10-iscsi devstack@n-api.service[101658]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=101658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:50:04.013869 dv-cinder-784477-10-iscsi devstack@n-api.service[101659]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=101659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:50:04.014044 dv-cinder-784477-10-iscsi devstack@n-api.service[101659]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=101659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:50:04.014167 dv-cinder-784477-10-iscsi devstack@n-api.service[101658]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=101658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:50:04.014347 dv-cinder-784477-10-iscsi devstack@n-api.service[101658]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=101658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:50:04.014477 dv-cinder-784477-10-iscsi devstack@n-api.service[101659]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=101659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:50:04.014650 dv-cinder-784477-10-iscsi devstack@n-api.service[101658]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=101658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:50:04.014783 dv-cinder-784477-10-iscsi devstack@n-api.service[101659]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=101659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:50:04.014961 dv-cinder-784477-10-iscsi devstack@n-api.service[101659]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=101659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:50:04.015083 dv-cinder-784477-10-iscsi devstack@n-api.service[101658]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=101658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:50:04.015267 dv-cinder-784477-10-iscsi devstack@n-api.service[101658]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=101658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:50:04.015389 dv-cinder-784477-10-iscsi devstack@n-api.service[101659]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=101659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:50:04.015575 dv-cinder-784477-10-iscsi devstack@n-api.service[101659]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=101659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:50:04.015711 dv-cinder-784477-10-iscsi devstack@n-api.service[101658]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=101658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:50:04.015878 dv-cinder-784477-10-iscsi devstack@n-api.service[101659]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=101659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:50:04.016002 dv-cinder-784477-10-iscsi devstack@n-api.service[101658]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=101658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:50:04.016176 dv-cinder-784477-10-iscsi devstack@n-api.service[101658]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=101658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:50:04.016377 dv-cinder-784477-10-iscsi devstack@n-api.service[101659]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=101659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:50:04.016521 dv-cinder-784477-10-iscsi devstack@n-api.service[101659]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=101659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:50:04.016642 dv-cinder-784477-10-iscsi devstack@n-api.service[101658]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=101658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:50:04.016799 dv-cinder-784477-10-iscsi devstack@n-api.service[101658]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=101658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:50:04.016973 dv-cinder-784477-10-iscsi devstack@n-api.service[101659]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=101659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:50:04.017137 dv-cinder-784477-10-iscsi devstack@n-api.service[101658]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=101658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:50:04.017262 dv-cinder-784477-10-iscsi devstack@n-api.service[101659]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=101659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:50:04.017441 dv-cinder-784477-10-iscsi devstack@n-api.service[101659]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=101659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:50:04.017565 dv-cinder-784477-10-iscsi devstack@n-api.service[101658]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=101658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:50:04.017743 dv-cinder-784477-10-iscsi devstack@n-api.service[101658]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=101658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:50:04.017864 dv-cinder-784477-10-iscsi devstack@n-api.service[101659]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=101659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:50:04.018044 dv-cinder-784477-10-iscsi devstack@n-api.service[101658]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=101658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:50:04.018168 dv-cinder-784477-10-iscsi devstack@n-api.service[101659]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=101659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:50:04.018350 dv-cinder-784477-10-iscsi devstack@n-api.service[101659]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=101659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:50:04.018482 dv-cinder-784477-10-iscsi devstack@n-api.service[101658]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=101658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:50:04.018653 dv-cinder-784477-10-iscsi devstack@n-api.service[101658]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=101658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:50:04.018775 dv-cinder-784477-10-iscsi devstack@n-api.service[101659]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=101659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:50:04.018954 dv-cinder-784477-10-iscsi devstack@n-api.service[101658]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=101658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:50:04.019078 dv-cinder-784477-10-iscsi devstack@n-api.service[101659]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=101659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:50:04.019255 dv-cinder-784477-10-iscsi devstack@n-api.service[101659]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=101659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:50:04.019388 dv-cinder-784477-10-iscsi devstack@n-api.service[101658]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=101658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:50:04.019557 dv-cinder-784477-10-iscsi devstack@n-api.service[101658]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=101658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:50:04.019680 dv-cinder-784477-10-iscsi devstack@n-api.service[101659]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=101659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:50:04.019869 dv-cinder-784477-10-iscsi devstack@n-api.service[101659]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=101659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:50:04.020000 dv-cinder-784477-10-iscsi devstack@n-api.service[101658]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=101658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:50:04.020169 dv-cinder-784477-10-iscsi devstack@n-api.service[101658]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=101658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:50:04.020292 dv-cinder-784477-10-iscsi devstack@n-api.service[101659]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=101659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:50:04.020510 dv-cinder-784477-10-iscsi devstack@n-api.service[101658]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=101658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:50:04.020643 dv-cinder-784477-10-iscsi devstack@n-api.service[101659]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=101659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:50:04.020774 dv-cinder-784477-10-iscsi devstack@n-api.service[101658]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=101658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:50:04.020980 dv-cinder-784477-10-iscsi devstack@n-api.service[101659]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=101659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:50:04.021106 dv-cinder-784477-10-iscsi devstack@n-api.service[101658]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=101658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:50:04.021237 dv-cinder-784477-10-iscsi devstack@n-api.service[101659]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=101659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:50:04.021389 dv-cinder-784477-10-iscsi devstack@n-api.service[101658]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=101658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:50:04.021515 dv-cinder-784477-10-iscsi devstack@n-api.service[101659]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=101659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:50:04.021693 dv-cinder-784477-10-iscsi devstack@n-api.service[101658]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=101658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:50:04.021846 dv-cinder-784477-10-iscsi devstack@n-api.service[101659]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=101659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:50:04.022012 dv-cinder-784477-10-iscsi devstack@n-api.service[101659]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=101659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:50:04.022136 dv-cinder-784477-10-iscsi devstack@n-api.service[101658]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=101658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:50:04.022316 dv-cinder-784477-10-iscsi devstack@n-api.service[101659]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=101659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:50:04.022441 dv-cinder-784477-10-iscsi devstack@n-api.service[101658]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=101658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:50:04.022615 dv-cinder-784477-10-iscsi devstack@n-api.service[101658]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=101658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:50:04.022746 dv-cinder-784477-10-iscsi devstack@n-api.service[101659]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=101659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:50:04.022915 dv-cinder-784477-10-iscsi devstack@n-api.service[101658]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=101658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:50:04.023039 dv-cinder-784477-10-iscsi devstack@n-api.service[101659]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=101659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:50:04.023219 dv-cinder-784477-10-iscsi devstack@n-api.service[101659]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=101659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:50:04.023341 dv-cinder-784477-10-iscsi devstack@n-api.service[101658]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=101658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:50:04.023523 dv-cinder-784477-10-iscsi devstack@n-api.service[101659]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=101659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:50:04.023642 dv-cinder-784477-10-iscsi devstack@n-api.service[101658]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=101658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:50:04.023821 dv-cinder-784477-10-iscsi devstack@n-api.service[101658]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=101658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:50:04.023946 dv-cinder-784477-10-iscsi devstack@n-api.service[101659]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=101659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:50:04.024128 dv-cinder-784477-10-iscsi devstack@n-api.service[101658]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=101658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:50:04.024251 dv-cinder-784477-10-iscsi devstack@n-api.service[101659]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=101659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:50:04.024444 dv-cinder-784477-10-iscsi devstack@n-api.service[101659]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=101659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:50:04.024574 dv-cinder-784477-10-iscsi devstack@n-api.service[101658]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=101658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:50:04.024751 dv-cinder-784477-10-iscsi devstack@n-api.service[101659]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=101659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:50:04.024908 dv-cinder-784477-10-iscsi devstack@n-api.service[101658]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=101658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:50:04.025074 dv-cinder-784477-10-iscsi devstack@n-api.service[101658]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=101658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:50:04.025196 dv-cinder-784477-10-iscsi devstack@n-api.service[101659]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=101659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:50:04.025379 dv-cinder-784477-10-iscsi devstack@n-api.service[101659]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=101659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:50:04.025503 dv-cinder-784477-10-iscsi devstack@n-api.service[101658]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=101658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:50:04.025679 dv-cinder-784477-10-iscsi devstack@n-api.service[101658]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=101658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:50:04.025828 dv-cinder-784477-10-iscsi devstack@n-api.service[101659]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=101659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:50:04.025981 dv-cinder-784477-10-iscsi devstack@n-api.service[101659]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=101659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:50:04.026104 dv-cinder-784477-10-iscsi devstack@n-api.service[101658]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=101658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:50:04.026283 dv-cinder-784477-10-iscsi devstack@n-api.service[101658]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=101658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:50:04.026414 dv-cinder-784477-10-iscsi devstack@n-api.service[101659]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=101659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:50:04.026584 dv-cinder-784477-10-iscsi devstack@n-api.service[101659]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=101659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:50:04.026715 dv-cinder-784477-10-iscsi devstack@n-api.service[101658]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=101658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:50:04.026880 dv-cinder-784477-10-iscsi devstack@n-api.service[101658]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=101658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:50:04.027011 dv-cinder-784477-10-iscsi devstack@n-api.service[101659]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=101659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:50:04.027177 dv-cinder-784477-10-iscsi devstack@n-api.service[101658]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=101658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:50:04.027302 dv-cinder-784477-10-iscsi devstack@n-api.service[101659]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=101659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:50:04.027477 dv-cinder-784477-10-iscsi devstack@n-api.service[101659]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=101659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:50:04.027607 dv-cinder-784477-10-iscsi devstack@n-api.service[101658]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=101658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:50:04.027775 dv-cinder-784477-10-iscsi devstack@n-api.service[101658]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=101658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:50:04.027907 dv-cinder-784477-10-iscsi devstack@n-api.service[101659]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=101659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:50:04.028076 dv-cinder-784477-10-iscsi devstack@n-api.service[101658]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=101658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:50:04.028200 dv-cinder-784477-10-iscsi devstack@n-api.service[101659]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=101659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:50:04.028394 dv-cinder-784477-10-iscsi devstack@n-api.service[101659]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=101659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:50:04.028516 dv-cinder-784477-10-iscsi devstack@n-api.service[101658]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=101658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:50:04.028700 dv-cinder-784477-10-iscsi devstack@n-api.service[101659]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=101659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:50:04.028834 dv-cinder-784477-10-iscsi devstack@n-api.service[101658]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=101658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:50:04.029025 dv-cinder-784477-10-iscsi devstack@n-api.service[101658]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=101658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:50:04.029149 dv-cinder-784477-10-iscsi devstack@n-api.service[101659]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=101659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:50:04.029326 dv-cinder-784477-10-iscsi devstack@n-api.service[101659]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=101659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:50:04.029448 dv-cinder-784477-10-iscsi devstack@n-api.service[101658]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=101658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:50:04.029623 dv-cinder-784477-10-iscsi devstack@n-api.service[101658]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=101658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:50:04.029776 dv-cinder-784477-10-iscsi devstack@n-api.service[101659]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=101659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:50:04.029958 dv-cinder-784477-10-iscsi devstack@n-api.service[101659]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=101659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:50:04.030073 dv-cinder-784477-10-iscsi devstack@n-api.service[101658]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=101658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:50:04.030254 dv-cinder-784477-10-iscsi devstack@n-api.service[101658]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=101658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:50:04.030376 dv-cinder-784477-10-iscsi devstack@n-api.service[101659]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=101659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:50:04.030616 dv-cinder-784477-10-iscsi devstack@n-api.service[101658]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=101658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:50:04.030736 dv-cinder-784477-10-iscsi devstack@n-api.service[101659]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=101659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:50:04.030918 dv-cinder-784477-10-iscsi devstack@n-api.service[101658]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=101658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:50:04.031020 dv-cinder-784477-10-iscsi devstack@n-api.service[101659]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=101659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:50:04.031227 dv-cinder-784477-10-iscsi devstack@n-api.service[101658]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=101658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:50:04.031325 dv-cinder-784477-10-iscsi devstack@n-api.service[101659]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=101659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:50:04.031539 dv-cinder-784477-10-iscsi devstack@n-api.service[101659]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=101659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:50:04.031635 dv-cinder-784477-10-iscsi devstack@n-api.service[101658]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=101658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:50:04.031846 dv-cinder-784477-10-iscsi devstack@n-api.service[101658]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=101658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:50:04.031942 dv-cinder-784477-10-iscsi devstack@n-api.service[101659]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=101659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:50:04.032213 dv-cinder-784477-10-iscsi devstack@n-api.service[101659]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=101659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:50:04.032308 dv-cinder-784477-10-iscsi devstack@n-api.service[101658]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=101658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:50:04.032522 dv-cinder-784477-10-iscsi devstack@n-api.service[101659]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=101659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:50:04.032626 dv-cinder-784477-10-iscsi devstack@n-api.service[101658]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=101658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:50:04.032820 dv-cinder-784477-10-iscsi devstack@n-api.service[101658]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=101658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:50:04.032947 dv-cinder-784477-10-iscsi devstack@n-api.service[101659]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=101659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:50:04.033154 dv-cinder-784477-10-iscsi devstack@n-api.service[101658]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=101658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:50:04.033238 dv-cinder-784477-10-iscsi devstack@n-api.service[101659]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=101659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:50:04.033466 dv-cinder-784477-10-iscsi devstack@n-api.service[101659]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=101659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:50:04.033561 dv-cinder-784477-10-iscsi devstack@n-api.service[101658]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=101658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:50:04.033771 dv-cinder-784477-10-iscsi devstack@n-api.service[101659]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=101659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:50:04.033880 dv-cinder-784477-10-iscsi devstack@n-api.service[101658]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=101658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:50:04.034068 dv-cinder-784477-10-iscsi devstack@n-api.service[101658]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=101658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:50:04.034156 dv-cinder-784477-10-iscsi devstack@n-api.service[101659]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=101659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:50:04.034371 dv-cinder-784477-10-iscsi devstack@n-api.service[101658]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=101658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:50:04.034466 dv-cinder-784477-10-iscsi devstack@n-api.service[101659]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=101659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:50:04.034688 dv-cinder-784477-10-iscsi devstack@n-api.service[101659]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=101659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:50:04.034782 dv-cinder-784477-10-iscsi devstack@n-api.service[101658]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=101658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:50:04.034993 dv-cinder-784477-10-iscsi devstack@n-api.service[101658]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=101658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:50:04.035089 dv-cinder-784477-10-iscsi devstack@n-api.service[101659]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=101659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:50:04.035302 dv-cinder-784477-10-iscsi devstack@n-api.service[101658]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=101658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:50:04.035389 dv-cinder-784477-10-iscsi devstack@n-api.service[101659]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=101659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:50:04.035620 dv-cinder-784477-10-iscsi devstack@n-api.service[101658]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=101658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:50:04.035707 dv-cinder-784477-10-iscsi devstack@n-api.service[101659]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=101659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:50:04.035940 dv-cinder-784477-10-iscsi devstack@n-api.service[101658]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=101658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:50:04.036036 dv-cinder-784477-10-iscsi devstack@n-api.service[101659]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=101659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:50:04.036245 dv-cinder-784477-10-iscsi devstack@n-api.service[101659]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=101659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:50:04.036331 dv-cinder-784477-10-iscsi devstack@n-api.service[101658]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=101658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:50:04.036548 dv-cinder-784477-10-iscsi devstack@n-api.service[101658]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=101658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:50:04.036634 dv-cinder-784477-10-iscsi devstack@n-api.service[101659]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=101659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:50:04.036878 dv-cinder-784477-10-iscsi devstack@n-api.service[101658]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=101658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:50:04.036982 dv-cinder-784477-10-iscsi devstack@n-api.service[101659]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=101659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:50:04.037183 dv-cinder-784477-10-iscsi devstack@n-api.service[101658]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=101658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:50:04.037271 dv-cinder-784477-10-iscsi devstack@n-api.service[101659]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=101659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:50:04.037494 dv-cinder-784477-10-iscsi devstack@n-api.service[101659]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=101659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:50:04.037593 dv-cinder-784477-10-iscsi devstack@n-api.service[101658]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=101658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:50:04.037808 dv-cinder-784477-10-iscsi devstack@n-api.service[101659]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=101659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:50:04.037904 dv-cinder-784477-10-iscsi devstack@n-api.service[101658]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=101658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:50:04.038113 dv-cinder-784477-10-iscsi devstack@n-api.service[101658]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=101658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:50:04.038207 dv-cinder-784477-10-iscsi devstack@n-api.service[101659]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=101659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:50:04.038424 dv-cinder-784477-10-iscsi devstack@n-api.service[101658]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=101658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:50:04.038512 dv-cinder-784477-10-iscsi devstack@n-api.service[101659]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=101659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:50:04.038733 dv-cinder-784477-10-iscsi devstack@n-api.service[101659]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=101659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:50:04.038831 dv-cinder-784477-10-iscsi devstack@n-api.service[101658]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=101658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:50:04.039038 dv-cinder-784477-10-iscsi devstack@n-api.service[101658]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=101658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:50:04.039124 dv-cinder-784477-10-iscsi devstack@n-api.service[101659]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=101659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:50:04.039347 dv-cinder-784477-10-iscsi devstack@n-api.service[101659]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=101659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:50:04.039433 dv-cinder-784477-10-iscsi devstack@n-api.service[101658]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=101658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:50:04.039652 dv-cinder-784477-10-iscsi devstack@n-api.service[101658]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=101658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:50:04.039739 dv-cinder-784477-10-iscsi devstack@n-api.service[101659]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=101659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:50:04.039955 dv-cinder-784477-10-iscsi devstack@n-api.service[101658]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=101658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:50:04.040042 dv-cinder-784477-10-iscsi devstack@n-api.service[101659]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=101659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:50:04.040261 dv-cinder-784477-10-iscsi devstack@n-api.service[101658]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=101658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:50:04.040348 dv-cinder-784477-10-iscsi devstack@n-api.service[101659]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=101659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:50:04.040565 dv-cinder-784477-10-iscsi devstack@n-api.service[101659]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=101659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:50:04.040669 dv-cinder-784477-10-iscsi devstack@n-api.service[101658]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=101658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:50:04.040897 dv-cinder-784477-10-iscsi devstack@n-api.service[101658]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=101658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:50:04.040983 dv-cinder-784477-10-iscsi devstack@n-api.service[101659]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=101659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:50:04.041192 dv-cinder-784477-10-iscsi devstack@n-api.service[101658]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=101658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:50:04.041280 dv-cinder-784477-10-iscsi devstack@n-api.service[101659]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=101659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:50:04.041502 dv-cinder-784477-10-iscsi devstack@n-api.service[101658]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=101658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:50:04.041598 dv-cinder-784477-10-iscsi devstack@n-api.service[101659]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=101659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:50:04.041803 dv-cinder-784477-10-iscsi devstack@n-api.service[101658]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=101658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:50:04.041896 dv-cinder-784477-10-iscsi devstack@n-api.service[101659]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=101659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:50:04.042107 dv-cinder-784477-10-iscsi devstack@n-api.service[101659]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=101659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:50:04.042202 dv-cinder-784477-10-iscsi devstack@n-api.service[101658]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=101658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:50:04.042405 dv-cinder-784477-10-iscsi devstack@n-api.service[101658]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=101658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:50:04.042492 dv-cinder-784477-10-iscsi devstack@n-api.service[101659]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=101659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:50:04.042708 dv-cinder-784477-10-iscsi devstack@n-api.service[101659]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=101659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:50:04.042794 dv-cinder-784477-10-iscsi devstack@n-api.service[101658]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=101658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:50:04.043007 dv-cinder-784477-10-iscsi devstack@n-api.service[101658]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=101658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:50:04.043135 dv-cinder-784477-10-iscsi devstack@n-api.service[101659]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=101659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:50:04.043431 dv-cinder-784477-10-iscsi devstack@n-api.service[101658]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=101658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:50:04.043518 dv-cinder-784477-10-iscsi devstack@n-api.service[101659]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=101659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:50:04.043749 dv-cinder-784477-10-iscsi devstack@n-api.service[101658]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=101658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:50:04.043852 dv-cinder-784477-10-iscsi devstack@n-api.service[101659]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=101659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:50:04.044054 dv-cinder-784477-10-iscsi devstack@n-api.service[101659]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=101659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:50:04.044161 dv-cinder-784477-10-iscsi devstack@n-api.service[101658]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=101658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:50:04.044351 dv-cinder-784477-10-iscsi devstack@n-api.service[101658]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=101658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:50:04.044437 dv-cinder-784477-10-iscsi devstack@n-api.service[101659]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=101659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:50:04.044660 dv-cinder-784477-10-iscsi devstack@n-api.service[101658]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=101658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:50:04.044746 dv-cinder-784477-10-iscsi devstack@n-api.service[101659]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=101659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:50:04.044992 dv-cinder-784477-10-iscsi devstack@n-api.service[101658]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=101658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:50:04.045097 dv-cinder-784477-10-iscsi devstack@n-api.service[101659]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=101659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:50:04.045306 dv-cinder-784477-10-iscsi devstack@n-api.service[101659]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=101659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:50:04.045393 dv-cinder-784477-10-iscsi devstack@n-api.service[101658]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=101658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:50:04.045612 dv-cinder-784477-10-iscsi devstack@n-api.service[101659]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=101659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:50:04.045699 dv-cinder-784477-10-iscsi devstack@n-api.service[101658]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=101658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:50:04.045910 dv-cinder-784477-10-iscsi devstack@n-api.service[101658]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=101658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:50:04.046033 dv-cinder-784477-10-iscsi devstack@n-api.service[101659]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=101659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:50:04.046326 dv-cinder-784477-10-iscsi devstack@n-api.service[101658]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=101658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:50:04.046414 dv-cinder-784477-10-iscsi devstack@n-api.service[101659]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=101659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:50:04.046637 dv-cinder-784477-10-iscsi devstack@n-api.service[101658]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=101658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:50:04.046724 dv-cinder-784477-10-iscsi devstack@n-api.service[101659]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=101659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:50:04.046950 dv-cinder-784477-10-iscsi devstack@n-api.service[101658]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=101658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:50:04.047113 dv-cinder-784477-10-iscsi devstack@n-api.service[101659]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=101659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:50:04.047255 dv-cinder-784477-10-iscsi devstack@n-api.service[101659]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=101659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:50:04.047390 dv-cinder-784477-10-iscsi devstack@n-api.service[101658]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=101658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:50:04.047525 dv-cinder-784477-10-iscsi devstack@n-api.service[101659]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=101659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:50:04.047662 dv-cinder-784477-10-iscsi devstack@n-api.service[101658]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=101658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:50:04.047859 dv-cinder-784477-10-iscsi devstack@n-api.service[101658]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=101658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:50:04.048018 dv-cinder-784477-10-iscsi devstack@n-api.service[101659]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=101659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:50:04.048184 dv-cinder-784477-10-iscsi devstack@n-api.service[101658]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=101658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:50:04.048327 dv-cinder-784477-10-iscsi devstack@n-api.service[101659]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=101659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:50:04.048462 dv-cinder-784477-10-iscsi devstack@n-api.service[101658]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=101658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:50:04.048597 dv-cinder-784477-10-iscsi devstack@n-api.service[101659]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=101659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:50:04.048767 dv-cinder-784477-10-iscsi devstack@n-api.service[101658]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=101658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:50:04.049008 dv-cinder-784477-10-iscsi devstack@n-api.service[101659]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=101659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:50:04.049148 dv-cinder-784477-10-iscsi devstack@n-api.service[101658]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=101658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:50:04.049282 dv-cinder-784477-10-iscsi devstack@n-api.service[101659]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=101659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:50:04.049741 dv-cinder-784477-10-iscsi devstack@n-api.service[101658]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=101658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:50:04.049895 dv-cinder-784477-10-iscsi devstack@n-api.service[101659]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=101659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:50:04.050032 dv-cinder-784477-10-iscsi devstack@n-api.service[101658]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=101658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:50:04.050168 dv-cinder-784477-10-iscsi devstack@n-api.service[101659]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=101659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:50:04.050312 dv-cinder-784477-10-iscsi devstack@n-api.service[101658]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=101658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:50:04.050454 dv-cinder-784477-10-iscsi devstack@n-api.service[101659]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=101659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:50:04.050592 dv-cinder-784477-10-iscsi devstack@n-api.service[101658]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=101658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:50:04.050736 dv-cinder-784477-10-iscsi devstack@n-api.service[101659]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=101659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:50:04.051007 dv-cinder-784477-10-iscsi devstack@n-api.service[101658]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=101658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:50:04.051150 dv-cinder-784477-10-iscsi devstack@n-api.service[101659]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=101659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:50:04.051318 dv-cinder-784477-10-iscsi devstack@n-api.service[101658]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=101658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:50:04.051460 dv-cinder-784477-10-iscsi devstack@n-api.service[101659]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=101659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:50:04.051624 dv-cinder-784477-10-iscsi devstack@n-api.service[101658]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=101658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:50:04.051775 dv-cinder-784477-10-iscsi devstack@n-api.service[101659]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=101659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:50:04.052037 dv-cinder-784477-10-iscsi devstack@n-api.service[101659]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=101659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:50:04.052208 dv-cinder-784477-10-iscsi devstack@n-api.service[101658]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=101658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:50:04.052368 dv-cinder-784477-10-iscsi devstack@n-api.service[101658]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=101658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:50:04.052511 dv-cinder-784477-10-iscsi devstack@n-api.service[101659]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=101659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:50:04.052656 dv-cinder-784477-10-iscsi devstack@n-api.service[101658]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=101658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:50:04.052792 dv-cinder-784477-10-iscsi devstack@n-api.service[101659]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=101659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:50:04.052961 dv-cinder-784477-10-iscsi devstack@n-api.service[101658]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=101658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:50:04.053098 dv-cinder-784477-10-iscsi devstack@n-api.service[101659]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=101659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:50:04.053277 dv-cinder-784477-10-iscsi devstack@n-api.service[101658]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=101658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:50:04.053435 dv-cinder-784477-10-iscsi devstack@n-api.service[101659]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=101659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:50:04.053657 dv-cinder-784477-10-iscsi devstack@n-api.service[101659]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=101659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:50:04.053796 dv-cinder-784477-10-iscsi devstack@n-api.service[101658]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=101658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:50:04.053953 dv-cinder-784477-10-iscsi devstack@n-api.service[101659]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=101659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:50:04.054093 dv-cinder-784477-10-iscsi devstack@n-api.service[101658]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=101658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:50:04.054235 dv-cinder-784477-10-iscsi devstack@n-api.service[101659]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=101659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:50:04.054381 dv-cinder-784477-10-iscsi devstack@n-api.service[101658]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=101658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:50:04.054525 dv-cinder-784477-10-iscsi devstack@n-api.service[101658]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=101658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:50:04.054666 dv-cinder-784477-10-iscsi devstack@n-api.service[101659]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=101659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:50:04.054808 dv-cinder-784477-10-iscsi devstack@n-api.service[101658]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=101658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:50:04.054953 dv-cinder-784477-10-iscsi devstack@n-api.service[101659]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=101659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:50:04.055089 dv-cinder-784477-10-iscsi devstack@n-api.service[101658]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=101658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:50:04.055224 dv-cinder-784477-10-iscsi devstack@n-api.service[101659]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=101659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:50:04.055372 dv-cinder-784477-10-iscsi devstack@n-api.service[101658]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=101658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:50:04.055509 dv-cinder-784477-10-iscsi devstack@n-api.service[101659]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=101659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:50:04.055682 dv-cinder-784477-10-iscsi devstack@n-api.service[101658]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=101658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:50:04.055832 dv-cinder-784477-10-iscsi devstack@n-api.service[101659]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=101659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:50:04.055968 dv-cinder-784477-10-iscsi devstack@n-api.service[101658]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=101658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:50:04.056103 dv-cinder-784477-10-iscsi devstack@n-api.service[101659]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=101659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:50:04.056290 dv-cinder-784477-10-iscsi devstack@n-api.service[101658]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=101658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:50:04.056434 dv-cinder-784477-10-iscsi devstack@n-api.service[101659]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=101659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:50:04.056610 dv-cinder-784477-10-iscsi devstack@n-api.service[101658]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=101658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:50:04.056752 dv-cinder-784477-10-iscsi devstack@n-api.service[101659]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=101659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:50:04.056942 dv-cinder-784477-10-iscsi devstack@n-api.service[101658]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=101658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:50:04.057098 dv-cinder-784477-10-iscsi devstack@n-api.service[101659]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=101659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:50:04.057264 dv-cinder-784477-10-iscsi devstack@n-api.service[101658]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=101658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:50:04.057407 dv-cinder-784477-10-iscsi devstack@n-api.service[101659]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=101659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:50:04.057671 dv-cinder-784477-10-iscsi devstack@n-api.service[101659]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=101659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:50:04.057810 dv-cinder-784477-10-iscsi devstack@n-api.service[101658]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=101658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:50:04.057988 dv-cinder-784477-10-iscsi devstack@n-api.service[101659]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=101659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:50:04.058144 dv-cinder-784477-10-iscsi devstack@n-api.service[101658]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=101658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:50:04.058293 dv-cinder-784477-10-iscsi devstack@n-api.service[101658]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=101658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:50:04.058441 dv-cinder-784477-10-iscsi devstack@n-api.service[101659]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=101659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:50:04.058598 dv-cinder-784477-10-iscsi devstack@n-api.service[101658]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=101658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:50:04.058741 dv-cinder-784477-10-iscsi devstack@n-api.service[101659]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=101659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:50:04.058917 dv-cinder-784477-10-iscsi devstack@n-api.service[101659]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=101659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:50:04.059059 dv-cinder-784477-10-iscsi devstack@n-api.service[101658]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=101658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:50:04.059220 dv-cinder-784477-10-iscsi devstack@n-api.service[101658]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=101658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:50:04.059369 dv-cinder-784477-10-iscsi devstack@n-api.service[101659]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=101659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:50:04.059505 dv-cinder-784477-10-iscsi devstack@n-api.service[101658]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=101658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:50:04.059640 dv-cinder-784477-10-iscsi devstack@n-api.service[101659]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=101659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:50:04.059814 dv-cinder-784477-10-iscsi devstack@n-api.service[101658]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=101658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:50:04.059956 dv-cinder-784477-10-iscsi devstack@n-api.service[101659]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=101659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:50:04.060098 dv-cinder-784477-10-iscsi devstack@n-api.service[101659]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=101659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:50:04.060252 dv-cinder-784477-10-iscsi devstack@n-api.service[101658]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=101658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:50:04.060390 dv-cinder-784477-10-iscsi devstack@n-api.service[101658]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=101658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:50:04.060530 dv-cinder-784477-10-iscsi devstack@n-api.service[101659]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=101659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:50:04.060709 dv-cinder-784477-10-iscsi devstack@n-api.service[101658]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=101658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:50:04.060878 dv-cinder-784477-10-iscsi devstack@n-api.service[101659]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=101659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:50:04.061021 dv-cinder-784477-10-iscsi devstack@n-api.service[101658]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=101658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:50:04.061169 dv-cinder-784477-10-iscsi devstack@n-api.service[101659]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=101659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:50:04.061313 dv-cinder-784477-10-iscsi devstack@n-api.service[101658]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=101658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:50:04.061450 dv-cinder-784477-10-iscsi devstack@n-api.service[101659]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=101659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:50:04.061626 dv-cinder-784477-10-iscsi devstack@n-api.service[101658]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=101658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:50:04.061769 dv-cinder-784477-10-iscsi devstack@n-api.service[101659]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=101659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:50:04.061934 dv-cinder-784477-10-iscsi devstack@n-api.service[101658]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=101658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:50:04.062083 dv-cinder-784477-10-iscsi devstack@n-api.service[101659]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=101659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:50:04.062234 dv-cinder-784477-10-iscsi devstack@n-api.service[101658]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=101658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:50:04.062381 dv-cinder-784477-10-iscsi devstack@n-api.service[101659]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=101659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:50:04.062518 dv-cinder-784477-10-iscsi devstack@n-api.service[101658]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=101658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:50:04.062653 dv-cinder-784477-10-iscsi devstack@n-api.service[101659]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=101659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:50:04.062823 dv-cinder-784477-10-iscsi devstack@n-api.service[101658]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=101658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:50:04.062966 dv-cinder-784477-10-iscsi devstack@n-api.service[101659]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=101659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:50:04.063122 dv-cinder-784477-10-iscsi devstack@n-api.service[101658]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=101658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:50:04.063264 dv-cinder-784477-10-iscsi devstack@n-api.service[101659]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=101659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:50:04.063498 dv-cinder-784477-10-iscsi devstack@n-api.service[101658]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=101658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:50:04.063671 dv-cinder-784477-10-iscsi devstack@n-api.service[101659]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=101659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:50:04.063887 dv-cinder-784477-10-iscsi devstack@n-api.service[101658]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=101658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:50:04.064029 dv-cinder-784477-10-iscsi devstack@n-api.service[101659]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=101659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:50:04.064165 dv-cinder-784477-10-iscsi devstack@n-api.service[101658]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=101658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:50:04.064311 dv-cinder-784477-10-iscsi devstack@n-api.service[101659]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=101659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:50:04.064449 dv-cinder-784477-10-iscsi devstack@n-api.service[101659]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=101659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:50:04.064786 dv-cinder-784477-10-iscsi devstack@n-api.service[101658]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=101658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:50:04.064786 dv-cinder-784477-10-iscsi devstack@n-api.service[101658]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=101658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:50:04.065152 dv-cinder-784477-10-iscsi devstack@n-api.service[101659]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=101659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:50:04.065294 dv-cinder-784477-10-iscsi devstack@n-api.service[101658]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=101658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:50:04.065439 dv-cinder-784477-10-iscsi devstack@n-api.service[101659]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=101659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:50:04.065718 dv-cinder-784477-10-iscsi devstack@n-api.service[101658]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=101658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:50:04.065872 dv-cinder-784477-10-iscsi devstack@n-api.service[101659]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=101659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:50:04.066078 dv-cinder-784477-10-iscsi devstack@n-api.service[101658]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=101658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:50:04.066224 dv-cinder-784477-10-iscsi devstack@n-api.service[101659]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=101659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:50:04.066361 dv-cinder-784477-10-iscsi devstack@n-api.service[101658]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=101658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:50:04.066496 dv-cinder-784477-10-iscsi devstack@n-api.service[101659]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=101659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:50:04.066643 dv-cinder-784477-10-iscsi devstack@n-api.service[101658]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=101658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:50:04.066789 dv-cinder-784477-10-iscsi devstack@n-api.service[101659]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=101659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:50:04.066926 dv-cinder-784477-10-iscsi devstack@n-api.service[101658]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=101658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:50:04.067061 dv-cinder-784477-10-iscsi devstack@n-api.service[101659]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=101659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:50:04.067196 dv-cinder-784477-10-iscsi devstack@n-api.service[101658]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=101658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:50:04.067331 dv-cinder-784477-10-iscsi devstack@n-api.service[101659]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=101659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:50:04.067467 dv-cinder-784477-10-iscsi devstack@n-api.service[101658]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=101658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:50:04.067613 dv-cinder-784477-10-iscsi devstack@n-api.service[101659]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=101659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:50:04.067757 dv-cinder-784477-10-iscsi devstack@n-api.service[101658]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=101658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:50:04.067893 dv-cinder-784477-10-iscsi devstack@n-api.service[101659]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=101659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:50:04.068035 dv-cinder-784477-10-iscsi devstack@n-api.service[101658]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=101658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:50:04.068172 dv-cinder-784477-10-iscsi devstack@n-api.service[101659]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=101659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:50:04.068317 dv-cinder-784477-10-iscsi devstack@n-api.service[101658]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=101658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:50:04.068462 dv-cinder-784477-10-iscsi devstack@n-api.service[101659]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=101659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:50:04.068599 dv-cinder-784477-10-iscsi devstack@n-api.service[101658]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=101658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:50:04.068742 dv-cinder-784477-10-iscsi devstack@n-api.service[101659]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=101659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:50:04.068915 dv-cinder-784477-10-iscsi devstack@n-api.service[101658]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=101658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:50:04.069069 dv-cinder-784477-10-iscsi devstack@n-api.service[101659]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=101659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:50:04.069214 dv-cinder-784477-10-iscsi devstack@n-api.service[101658]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=101658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:50:04.069350 dv-cinder-784477-10-iscsi devstack@n-api.service[101659]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=101659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:50:04.069492 dv-cinder-784477-10-iscsi devstack@n-api.service[101658]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=101658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:50:04.069628 dv-cinder-784477-10-iscsi devstack@n-api.service[101659]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=101659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:50:04.069765 dv-cinder-784477-10-iscsi devstack@n-api.service[101658]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=101658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:50:04.069900 dv-cinder-784477-10-iscsi devstack@n-api.service[101659]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=101659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:50:04.070043 dv-cinder-784477-10-iscsi devstack@n-api.service[101658]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=101658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:50:04.070189 dv-cinder-784477-10-iscsi devstack@n-api.service[101659]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=101659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:50:04.070332 dv-cinder-784477-10-iscsi devstack@n-api.service[101658]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=101658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:50:04.070474 dv-cinder-784477-10-iscsi devstack@n-api.service[101659]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=101659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:50:04.070631 dv-cinder-784477-10-iscsi devstack@n-api.service[101658]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=101658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:50:04.070772 dv-cinder-784477-10-iscsi devstack@n-api.service[101659]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=101659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:50:04.070918 dv-cinder-784477-10-iscsi devstack@n-api.service[101658]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=101658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:50:04.071072 dv-cinder-784477-10-iscsi devstack@n-api.service[101658]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=101658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:50:04.071312 dv-cinder-784477-10-iscsi devstack@n-api.service[101658]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=101658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:50:04.071633 dv-cinder-784477-10-iscsi devstack@n-api.service[101658]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=101658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:50:04.072076 dv-cinder-784477-10-iscsi devstack@n-api.service[101658]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=101658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:50:04.072217 dv-cinder-784477-10-iscsi devstack@n-api.service[101659]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=101659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:50:04.072467 dv-cinder-784477-10-iscsi devstack@n-api.service[101659]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=101659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:50:04.072609 dv-cinder-784477-10-iscsi devstack@n-api.service[101658]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=101658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:50:04.072795 dv-cinder-784477-10-iscsi devstack@n-api.service[101659]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=101659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:50:04.073011 dv-cinder-784477-10-iscsi devstack@n-api.service[101658]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=101658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:50:04.073154 dv-cinder-784477-10-iscsi devstack@n-api.service[101659]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=101659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:50:04.073439 dv-cinder-784477-10-iscsi devstack@n-api.service[101659]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=101659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:50:04.073603 dv-cinder-784477-10-iscsi devstack@n-api.service[101658]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=101658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:50:04.073760 dv-cinder-784477-10-iscsi devstack@n-api.service[101659]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=101659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:50:04.073921 dv-cinder-784477-10-iscsi devstack@n-api.service[101658]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=101658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:50:04.074132 dv-cinder-784477-10-iscsi devstack@n-api.service[101659]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=101659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:50:04.074273 dv-cinder-784477-10-iscsi devstack@n-api.service[101658]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=101658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:50:04.074418 dv-cinder-784477-10-iscsi devstack@n-api.service[101659]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=101659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:50:04.074554 dv-cinder-784477-10-iscsi devstack@n-api.service[101658]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=101658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:50:04.074689 dv-cinder-784477-10-iscsi devstack@n-api.service[101659]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=101659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:50:04.074835 dv-cinder-784477-10-iscsi devstack@n-api.service[101658]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=101658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:50:04.074973 dv-cinder-784477-10-iscsi devstack@n-api.service[101659]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=101659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:50:04.075108 dv-cinder-784477-10-iscsi devstack@n-api.service[101658]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=101658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:50:04.075252 dv-cinder-784477-10-iscsi devstack@n-api.service[101659]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=101659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:50:04.075396 dv-cinder-784477-10-iscsi devstack@n-api.service[101658]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=101658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:50:04.075565 dv-cinder-784477-10-iscsi devstack@n-api.service[101659]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=101659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:50:04.075708 dv-cinder-784477-10-iscsi devstack@n-api.service[101658]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=101658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:50:04.075874 dv-cinder-784477-10-iscsi devstack@n-api.service[101659]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=101659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:50:04.076026 dv-cinder-784477-10-iscsi devstack@n-api.service[101658]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=101658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:50:04.076219 dv-cinder-784477-10-iscsi devstack@n-api.service[101659]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=101659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:50:04.076375 dv-cinder-784477-10-iscsi devstack@n-api.service[101658]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=101658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:50:04.076514 dv-cinder-784477-10-iscsi devstack@n-api.service[101659]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=101659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:50:04.076657 dv-cinder-784477-10-iscsi devstack@n-api.service[101658]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=101658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:50:04.076892 dv-cinder-784477-10-iscsi devstack@n-api.service[101659]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=101659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:50:04.077053 dv-cinder-784477-10-iscsi devstack@n-api.service[101658]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=101658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:50:04.077191 dv-cinder-784477-10-iscsi devstack@n-api.service[101659]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=101659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:50:04.077326 dv-cinder-784477-10-iscsi devstack@n-api.service[101658]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=101658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:50:04.077510 dv-cinder-784477-10-iscsi devstack@n-api.service[101659]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=101659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:50:04.077652 dv-cinder-784477-10-iscsi devstack@n-api.service[101658]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=101658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:50:04.077835 dv-cinder-784477-10-iscsi devstack@n-api.service[101658]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=101658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:50:04.077984 dv-cinder-784477-10-iscsi devstack@n-api.service[101659]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=101659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:50:04.078146 dv-cinder-784477-10-iscsi devstack@n-api.service[101659]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=101659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:50:04.078294 dv-cinder-784477-10-iscsi devstack@n-api.service[101658]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=101658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:50:04.078459 dv-cinder-784477-10-iscsi devstack@n-api.service[101658]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=101658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:50:04.078599 dv-cinder-784477-10-iscsi devstack@n-api.service[101659]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=101659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:50:04.078772 dv-cinder-784477-10-iscsi devstack@n-api.service[101658]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=101658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:50:04.078933 dv-cinder-784477-10-iscsi devstack@n-api.service[101659]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=101659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:50:04.079103 dv-cinder-784477-10-iscsi devstack@n-api.service[101658]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=101658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:50:04.079241 dv-cinder-784477-10-iscsi devstack@n-api.service[101659]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=101659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:50:04.079420 dv-cinder-784477-10-iscsi devstack@n-api.service[101658]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=101658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:50:04.079580 dv-cinder-784477-10-iscsi devstack@n-api.service[101659]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=101659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:50:04.079737 dv-cinder-784477-10-iscsi devstack@n-api.service[101658]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=101658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:50:04.079889 dv-cinder-784477-10-iscsi devstack@n-api.service[101659]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=101659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:50:04.080054 dv-cinder-784477-10-iscsi devstack@n-api.service[101659]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=101659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:50:04.080196 dv-cinder-784477-10-iscsi devstack@n-api.service[101658]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=101658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:50:04.080361 dv-cinder-784477-10-iscsi devstack@n-api.service[101658]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=101658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:50:04.080502 dv-cinder-784477-10-iscsi devstack@n-api.service[101659]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=101659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:50:04.080685 dv-cinder-784477-10-iscsi devstack@n-api.service[101659]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=101659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:50:04.080823 dv-cinder-784477-10-iscsi devstack@n-api.service[101658]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=101658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:50:04.081030 dv-cinder-784477-10-iscsi devstack@n-api.service[101659]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=101659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:50:04.081168 dv-cinder-784477-10-iscsi devstack@n-api.service[101658]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=101658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:50:04.081304 dv-cinder-784477-10-iscsi devstack@n-api.service[101659]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=101659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:50:04.081440 dv-cinder-784477-10-iscsi devstack@n-api.service[101658]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=101658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:50:04.081613 dv-cinder-784477-10-iscsi devstack@n-api.service[101659]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=101659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:50:04.081814 dv-cinder-784477-10-iscsi devstack@n-api.service[101658]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=101658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:50:04.081964 dv-cinder-784477-10-iscsi devstack@n-api.service[101659]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=101659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:50:04.082226 dv-cinder-784477-10-iscsi devstack@n-api.service[101658]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=101658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:50:04.082448 dv-cinder-784477-10-iscsi devstack@n-api.service[101659]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=101659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:50:04.082590 dv-cinder-784477-10-iscsi devstack@n-api.service[101658]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=101658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:50:04.082782 dv-cinder-784477-10-iscsi devstack@n-api.service[101659]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=101659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:50:04.082932 dv-cinder-784477-10-iscsi devstack@n-api.service[101658]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=101658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:50:04.083104 dv-cinder-784477-10-iscsi devstack@n-api.service[101659]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=101659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:50:04.083255 dv-cinder-784477-10-iscsi devstack@n-api.service[101658]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=101658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:50:04.083432 dv-cinder-784477-10-iscsi devstack@n-api.service[101659]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=101659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:50:04.083568 dv-cinder-784477-10-iscsi devstack@n-api.service[101658]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=101658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:50:04.083713 dv-cinder-784477-10-iscsi devstack@n-api.service[101659]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=101659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:50:04.083850 dv-cinder-784477-10-iscsi devstack@n-api.service[101658]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=101658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:50:04.084030 dv-cinder-784477-10-iscsi devstack@n-api.service[101659]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=101659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:50:04.084254 dv-cinder-784477-10-iscsi devstack@n-api.service[101658]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=101658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:50:04.084404 dv-cinder-784477-10-iscsi devstack@n-api.service[101658]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=101658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:50:04.084554 dv-cinder-784477-10-iscsi devstack@n-api.service[101659]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=101659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:50:04.084692 dv-cinder-784477-10-iscsi devstack@n-api.service[101658]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=101658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:50:04.084827 dv-cinder-784477-10-iscsi devstack@n-api.service[101659]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=101659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:50:04.085009 dv-cinder-784477-10-iscsi devstack@n-api.service[101658]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=101658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:50:04.085159 dv-cinder-784477-10-iscsi devstack@n-api.service[101659]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=101659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:50:04.085295 dv-cinder-784477-10-iscsi devstack@n-api.service[101658]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=101658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:50:04.085448 dv-cinder-784477-10-iscsi devstack@n-api.service[101659]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=101659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:50:04.085586 dv-cinder-784477-10-iscsi devstack@n-api.service[101659]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=101659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:50:04.085719 dv-cinder-784477-10-iscsi devstack@n-api.service[101658]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=101658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:50:04.085884 dv-cinder-784477-10-iscsi devstack@n-api.service[101659]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=101659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:50:04.086027 dv-cinder-784477-10-iscsi devstack@n-api.service[101658]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=101658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:50:04.086207 dv-cinder-784477-10-iscsi devstack@n-api.service[101659]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=101659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:50:04.086358 dv-cinder-784477-10-iscsi devstack@n-api.service[101658]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=101658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:50:04.086518 dv-cinder-784477-10-iscsi devstack@n-api.service[101658]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=101658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:50:04.086659 dv-cinder-784477-10-iscsi devstack@n-api.service[101659]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=101659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:50:04.086834 dv-cinder-784477-10-iscsi devstack@n-api.service[101658]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=101658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:50:04.087000 dv-cinder-784477-10-iscsi devstack@n-api.service[101659]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=101659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:50:04.087248 dv-cinder-784477-10-iscsi devstack@n-api.service[101658]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=101658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:50:04.087498 dv-cinder-784477-10-iscsi devstack@n-api.service[101659]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=101659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:50:04.087647 dv-cinder-784477-10-iscsi devstack@n-api.service[101658]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=101658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:50:04.087792 dv-cinder-784477-10-iscsi devstack@n-api.service[101659]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=101659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:50:04.087792 dv-cinder-784477-10-iscsi devstack@n-api.service[101659]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=101659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:50:04.088051 dv-cinder-784477-10-iscsi devstack@n-api.service[101658]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=101658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:50:04.088236 dv-cinder-784477-10-iscsi devstack@n-api.service[101659]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=101659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:50:04.088376 dv-cinder-784477-10-iscsi devstack@n-api.service[101658]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=101658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:50:04.088376 dv-cinder-784477-10-iscsi devstack@n-api.service[101658]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=101658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:50:04.088646 dv-cinder-784477-10-iscsi devstack@n-api.service[101659]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=101659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:50:04.088925 dv-cinder-784477-10-iscsi devstack@n-api.service[101658]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=101658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:50:04.089162 dv-cinder-784477-10-iscsi devstack@n-api.service[101659]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=101659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:50:04.089368 dv-cinder-784477-10-iscsi devstack@n-api.service[101658]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=101658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:50:04.089585 dv-cinder-784477-10-iscsi devstack@n-api.service[101659]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=101659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:50:04.089790 dv-cinder-784477-10-iscsi devstack@n-api.service[101658]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=101658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:50:04.089987 dv-cinder-784477-10-iscsi devstack@n-api.service[101659]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=101659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:50:04.090178 dv-cinder-784477-10-iscsi devstack@n-api.service[101658]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=101658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:50:04.090431 dv-cinder-784477-10-iscsi devstack@n-api.service[101659]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=101659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:50:04.090625 dv-cinder-784477-10-iscsi devstack@n-api.service[101658]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=101658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:50:04.090858 dv-cinder-784477-10-iscsi devstack@n-api.service[101659]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=101659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:50:04.091053 dv-cinder-784477-10-iscsi devstack@n-api.service[101658]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=101658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:50:04.091243 dv-cinder-784477-10-iscsi devstack@n-api.service[101659]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=101659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:50:04.091463 dv-cinder-784477-10-iscsi devstack@n-api.service[101658]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=101658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:50:04.091658 dv-cinder-784477-10-iscsi devstack@n-api.service[101659]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=101659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:50:04.091861 dv-cinder-784477-10-iscsi devstack@n-api.service[101658]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=101658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:50:04.092056 dv-cinder-784477-10-iscsi devstack@n-api.service[101659]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=101659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:50:04.092250 dv-cinder-784477-10-iscsi devstack@n-api.service[101658]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=101658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:50:04.092451 dv-cinder-784477-10-iscsi devstack@n-api.service[101659]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=101659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:50:04.092656 dv-cinder-784477-10-iscsi devstack@n-api.service[101658]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=101658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:50:04.092905 dv-cinder-784477-10-iscsi devstack@n-api.service[101659]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=101659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:50:04.093084 dv-cinder-784477-10-iscsi devstack@n-api.service[101658]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=101658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:50:04.093286 dv-cinder-784477-10-iscsi devstack@n-api.service[101659]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=101659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:50:04.093435 dv-cinder-784477-10-iscsi devstack@n-api.service[101658]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=101658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:50:04.093579 dv-cinder-784477-10-iscsi devstack@n-api.service[101659]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=101659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:50:04.093735 dv-cinder-784477-10-iscsi devstack@n-api.service[101658]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=101658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:50:04.093892 dv-cinder-784477-10-iscsi devstack@n-api.service[101659]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=101659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:50:04.094034 dv-cinder-784477-10-iscsi devstack@n-api.service[101658]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=101658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:50:04.094183 dv-cinder-784477-10-iscsi devstack@n-api.service[101659]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=101659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:50:04.094183 dv-cinder-784477-10-iscsi devstack@n-api.service[101659]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=101659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:50:04.094560 dv-cinder-784477-10-iscsi devstack@n-api.service[101658]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=101658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:50:04.094783 dv-cinder-784477-10-iscsi devstack@n-api.service[101659]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=101659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:50:04.094941 dv-cinder-784477-10-iscsi devstack@n-api.service[101658]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=101658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:50:04.095085 dv-cinder-784477-10-iscsi devstack@n-api.service[101659]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=101659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:50:04.095256 dv-cinder-784477-10-iscsi devstack@n-api.service[101658]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=101658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:50:04.095404 dv-cinder-784477-10-iscsi devstack@n-api.service[101659]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=101659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:50:04.095404 dv-cinder-784477-10-iscsi devstack@n-api.service[101659]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=101659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:50:04.095687 dv-cinder-784477-10-iscsi devstack@n-api.service[101658]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=101658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:50:04.095687 dv-cinder-784477-10-iscsi devstack@n-api.service[101658]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=101658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:50:04.095989 dv-cinder-784477-10-iscsi devstack@n-api.service[101659]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=101659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:50:04.096132 dv-cinder-784477-10-iscsi devstack@n-api.service[101658]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=101658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:50:04.096273 dv-cinder-784477-10-iscsi devstack@n-api.service[101659]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=101659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:50:04.096430 dv-cinder-784477-10-iscsi devstack@n-api.service[101658]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=101658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:50:04.096574 dv-cinder-784477-10-iscsi devstack@n-api.service[101659]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=101659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:50:04.096715 dv-cinder-784477-10-iscsi devstack@n-api.service[101658]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=101658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:50:04.096912 dv-cinder-784477-10-iscsi devstack@n-api.service[101659]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=101659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:50:04.097148 dv-cinder-784477-10-iscsi devstack@n-api.service[101658]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=101658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:50:04.097349 dv-cinder-784477-10-iscsi devstack@n-api.service[101659]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=101659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:50:04.097558 dv-cinder-784477-10-iscsi devstack@n-api.service[101658]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=101658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:50:04.097756 dv-cinder-784477-10-iscsi devstack@n-api.service[101659]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=101659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:50:04.097961 dv-cinder-784477-10-iscsi devstack@n-api.service[101658]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=101658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:50:04.098121 dv-cinder-784477-10-iscsi devstack@n-api.service[101659]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=101659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:50:04.098264 dv-cinder-784477-10-iscsi devstack@n-api.service[101658]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=101658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:50:04.098423 dv-cinder-784477-10-iscsi devstack@n-api.service[101659]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=101659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:50:04.098566 dv-cinder-784477-10-iscsi devstack@n-api.service[101658]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=101658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:50:04.098708 dv-cinder-784477-10-iscsi devstack@n-api.service[101659]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=101659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:50:04.098859 dv-cinder-784477-10-iscsi devstack@n-api.service[101658]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=101658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:50:04.099001 dv-cinder-784477-10-iscsi devstack@n-api.service[101659]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=101659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:50:04.099144 dv-cinder-784477-10-iscsi devstack@n-api.service[101658]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=101658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:50:04.099300 dv-cinder-784477-10-iscsi devstack@n-api.service[101659]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=101659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:50:04.099444 dv-cinder-784477-10-iscsi devstack@n-api.service[101658]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=101658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:50:04.099590 dv-cinder-784477-10-iscsi devstack@n-api.service[101659]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=101659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:50:04.099861 dv-cinder-784477-10-iscsi devstack@n-api.service[101658]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=101658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:50:04.100007 dv-cinder-784477-10-iscsi devstack@n-api.service[101659]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=101659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:50:04.100168 dv-cinder-784477-10-iscsi devstack@n-api.service[101658]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=101658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:50:04.100326 dv-cinder-784477-10-iscsi devstack@n-api.service[101659]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=101659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:50:04.100470 dv-cinder-784477-10-iscsi devstack@n-api.service[101658]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=101658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:50:04.100619 dv-cinder-784477-10-iscsi devstack@n-api.service[101659]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=101659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:50:04.100762 dv-cinder-784477-10-iscsi devstack@n-api.service[101658]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=101658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:50:04.100931 dv-cinder-784477-10-iscsi devstack@n-api.service[101659]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=101659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:50:04.101079 dv-cinder-784477-10-iscsi devstack@n-api.service[101658]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=101658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:50:04.101234 dv-cinder-784477-10-iscsi devstack@n-api.service[101659]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=101659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:50:04.101395 dv-cinder-784477-10-iscsi devstack@n-api.service[101658]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=101658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:50:04.101606 dv-cinder-784477-10-iscsi devstack@n-api.service[101659]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=101659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:50:04.101806 dv-cinder-784477-10-iscsi devstack@n-api.service[101658]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=101658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:50:04.102006 dv-cinder-784477-10-iscsi devstack@n-api.service[101659]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=101659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:50:04.102238 dv-cinder-784477-10-iscsi devstack@n-api.service[101658]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=101658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:50:04.102442 dv-cinder-784477-10-iscsi devstack@n-api.service[101659]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=101659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:50:04.102596 dv-cinder-784477-10-iscsi devstack@n-api.service[101658]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=101658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:50:04.102747 dv-cinder-784477-10-iscsi devstack@n-api.service[101659]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=101659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:50:04.102891 dv-cinder-784477-10-iscsi devstack@n-api.service[101658]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=101658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:50:04.103034 dv-cinder-784477-10-iscsi devstack@n-api.service[101659]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=101659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:50:04.103190 dv-cinder-784477-10-iscsi devstack@n-api.service[101658]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=101658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:50:04.103334 dv-cinder-784477-10-iscsi devstack@n-api.service[101659]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=101659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:50:04.103483 dv-cinder-784477-10-iscsi devstack@n-api.service[101658]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=101658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:50:04.103626 dv-cinder-784477-10-iscsi devstack@n-api.service[101659]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=101659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:50:04.103768 dv-cinder-784477-10-iscsi devstack@n-api.service[101658]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=101658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:50:04.103925 dv-cinder-784477-10-iscsi devstack@n-api.service[101659]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=101659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:50:04.104077 dv-cinder-784477-10-iscsi devstack@n-api.service[101658]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=101658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:50:04.104077 dv-cinder-784477-10-iscsi devstack@n-api.service[101658]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=101658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:50:04.104417 dv-cinder-784477-10-iscsi devstack@n-api.service[101659]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=101659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:50:04.104633 dv-cinder-784477-10-iscsi devstack@n-api.service[101658]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=101658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:50:04.104788 dv-cinder-784477-10-iscsi devstack@n-api.service[101659]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=101659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:50:04.104985 dv-cinder-784477-10-iscsi devstack@n-api.service[101658]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=101658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:50:04.105175 dv-cinder-784477-10-iscsi devstack@n-api.service[101659]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=101659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:50:04.105336 dv-cinder-784477-10-iscsi devstack@n-api.service[101658]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=101658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:50:04.105482 dv-cinder-784477-10-iscsi devstack@n-api.service[101659]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=101659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:50:04.105626 dv-cinder-784477-10-iscsi devstack@n-api.service[101658]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=101658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:50:04.105768 dv-cinder-784477-10-iscsi devstack@n-api.service[101659]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=101659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:50:04.105921 dv-cinder-784477-10-iscsi devstack@n-api.service[101658]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=101658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:50:04.106136 dv-cinder-784477-10-iscsi devstack@n-api.service[101659]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=101659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:50:04.106333 dv-cinder-784477-10-iscsi devstack@n-api.service[101658]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=101658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:50:04.106553 dv-cinder-784477-10-iscsi devstack@n-api.service[101659]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=101659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:50:04.106752 dv-cinder-784477-10-iscsi devstack@n-api.service[101658]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=101658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:50:04.106966 dv-cinder-784477-10-iscsi devstack@n-api.service[101659]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=101659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:50:04.107147 dv-cinder-784477-10-iscsi devstack@n-api.service[101658]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=101658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:50:04.107304 dv-cinder-784477-10-iscsi devstack@n-api.service[101659]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=101659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:50:04.107450 dv-cinder-784477-10-iscsi devstack@n-api.service[101658]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=101658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:50:04.107592 dv-cinder-784477-10-iscsi devstack@n-api.service[101659]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=101659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:50:04.107734 dv-cinder-784477-10-iscsi devstack@n-api.service[101658]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=101658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:50:04.107876 dv-cinder-784477-10-iscsi devstack@n-api.service[101659]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=101659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:50:04.108027 dv-cinder-784477-10-iscsi devstack@n-api.service[101658]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=101658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:50:04.108178 dv-cinder-784477-10-iscsi devstack@n-api.service[101659]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=101659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:50:04.108321 dv-cinder-784477-10-iscsi devstack@n-api.service[101658]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=101658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:50:04.108474 dv-cinder-784477-10-iscsi devstack@n-api.service[101659]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=101659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:50:04.108626 dv-cinder-784477-10-iscsi devstack@n-api.service[101658]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=101658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:50:04.108782 dv-cinder-784477-10-iscsi devstack@n-api.service[101659]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=101659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:50:04.108979 dv-cinder-784477-10-iscsi devstack@n-api.service[101658]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=101658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:50:04.109141 dv-cinder-784477-10-iscsi devstack@n-api.service[101659]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=101659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:50:04.109293 dv-cinder-784477-10-iscsi devstack@n-api.service[101658]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=101658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:50:04.109437 dv-cinder-784477-10-iscsi devstack@n-api.service[101659]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=101659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:50:04.109580 dv-cinder-784477-10-iscsi devstack@n-api.service[101658]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=101658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:50:04.109730 dv-cinder-784477-10-iscsi devstack@n-api.service[101659]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=101659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:50:04.109873 dv-cinder-784477-10-iscsi devstack@n-api.service[101658]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=101658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:50:04.110015 dv-cinder-784477-10-iscsi devstack@n-api.service[101659]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=101659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:50:04.110157 dv-cinder-784477-10-iscsi devstack@n-api.service[101658]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=101658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:50:04.110335 dv-cinder-784477-10-iscsi devstack@n-api.service[101659]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=101659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:50:04.110497 dv-cinder-784477-10-iscsi devstack@n-api.service[101658]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=101658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:50:04.110825 dv-cinder-784477-10-iscsi devstack@n-api.service[101659]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=101659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:50:04.110983 dv-cinder-784477-10-iscsi devstack@n-api.service[101658]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=101658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:50:04.111126 dv-cinder-784477-10-iscsi devstack@n-api.service[101659]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=101659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:50:04.111276 dv-cinder-784477-10-iscsi devstack@n-api.service[101658]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=101658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:50:04.111429 dv-cinder-784477-10-iscsi devstack@n-api.service[101659]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=101659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:50:04.111579 dv-cinder-784477-10-iscsi devstack@n-api.service[101658]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=101658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:50:04.111732 dv-cinder-784477-10-iscsi devstack@n-api.service[101659]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=101659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:50:04.111876 dv-cinder-784477-10-iscsi devstack@n-api.service[101658]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=101658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:50:04.112018 dv-cinder-784477-10-iscsi devstack@n-api.service[101659]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=101659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:50:04.112160 dv-cinder-784477-10-iscsi devstack@n-api.service[101658]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=101658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:50:04.112302 dv-cinder-784477-10-iscsi devstack@n-api.service[101659]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=101659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:50:04.112445 dv-cinder-784477-10-iscsi devstack@n-api.service[101658]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=101658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:50:04.112607 dv-cinder-784477-10-iscsi devstack@n-api.service[101659]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=101659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:50:04.112752 dv-cinder-784477-10-iscsi devstack@n-api.service[101658]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=101658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:50:04.112914 dv-cinder-784477-10-iscsi devstack@n-api.service[101659]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=101659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:50:04.113072 dv-cinder-784477-10-iscsi devstack@n-api.service[101658]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=101658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:50:04.113216 dv-cinder-784477-10-iscsi devstack@n-api.service[101659]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=101659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:50:04.113372 dv-cinder-784477-10-iscsi devstack@n-api.service[101658]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=101658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:50:04.113516 dv-cinder-784477-10-iscsi devstack@n-api.service[101659]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=101659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:50:04.113659 dv-cinder-784477-10-iscsi devstack@n-api.service[101658]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=101658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:50:04.113810 dv-cinder-784477-10-iscsi devstack@n-api.service[101659]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=101659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:50:04.113954 dv-cinder-784477-10-iscsi devstack@n-api.service[101658]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=101658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:50:04.114096 dv-cinder-784477-10-iscsi devstack@n-api.service[101659]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=101659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:50:04.114250 dv-cinder-784477-10-iscsi devstack@n-api.service[101658]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=101658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:50:04.114403 dv-cinder-784477-10-iscsi devstack@n-api.service[101659]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=101659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:50:04.114559 dv-cinder-784477-10-iscsi devstack@n-api.service[101658]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=101658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:50:04.114806 dv-cinder-784477-10-iscsi devstack@n-api.service[101659]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=101659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:50:04.114957 dv-cinder-784477-10-iscsi devstack@n-api.service[101658]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=101658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:50:04.115124 dv-cinder-784477-10-iscsi devstack@n-api.service[101659]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=101659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:50:04.115281 dv-cinder-784477-10-iscsi devstack@n-api.service[101658]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=101658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:50:04.115438 dv-cinder-784477-10-iscsi devstack@n-api.service[101659]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=101659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:50:04.115581 dv-cinder-784477-10-iscsi devstack@n-api.service[101658]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=101658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:50:04.115724 dv-cinder-784477-10-iscsi devstack@n-api.service[101659]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=101659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:50:04.115867 dv-cinder-784477-10-iscsi devstack@n-api.service[101658]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=101658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:50:04.116016 dv-cinder-784477-10-iscsi devstack@n-api.service[101659]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=101659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:50:04.116172 dv-cinder-784477-10-iscsi devstack@n-api.service[101658]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=101658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:50:04.116316 dv-cinder-784477-10-iscsi devstack@n-api.service[101659]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=101659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:50:04.116527 dv-cinder-784477-10-iscsi devstack@n-api.service[101658]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=101658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:50:04.116687 dv-cinder-784477-10-iscsi devstack@n-api.service[101659]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=101659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:50:04.116831 dv-cinder-784477-10-iscsi devstack@n-api.service[101658]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=101658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:50:04.117019 dv-cinder-784477-10-iscsi devstack@n-api.service[101659]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=101659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:50:04.117185 dv-cinder-784477-10-iscsi devstack@n-api.service[101658]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=101658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:50:04.117335 dv-cinder-784477-10-iscsi devstack@n-api.service[101659]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=101659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:50:04.117487 dv-cinder-784477-10-iscsi devstack@n-api.service[101658]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=101658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:50:04.117631 dv-cinder-784477-10-iscsi devstack@n-api.service[101659]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=101659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:50:04.117773 dv-cinder-784477-10-iscsi devstack@n-api.service[101658]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=101658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:50:04.117773 dv-cinder-784477-10-iscsi devstack@n-api.service[101658]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=101658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:50:04.118137 dv-cinder-784477-10-iscsi devstack@n-api.service[101659]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=101659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:50:04.118297 dv-cinder-784477-10-iscsi devstack@n-api.service[101658]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=101658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:50:04.118448 dv-cinder-784477-10-iscsi devstack@n-api.service[101659]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=101659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:50:04.118602 dv-cinder-784477-10-iscsi devstack@n-api.service[101658]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=101658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:50:04.118745 dv-cinder-784477-10-iscsi devstack@n-api.service[101659]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=101659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:50:04.118896 dv-cinder-784477-10-iscsi devstack@n-api.service[101658]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=101658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:50:04.119041 dv-cinder-784477-10-iscsi devstack@n-api.service[101659]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=101659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:50:04.119185 dv-cinder-784477-10-iscsi devstack@n-api.service[101658]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=101658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:50:04.119327 dv-cinder-784477-10-iscsi devstack@n-api.service[101659]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=101659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:50:04.119469 dv-cinder-784477-10-iscsi devstack@n-api.service[101658]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=101658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:50:04.119620 dv-cinder-784477-10-iscsi devstack@n-api.service[101659]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=101659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:50:04.119763 dv-cinder-784477-10-iscsi devstack@n-api.service[101658]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=101658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:50:04.119906 dv-cinder-784477-10-iscsi devstack@n-api.service[101659]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=101659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:50:04.120049 dv-cinder-784477-10-iscsi devstack@n-api.service[101658]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=101658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:50:04.120191 dv-cinder-784477-10-iscsi devstack@n-api.service[101659]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=101659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:50:04.120333 dv-cinder-784477-10-iscsi devstack@n-api.service[101658]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=101658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:50:04.120495 dv-cinder-784477-10-iscsi devstack@n-api.service[101659]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=101659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:50:04.120639 dv-cinder-784477-10-iscsi devstack@n-api.service[101658]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=101658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:50:04.120781 dv-cinder-784477-10-iscsi devstack@n-api.service[101659]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=101659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:50:04.120949 dv-cinder-784477-10-iscsi devstack@n-api.service[101658]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=101658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:50:04.121094 dv-cinder-784477-10-iscsi devstack@n-api.service[101659]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=101659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:50:04.121247 dv-cinder-784477-10-iscsi devstack@n-api.service[101658]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=101658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:50:04.121400 dv-cinder-784477-10-iscsi devstack@n-api.service[101659]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=101659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:50:04.121544 dv-cinder-784477-10-iscsi devstack@n-api.service[101658]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=101658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:50:04.121686 dv-cinder-784477-10-iscsi devstack@n-api.service[101659]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=101659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:50:04.121842 dv-cinder-784477-10-iscsi devstack@n-api.service[101658]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=101658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:50:04.121998 dv-cinder-784477-10-iscsi devstack@n-api.service[101659]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=101659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:50:04.122150 dv-cinder-784477-10-iscsi devstack@n-api.service[101658]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=101658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:50:04.122339 dv-cinder-784477-10-iscsi devstack@n-api.service[101659]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=101659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:50:04.122486 dv-cinder-784477-10-iscsi devstack@n-api.service[101658]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=101658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:50:04.122629 dv-cinder-784477-10-iscsi devstack@n-api.service[101659]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=101659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:50:04.122781 dv-cinder-784477-10-iscsi devstack@n-api.service[101658]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=101658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:50:04.122925 dv-cinder-784477-10-iscsi devstack@n-api.service[101659]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=101659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:50:04.123077 dv-cinder-784477-10-iscsi devstack@n-api.service[101658]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=101658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:50:04.123222 dv-cinder-784477-10-iscsi devstack@n-api.service[101659]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=101659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:50:04.123364 dv-cinder-784477-10-iscsi devstack@n-api.service[101658]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=101658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:50:04.123506 dv-cinder-784477-10-iscsi devstack@n-api.service[101659]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=101659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:50:04.123649 dv-cinder-784477-10-iscsi devstack@n-api.service[101658]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=101658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:50:04.123800 dv-cinder-784477-10-iscsi devstack@n-api.service[101659]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=101659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:50:04.123956 dv-cinder-784477-10-iscsi devstack@n-api.service[101658]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=101658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:50:04.124109 dv-cinder-784477-10-iscsi devstack@n-api.service[101659]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=101659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:50:04.124307 dv-cinder-784477-10-iscsi devstack@n-api.service[101658]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=101658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:50:04.124453 dv-cinder-784477-10-iscsi devstack@n-api.service[101659]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=101659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:50:04.124596 dv-cinder-784477-10-iscsi devstack@n-api.service[101658]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=101658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:50:04.124750 dv-cinder-784477-10-iscsi devstack@n-api.service[101659]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=101659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:50:04.125122 dv-cinder-784477-10-iscsi devstack@n-api.service[101658]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=101658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:50:04.125279 dv-cinder-784477-10-iscsi devstack@n-api.service[101659]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=101659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:50:04.125422 dv-cinder-784477-10-iscsi devstack@n-api.service[101658]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=101658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:50:04.125565 dv-cinder-784477-10-iscsi devstack@n-api.service[101659]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=101659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:50:04.125716 dv-cinder-784477-10-iscsi devstack@n-api.service[101658]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=101658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:50:04.125918 dv-cinder-784477-10-iscsi devstack@n-api.service[101659]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=101659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:50:04.126070 dv-cinder-784477-10-iscsi devstack@n-api.service[101658]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=101658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:50:04.126214 dv-cinder-784477-10-iscsi devstack@n-api.service[101659]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=101659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:50:04.126372 dv-cinder-784477-10-iscsi devstack@n-api.service[101658]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=101658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:50:04.126526 dv-cinder-784477-10-iscsi devstack@n-api.service[101659]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=101659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:50:04.126669 dv-cinder-784477-10-iscsi devstack@n-api.service[101658]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=101658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:50:04.126820 dv-cinder-784477-10-iscsi devstack@n-api.service[101659]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=101659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:50:04.126964 dv-cinder-784477-10-iscsi devstack@n-api.service[101658]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=101658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:50:04.127113 dv-cinder-784477-10-iscsi devstack@n-api.service[101659]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=101659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:50:04.127259 dv-cinder-784477-10-iscsi devstack@n-api.service[101658]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=101658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:50:04.127403 dv-cinder-784477-10-iscsi devstack@n-api.service[101659]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=101659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:50:04.127545 dv-cinder-784477-10-iscsi devstack@n-api.service[101658]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=101658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:50:04.127705 dv-cinder-784477-10-iscsi devstack@n-api.service[101659]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=101659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:50:04.127849 dv-cinder-784477-10-iscsi devstack@n-api.service[101658]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=101658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:50:04.128002 dv-cinder-784477-10-iscsi devstack@n-api.service[101659]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=101659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:50:04.128160 dv-cinder-784477-10-iscsi devstack@n-api.service[101658]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=101658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:50:04.128310 dv-cinder-784477-10-iscsi devstack@n-api.service[101659]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=101659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:50:04.128462 dv-cinder-784477-10-iscsi devstack@n-api.service[101658]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=101658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:50:04.128604 dv-cinder-784477-10-iscsi devstack@n-api.service[101659]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=101659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:50:04.128746 dv-cinder-784477-10-iscsi devstack@n-api.service[101658]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=101658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:50:04.128921 dv-cinder-784477-10-iscsi devstack@n-api.service[101659]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=101659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:50:04.129078 dv-cinder-784477-10-iscsi devstack@n-api.service[101658]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=101658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:50:04.129221 dv-cinder-784477-10-iscsi devstack@n-api.service[101659]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=101659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:50:04.129372 dv-cinder-784477-10-iscsi devstack@n-api.service[101658]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=101658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:50:04.129524 dv-cinder-784477-10-iscsi devstack@n-api.service[101659]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=101659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:50:04.129678 dv-cinder-784477-10-iscsi devstack@n-api.service[101658]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=101658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:50:04.129821 dv-cinder-784477-10-iscsi devstack@n-api.service[101659]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=101659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:50:04.129964 dv-cinder-784477-10-iscsi devstack@n-api.service[101658]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=101658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:50:04.130117 dv-cinder-784477-10-iscsi devstack@n-api.service[101659]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=101659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:50:04.130269 dv-cinder-784477-10-iscsi devstack@n-api.service[101658]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=101658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:50:04.130412 dv-cinder-784477-10-iscsi devstack@n-api.service[101659]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=101659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:50:04.130555 dv-cinder-784477-10-iscsi devstack@n-api.service[101658]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=101658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:50:04.130697 dv-cinder-784477-10-iscsi devstack@n-api.service[101659]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=101659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:50:04.130838 dv-cinder-784477-10-iscsi devstack@n-api.service[101658]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=101658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:50:04.130991 dv-cinder-784477-10-iscsi devstack@n-api.service[101659]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=101659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:50:04.131142 dv-cinder-784477-10-iscsi devstack@n-api.service[101658]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=101658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:50:04.131284 dv-cinder-784477-10-iscsi devstack@n-api.service[101659]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=101659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:50:04.131426 dv-cinder-784477-10-iscsi devstack@n-api.service[101658]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=101658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:50:04.131568 dv-cinder-784477-10-iscsi devstack@n-api.service[101659]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=101659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:50:04.131710 dv-cinder-784477-10-iscsi devstack@n-api.service[101658]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=101658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:50:04.131882 dv-cinder-784477-10-iscsi devstack@n-api.service[101659]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=101659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:50:04.132026 dv-cinder-784477-10-iscsi devstack@n-api.service[101658]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=101658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:50:04.132168 dv-cinder-784477-10-iscsi devstack@n-api.service[101659]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=101659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:50:04.132314 dv-cinder-784477-10-iscsi devstack@n-api.service[101658]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=101658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:50:04.132456 dv-cinder-784477-10-iscsi devstack@n-api.service[101659]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=101659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:50:04.132598 dv-cinder-784477-10-iscsi devstack@n-api.service[101658]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=101658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:50:04.132749 dv-cinder-784477-10-iscsi devstack@n-api.service[101659]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=101659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:50:04.132914 dv-cinder-784477-10-iscsi devstack@n-api.service[101658]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=101658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:50:04.133063 dv-cinder-784477-10-iscsi devstack@n-api.service[101659]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=101659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:50:04.133221 dv-cinder-784477-10-iscsi devstack@n-api.service[101658]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=101658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:50:04.133364 dv-cinder-784477-10-iscsi devstack@n-api.service[101659]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=101659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:50:04.133515 dv-cinder-784477-10-iscsi devstack@n-api.service[101658]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=101658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:50:04.133661 dv-cinder-784477-10-iscsi devstack@n-api.service[101659]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=101659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:50:04.133814 dv-cinder-784477-10-iscsi devstack@n-api.service[101658]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=101658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:50:04.133965 dv-cinder-784477-10-iscsi devstack@n-api.service[101659]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=101659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:50:04.134108 dv-cinder-784477-10-iscsi devstack@n-api.service[101658]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=101658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:50:04.134249 dv-cinder-784477-10-iscsi devstack@n-api.service[101659]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=101659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:50:04.134400 dv-cinder-784477-10-iscsi devstack@n-api.service[101658]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=101658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:50:04.134550 dv-cinder-784477-10-iscsi devstack@n-api.service[101659]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=101659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:50:04.134693 dv-cinder-784477-10-iscsi devstack@n-api.service[101658]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=101658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:50:04.134693 dv-cinder-784477-10-iscsi devstack@n-api.service[101658]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=101658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:50:04.134972 dv-cinder-784477-10-iscsi devstack@n-api.service[101659]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=101659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:50:04.135146 dv-cinder-784477-10-iscsi devstack@n-api.service[101658]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=101658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:50:04.135304 dv-cinder-784477-10-iscsi devstack@n-api.service[101659]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=101659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:50:04.135448 dv-cinder-784477-10-iscsi devstack@n-api.service[101658]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=101658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:50:04.135600 dv-cinder-784477-10-iscsi devstack@n-api.service[101659]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=101659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:50:04.135744 dv-cinder-784477-10-iscsi devstack@n-api.service[101658]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=101658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:50:04.135886 dv-cinder-784477-10-iscsi devstack@n-api.service[101659]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=101659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:50:04.136035 dv-cinder-784477-10-iscsi devstack@n-api.service[101658]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=101658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:50:04.136190 dv-cinder-784477-10-iscsi devstack@n-api.service[101659]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=101659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:50:04.136334 dv-cinder-784477-10-iscsi devstack@n-api.service[101658]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=101658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:50:04.136476 dv-cinder-784477-10-iscsi devstack@n-api.service[101659]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=101659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:50:04.136618 dv-cinder-784477-10-iscsi devstack@n-api.service[101658]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=101658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:50:04.136768 dv-cinder-784477-10-iscsi devstack@n-api.service[101659]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=101659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:50:04.136972 dv-cinder-784477-10-iscsi devstack@n-api.service[101658]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=101658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:50:04.137128 dv-cinder-784477-10-iscsi devstack@n-api.service[101659]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=101659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:50:04.137270 dv-cinder-784477-10-iscsi devstack@n-api.service[101658]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=101658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:50:04.137412 dv-cinder-784477-10-iscsi devstack@n-api.service[101659]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=101659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:50:04.137575 dv-cinder-784477-10-iscsi devstack@n-api.service[101658]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=101658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:50:04.137742 dv-cinder-784477-10-iscsi devstack@n-api.service[101659]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=101659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:50:04.137902 dv-cinder-784477-10-iscsi devstack@n-api.service[101658]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=101658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:50:04.138046 dv-cinder-784477-10-iscsi devstack@n-api.service[101659]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=101659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:50:04.138189 dv-cinder-784477-10-iscsi devstack@n-api.service[101658]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=101658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:50:04.138331 dv-cinder-784477-10-iscsi devstack@n-api.service[101659]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=101659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:50:04.138473 dv-cinder-784477-10-iscsi devstack@n-api.service[101658]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=101658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:50:04.138615 dv-cinder-784477-10-iscsi devstack@n-api.service[101659]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=101659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:50:04.138766 dv-cinder-784477-10-iscsi devstack@n-api.service[101658]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=101658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:50:04.138912 dv-cinder-784477-10-iscsi devstack@n-api.service[101659]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=101659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:50:04.139054 dv-cinder-784477-10-iscsi devstack@n-api.service[101658]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=101658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:50:04.139196 dv-cinder-784477-10-iscsi devstack@n-api.service[101659]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=101659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:50:04.139355 dv-cinder-784477-10-iscsi devstack@n-api.service[101658]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=101658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:50:04.139508 dv-cinder-784477-10-iscsi devstack@n-api.service[101659]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=101659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:50:04.139651 dv-cinder-784477-10-iscsi devstack@n-api.service[101658]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=101658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:50:04.139801 dv-cinder-784477-10-iscsi devstack@n-api.service[101659]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=101659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:50:04.139945 dv-cinder-784477-10-iscsi devstack@n-api.service[101658]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=101658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:50:04.140088 dv-cinder-784477-10-iscsi devstack@n-api.service[101659]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=101659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:50:04.140230 dv-cinder-784477-10-iscsi devstack@n-api.service[101658]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=101658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:50:04.140386 dv-cinder-784477-10-iscsi devstack@n-api.service[101659]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=101659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:50:04.140529 dv-cinder-784477-10-iscsi devstack@n-api.service[101658]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=101658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:50:04.140679 dv-cinder-784477-10-iscsi devstack@n-api.service[101659]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=101659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:50:04.140841 dv-cinder-784477-10-iscsi devstack@n-api.service[101658]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=101658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:50:04.141014 dv-cinder-784477-10-iscsi devstack@n-api.service[101659]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=101659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:50:04.141166 dv-cinder-784477-10-iscsi devstack@n-api.service[101658]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=101658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:50:04.141330 dv-cinder-784477-10-iscsi devstack@n-api.service[101659]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=101659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:50:04.141508 dv-cinder-784477-10-iscsi devstack@n-api.service[101658]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=101658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:50:04.141657 dv-cinder-784477-10-iscsi devstack@n-api.service[101659]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=101659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:50:04.141805 dv-cinder-784477-10-iscsi devstack@n-api.service[101658]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=101658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:50:04.141948 dv-cinder-784477-10-iscsi devstack@n-api.service[101659]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=101659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:50:04.142100 dv-cinder-784477-10-iscsi devstack@n-api.service[101658]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=101658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:50:04.142244 dv-cinder-784477-10-iscsi devstack@n-api.service[101659]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=101659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:50:04.142386 dv-cinder-784477-10-iscsi devstack@n-api.service[101658]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=101658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:50:04.142528 dv-cinder-784477-10-iscsi devstack@n-api.service[101659]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=101659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:50:04.142670 dv-cinder-784477-10-iscsi devstack@n-api.service[101658]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=101658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:50:04.142812 dv-cinder-784477-10-iscsi devstack@n-api.service[101659]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=101659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:50:04.142966 dv-cinder-784477-10-iscsi devstack@n-api.service[101658]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=101658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:50:04.143121 dv-cinder-784477-10-iscsi devstack@n-api.service[101659]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=101659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:50:04.143264 dv-cinder-784477-10-iscsi devstack@n-api.service[101658]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=101658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:50:04.143406 dv-cinder-784477-10-iscsi devstack@n-api.service[101659]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=101659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:50:04.143547 dv-cinder-784477-10-iscsi devstack@n-api.service[101658]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=101658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:50:04.143690 dv-cinder-784477-10-iscsi devstack@n-api.service[101659]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=101659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:50:04.143840 dv-cinder-784477-10-iscsi devstack@n-api.service[101658]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=101658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:50:04.143983 dv-cinder-784477-10-iscsi devstack@n-api.service[101659]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=101659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:50:04.144125 dv-cinder-784477-10-iscsi devstack@n-api.service[101658]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=101658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:50:04.144268 dv-cinder-784477-10-iscsi devstack@n-api.service[101659]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=101659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:50:04.144410 dv-cinder-784477-10-iscsi devstack@n-api.service[101658]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=101658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Dec 14 12:50:04.144552 dv-cinder-784477-10-iscsi devstack@n-api.service[101659]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=101659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:50:04.144552 dv-cinder-784477-10-iscsi devstack@n-api.service[101659]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=101659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:50:04.144552 dv-cinder-784477-10-iscsi devstack@n-api.service[101659]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=101659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:50:04.144552 dv-cinder-784477-10-iscsi devstack@n-api.service[101659]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=101659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:50:04.144552 dv-cinder-784477-10-iscsi devstack@n-api.service[101659]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=101659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Dec 14 12:50:04.166481 dv-cinder-784477-10-iscsi devstack@n-api.service[101658]: DEBUG oslo_db.sqlalchemy.engines [None req-07742d00-5a66-4257-adad-ef4fc3c909c2 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=101658) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Dec 14 12:50:04.167512 dv-cinder-784477-10-iscsi devstack@n-api.service[101659]: DEBUG oslo_db.sqlalchemy.engines [None req-22ccf92e-32b9-43fd-8d81-b7f285348d93 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=101659) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Dec 14 12:50:04.231666 dv-cinder-784477-10-iscsi devstack@n-api.service[101658]: DEBUG nova.context [None req-07742d00-5a66-4257-adad-ef4fc3c909c2 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),c72c70dc-282a-4dd4-bee2-2334d6bc15ce(cell1) {{(pid=101658) load_cells /opt/stack/nova/nova/context.py:464}} Dec 14 12:50:04.232076 dv-cinder-784477-10-iscsi devstack@n-api.service[101659]: DEBUG nova.context [None req-22ccf92e-32b9-43fd-8d81-b7f285348d93 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),c72c70dc-282a-4dd4-bee2-2334d6bc15ce(cell1) {{(pid=101659) load_cells /opt/stack/nova/nova/context.py:464}} Dec 14 12:50:04.235904 dv-cinder-784477-10-iscsi devstack@n-api.service[101658]: DEBUG oslo_concurrency.lockutils [None req-07742d00-5a66-4257-adad-ef4fc3c909c2 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 12:50:04.236323 dv-cinder-784477-10-iscsi devstack@n-api.service[101659]: DEBUG oslo_concurrency.lockutils [None req-22ccf92e-32b9-43fd-8d81-b7f285348d93 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 12:50:04.237537 dv-cinder-784477-10-iscsi devstack@n-api.service[101658]: DEBUG oslo_concurrency.lockutils [None req-07742d00-5a66-4257-adad-ef4fc3c909c2 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=101658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 12:50:04.238123 dv-cinder-784477-10-iscsi devstack@n-api.service[101659]: DEBUG oslo_concurrency.lockutils [None req-22ccf92e-32b9-43fd-8d81-b7f285348d93 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=101659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 12:50:04.238365 dv-cinder-784477-10-iscsi devstack@n-api.service[101658]: DEBUG oslo_concurrency.lockutils [None req-07742d00-5a66-4257-adad-ef4fc3c909c2 None None] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 12:50:04.238928 dv-cinder-784477-10-iscsi devstack@n-api.service[101659]: DEBUG oslo_concurrency.lockutils [None req-22ccf92e-32b9-43fd-8d81-b7f285348d93 None None] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 12:50:04.240320 dv-cinder-784477-10-iscsi devstack@n-api.service[101658]: DEBUG oslo_concurrency.lockutils [None req-07742d00-5a66-4257-adad-ef4fc3c909c2 None None] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=101658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 12:50:04.240883 dv-cinder-784477-10-iscsi devstack@n-api.service[101659]: DEBUG oslo_concurrency.lockutils [None req-22ccf92e-32b9-43fd-8d81-b7f285348d93 None None] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=101659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 12:50:04.250834 dv-cinder-784477-10-iscsi devstack@n-api.service[101658]: DEBUG oslo_db.sqlalchemy.engines [None req-07742d00-5a66-4257-adad-ef4fc3c909c2 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=101658) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Dec 14 12:50:04.253485 dv-cinder-784477-10-iscsi devstack@n-api.service[101658]: DEBUG oslo_db.sqlalchemy.engines [None req-07742d00-5a66-4257-adad-ef4fc3c909c2 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=101658) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Dec 14 12:50:04.256711 dv-cinder-784477-10-iscsi devstack@n-api.service[101659]: DEBUG oslo_db.sqlalchemy.engines [None req-22ccf92e-32b9-43fd-8d81-b7f285348d93 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=101659) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Dec 14 12:50:04.259419 dv-cinder-784477-10-iscsi devstack@n-api.service[101659]: DEBUG oslo_db.sqlalchemy.engines [None req-22ccf92e-32b9-43fd-8d81-b7f285348d93 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=101659) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Dec 14 12:50:04.423154 dv-cinder-784477-10-iscsi devstack@n-api.service[101658]: DEBUG oslo_db.sqlalchemy.engines [None req-07742d00-5a66-4257-adad-ef4fc3c909c2 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=101658) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Dec 14 12:50:04.426344 dv-cinder-784477-10-iscsi devstack@n-api.service[101659]: DEBUG oslo_db.sqlalchemy.engines [None req-22ccf92e-32b9-43fd-8d81-b7f285348d93 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=101659) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Dec 14 12:50:04.763748 dv-cinder-784477-10-iscsi devstack@n-api.service[101658]: WARNING keystonemiddleware.auth_token [None req-07742d00-5a66-4257-adad-ef4fc3c909c2 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Dec 14 12:50:04.763965 dv-cinder-784477-10-iscsi devstack@n-api.service[101659]: WARNING keystonemiddleware.auth_token [None req-22ccf92e-32b9-43fd-8d81-b7f285348d93 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Dec 14 12:50:04.770370 dv-cinder-784477-10-iscsi devstack@n-api.service[101658]: WARNING keystonemiddleware.auth_token [None req-07742d00-5a66-4257-adad-ef4fc3c909c2 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Dec 14 12:50:04.770506 dv-cinder-784477-10-iscsi devstack@n-api.service[101659]: WARNING keystonemiddleware.auth_token [None req-22ccf92e-32b9-43fd-8d81-b7f285348d93 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Dec 14 12:50:05.106373 dv-cinder-784477-10-iscsi devstack@n-api.service[101658]: WARNING keystonemiddleware.auth_token [None req-07742d00-5a66-4257-adad-ef4fc3c909c2 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Dec 14 12:50:05.106962 dv-cinder-784477-10-iscsi devstack@n-api.service[101659]: WARNING keystonemiddleware.auth_token [None req-22ccf92e-32b9-43fd-8d81-b7f285348d93 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Dec 14 12:50:05.111763 dv-cinder-784477-10-iscsi devstack@n-api.service[101658]: WARNING keystonemiddleware.auth_token [None req-07742d00-5a66-4257-adad-ef4fc3c909c2 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Dec 14 12:50:05.112108 dv-cinder-784477-10-iscsi devstack@n-api.service[101659]: WARNING keystonemiddleware.auth_token [None req-22ccf92e-32b9-43fd-8d81-b7f285348d93 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Dec 14 12:50:05.116887 dv-cinder-784477-10-iscsi devstack@n-api.service[101658]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x558214a779c0 pid: 101658 (default app) Dec 14 12:50:05.117264 dv-cinder-784477-10-iscsi devstack@n-api.service[101659]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x558214a779c0 pid: 101659 (default app) Dec 14 12:50:05.118999 dv-cinder-784477-10-iscsi devstack@n-api.service[101658]: DEBUG nova.api.openstack.wsgi [None req-07742d00-5a66-4257-adad-ef4fc3c909c2 None None] Calling method '>' {{(pid=101658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 12:50:05.120208 dv-cinder-784477-10-iscsi devstack@n-api.service[101658]: INFO nova.api.openstack.requestlog [None req-07742d00-5a66-4257-adad-ef4fc3c909c2 None None] 10.222.0.49 "GET /compute/v2.1/" status: 200 len: 388 microversion: 2.1 time: 0.001759 Dec 14 12:50:05.120619 dv-cinder-784477-10-iscsi devstack@n-api.service[101658]: [pid: 101658|app: 0|req: 1/1] 10.222.0.49 () {50 vars in 788 bytes} [Tue Dec 14 12:50:05 2021] GET /compute/v2.1/ => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 14 12:51:27.011620 dv-cinder-784477-10-iscsi devstack@n-api.service[101659]: DEBUG nova.api.openstack.wsgi [None req-22ccf92e-32b9-43fd-8d81-b7f285348d93 None None] Calling method '>' {{(pid=101659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 12:51:27.013146 dv-cinder-784477-10-iscsi devstack@n-api.service[101659]: INFO nova.api.openstack.requestlog [None req-22ccf92e-32b9-43fd-8d81-b7f285348d93 None None] 10.222.0.49 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002223 Dec 14 12:51:27.013680 dv-cinder-784477-10-iscsi devstack@n-api.service[101659]: [pid: 101659|app: 0|req: 1/2] 10.222.0.49 () {54 vars in 930 bytes} [Tue Dec 14 12:51:27 2021] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 14 12:51:27.439015 dv-cinder-784477-10-iscsi devstack@n-api.service[101658]: DEBUG nova.api.openstack.wsgi [None req-c285bc7a-bf8f-49e2-9c84-a627ca2f7d0d admin admin] Calling method '>' {{(pid=101658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 12:51:27.468503 dv-cinder-784477-10-iscsi devstack@n-api.service[101658]: INFO nova.api.openstack.requestlog [None req-c285bc7a-bf8f-49e2-9c84-a627ca2f7d0d admin admin] 10.222.0.49 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 15 microversion: 2.61 time: 0.448020 Dec 14 12:51:27.469330 dv-cinder-784477-10-iscsi devstack@n-api.service[101658]: [pid: 101658|app: 0|req: 2/3] 10.222.0.49 () {60 vars in 1291 bytes} [Tue Dec 14 12:51:27 2021] GET /compute/v2.1/flavors/detail?is_public=True => generated 15 bytes in 449 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 14 12:51:29.870859 dv-cinder-784477-10-iscsi devstack@n-api.service[101659]: DEBUG nova.api.openstack.wsgi [None req-22ccf92e-32b9-43fd-8d81-b7f285348d93 None None] Calling method '>' {{(pid=101659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 12:51:29.871933 dv-cinder-784477-10-iscsi devstack@n-api.service[101659]: INFO nova.api.openstack.requestlog [None req-22ccf92e-32b9-43fd-8d81-b7f285348d93 None None] 10.222.0.49 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001474 Dec 14 12:51:29.872406 dv-cinder-784477-10-iscsi devstack@n-api.service[101659]: [pid: 101659|app: 0|req: 2/4] 10.222.0.49 () {54 vars in 930 bytes} [Tue Dec 14 12:51:29 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 14 12:51:29.933674 dv-cinder-784477-10-iscsi devstack@n-api.service[101658]: DEBUG nova.api.openstack.wsgi [None req-19618a94-bc2f-40b9-9dd2-0382ab953ac7 admin admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 256, "name": "cirros256", "disk": 1, "swap": 0, "os-flavor-access:is_public": true, "id": "c1", "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "vcpus": 1}} {{(pid=101658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 14 12:51:29.951885 dv-cinder-784477-10-iscsi devstack@n-api.service[101658]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 14 12:51:29.951885 dv-cinder-784477-10-iscsi devstack@n-api.service[101658]: warnings.warn(msg) Dec 14 12:51:29.984509 dv-cinder-784477-10-iscsi devstack@n-api.service[101658]: INFO nova.api.openstack.requestlog [None req-19618a94-bc2f-40b9-9dd2-0382ab953ac7 admin admin] 10.222.0.49 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.61 time: 0.104743 Dec 14 12:51:29.987865 dv-cinder-784477-10-iscsi devstack@n-api.service[101658]: [pid: 101658|app: 0|req: 3/5] 10.222.0.49 () {64 vars in 1282 bytes} [Tue Dec 14 12:51:29 2021] POST /compute/v2.1/flavors => generated 407 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 14 12:51:30.206638 dv-cinder-784477-10-iscsi devstack@n-api.service[101659]: DEBUG nova.api.openstack.wsgi [None req-99e3a067-b23d-4763-989d-b5206c13655d admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=101659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 14 12:51:30.209162 dv-cinder-784477-10-iscsi devstack@n-api.service[101659]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 14 12:51:30.209162 dv-cinder-784477-10-iscsi devstack@n-api.service[101659]: warnings.warn(msg) Dec 14 12:51:30.261270 dv-cinder-784477-10-iscsi devstack@n-api.service[101659]: INFO nova.api.openstack.requestlog [None req-99e3a067-b23d-4763-989d-b5206c13655d admin admin] 10.222.0.49 "POST /compute/v2.1/flavors/c1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.267236 Dec 14 12:51:30.268406 dv-cinder-784477-10-iscsi devstack@n-api.service[101659]: [pid: 101659|app: 0|req: 3/6] 10.222.0.49 () {64 vars in 1335 bytes} [Tue Dec 14 12:51:29 2021] POST /compute/v2.1/flavors/c1/os-extra_specs => generated 43 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 14 12:51:32.687225 dv-cinder-784477-10-iscsi devstack@n-api.service[101658]: DEBUG nova.api.openstack.wsgi [None req-19618a94-bc2f-40b9-9dd2-0382ab953ac7 admin admin] Calling method '>' {{(pid=101658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 12:51:32.688242 dv-cinder-784477-10-iscsi devstack@n-api.service[101658]: INFO nova.api.openstack.requestlog [None req-19618a94-bc2f-40b9-9dd2-0382ab953ac7 admin admin] 10.222.0.49 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001500 Dec 14 12:51:32.688651 dv-cinder-784477-10-iscsi devstack@n-api.service[101658]: [pid: 101658|app: 0|req: 4/7] 10.222.0.49 () {54 vars in 930 bytes} [Tue Dec 14 12:51:32 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 14 12:51:32.804367 dv-cinder-784477-10-iscsi devstack@n-api.service[101659]: DEBUG nova.api.openstack.wsgi [None req-640a2164-85c6-43f6-972f-7ca44b32d903 admin admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "rxtx_factor": 1.0, "name": "ds512M", "os-flavor-access:is_public": true, "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "disk": 5, "vcpus": 1, "id": "d1"}} {{(pid=101659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 14 12:51:32.821914 dv-cinder-784477-10-iscsi devstack@n-api.service[101659]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 14 12:51:32.821914 dv-cinder-784477-10-iscsi devstack@n-api.service[101659]: warnings.warn(msg) Dec 14 12:51:32.842701 dv-cinder-784477-10-iscsi devstack@n-api.service[101659]: INFO nova.api.openstack.requestlog [None req-640a2164-85c6-43f6-972f-7ca44b32d903 admin admin] 10.222.0.49 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.146951 Dec 14 12:51:32.843266 dv-cinder-784477-10-iscsi devstack@n-api.service[101659]: [pid: 101659|app: 0|req: 4/8] 10.222.0.49 () {64 vars in 1282 bytes} [Tue Dec 14 12:51:32 2021] POST /compute/v2.1/flavors => generated 404 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Dec 14 12:51:32.855676 dv-cinder-784477-10-iscsi devstack@n-api.service[101658]: DEBUG nova.api.openstack.wsgi [None req-ec225165-7b77-4f60-a8c4-c9a6e9b7c062 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=101658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 14 12:51:32.858425 dv-cinder-784477-10-iscsi devstack@n-api.service[101658]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 14 12:51:32.858425 dv-cinder-784477-10-iscsi devstack@n-api.service[101658]: warnings.warn(msg) Dec 14 12:51:32.893289 dv-cinder-784477-10-iscsi devstack@n-api.service[101658]: INFO nova.api.openstack.requestlog [None req-ec225165-7b77-4f60-a8c4-c9a6e9b7c062 admin admin] 10.222.0.49 "POST /compute/v2.1/flavors/d1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.041200 Dec 14 12:51:32.894253 dv-cinder-784477-10-iscsi devstack@n-api.service[101658]: [pid: 101658|app: 0|req: 5/9] 10.222.0.49 () {64 vars in 1335 bytes} [Tue Dec 14 12:51:32 2021] POST /compute/v2.1/flavors/d1/os-extra_specs => generated 43 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 14 12:51:35.283800 dv-cinder-784477-10-iscsi devstack@n-api.service[101659]: DEBUG nova.api.openstack.wsgi [None req-640a2164-85c6-43f6-972f-7ca44b32d903 admin admin] Calling method '>' {{(pid=101659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 12:51:35.285483 dv-cinder-784477-10-iscsi devstack@n-api.service[101659]: INFO nova.api.openstack.requestlog [None req-640a2164-85c6-43f6-972f-7ca44b32d903 admin admin] 10.222.0.49 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002151 Dec 14 12:51:35.291412 dv-cinder-784477-10-iscsi devstack@n-api.service[101659]: [pid: 101659|app: 0|req: 5/10] 10.222.0.49 () {54 vars in 930 bytes} [Tue Dec 14 12:51:35 2021] GET /compute/v2.1 => generated 388 bytes in 8 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 14 12:51:35.344379 dv-cinder-784477-10-iscsi devstack@n-api.service[101658]: DEBUG nova.api.openstack.wsgi [None req-6787a0b1-6dd1-49e2-8b04-ff3b2d21bc7a admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "ds1G", "os-flavor-access:is_public": true, "ram": 1024, "id": "d2", "rxtx_factor": 1.0, "disk": 10, "vcpus": 1, "OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0}} {{(pid=101658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 14 12:51:35.364081 dv-cinder-784477-10-iscsi devstack@n-api.service[101658]: INFO nova.api.openstack.requestlog [None req-6787a0b1-6dd1-49e2-8b04-ff3b2d21bc7a admin admin] 10.222.0.49 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.071399 Dec 14 12:51:35.370601 dv-cinder-784477-10-iscsi devstack@n-api.service[101658]: [pid: 101658|app: 0|req: 6/11] 10.222.0.49 () {64 vars in 1282 bytes} [Tue Dec 14 12:51:35 2021] POST /compute/v2.1/flavors => generated 404 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Dec 14 12:51:35.377177 dv-cinder-784477-10-iscsi devstack@n-api.service[101659]: DEBUG nova.api.openstack.wsgi [None req-ed9c6044-02c8-4bb6-a72d-7a1e3b53510a admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=101659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 14 12:51:35.402409 dv-cinder-784477-10-iscsi devstack@n-api.service[101659]: INFO nova.api.openstack.requestlog [None req-ed9c6044-02c8-4bb6-a72d-7a1e3b53510a admin admin] 10.222.0.49 "POST /compute/v2.1/flavors/d2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.028704 Dec 14 12:51:35.412546 dv-cinder-784477-10-iscsi devstack@n-api.service[101659]: [pid: 101659|app: 0|req: 6/12] 10.222.0.49 () {64 vars in 1335 bytes} [Tue Dec 14 12:51:35 2021] POST /compute/v2.1/flavors/d2/os-extra_specs => generated 43 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 14 12:51:37.805814 dv-cinder-784477-10-iscsi devstack@n-api.service[101658]: DEBUG nova.api.openstack.wsgi [None req-6787a0b1-6dd1-49e2-8b04-ff3b2d21bc7a admin admin] Calling method '>' {{(pid=101658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 12:51:37.806815 dv-cinder-784477-10-iscsi devstack@n-api.service[101658]: INFO nova.api.openstack.requestlog [None req-6787a0b1-6dd1-49e2-8b04-ff3b2d21bc7a admin admin] 10.222.0.49 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001449 Dec 14 12:51:37.807211 dv-cinder-784477-10-iscsi devstack@n-api.service[101658]: [pid: 101658|app: 0|req: 7/13] 10.222.0.49 () {54 vars in 930 bytes} [Tue Dec 14 12:51:37 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 14 12:51:37.872003 dv-cinder-784477-10-iscsi devstack@n-api.service[101659]: DEBUG nova.api.openstack.wsgi [None req-1e245bd4-80ec-4f62-bfe3-1ef32e475d6e admin admin] Action: 'create', calling method: >, body: {"flavor": {"rxtx_factor": 1.0, "disk": 10, "name": "ds2G", "swap": 0, "vcpus": 2, "os-flavor-access:is_public": true, "id": "d3", "OS-FLV-EXT-DATA:ephemeral": 0, "ram": 2048}} {{(pid=101659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 14 12:51:37.891719 dv-cinder-784477-10-iscsi devstack@n-api.service[101659]: INFO nova.api.openstack.requestlog [None req-1e245bd4-80ec-4f62-bfe3-1ef32e475d6e admin admin] 10.222.0.49 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.078090 Dec 14 12:51:37.892497 dv-cinder-784477-10-iscsi devstack@n-api.service[101659]: [pid: 101659|app: 0|req: 7/14] 10.222.0.49 () {64 vars in 1282 bytes} [Tue Dec 14 12:51:37 2021] POST /compute/v2.1/flavors => generated 404 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 14 12:51:37.904661 dv-cinder-784477-10-iscsi devstack@n-api.service[101658]: DEBUG nova.api.openstack.wsgi [None req-57b37b13-81de-4388-a1c9-f4061d251ffc admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=101658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 14 12:51:37.931126 dv-cinder-784477-10-iscsi devstack@n-api.service[101658]: INFO nova.api.openstack.requestlog [None req-57b37b13-81de-4388-a1c9-f4061d251ffc admin admin] 10.222.0.49 "POST /compute/v2.1/flavors/d3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.030306 Dec 14 12:51:37.931775 dv-cinder-784477-10-iscsi devstack@n-api.service[101658]: [pid: 101658|app: 0|req: 8/15] 10.222.0.49 () {64 vars in 1335 bytes} [Tue Dec 14 12:51:37 2021] POST /compute/v2.1/flavors/d3/os-extra_specs => generated 43 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 14 12:51:40.321927 dv-cinder-784477-10-iscsi devstack@n-api.service[101659]: DEBUG nova.api.openstack.wsgi [None req-1e245bd4-80ec-4f62-bfe3-1ef32e475d6e admin admin] Calling method '>' {{(pid=101659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 12:51:40.322937 dv-cinder-784477-10-iscsi devstack@n-api.service[101659]: INFO nova.api.openstack.requestlog [None req-1e245bd4-80ec-4f62-bfe3-1ef32e475d6e admin admin] 10.222.0.49 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001472 Dec 14 12:51:40.323308 dv-cinder-784477-10-iscsi devstack@n-api.service[101659]: [pid: 101659|app: 0|req: 8/16] 10.222.0.49 () {54 vars in 930 bytes} [Tue Dec 14 12:51:40 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 14 12:51:40.381514 dv-cinder-784477-10-iscsi devstack@n-api.service[101658]: DEBUG nova.api.openstack.wsgi [None req-757b57e1-37ab-4a48-af05-92eb15f61f03 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "ds4G", "os-flavor-access:is_public": true, "vcpus": 4, "disk": 20, "ram": 4096, "swap": 0, "rxtx_factor": 1.0, "id": "d4", "OS-FLV-EXT-DATA:ephemeral": 0}} {{(pid=101658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 14 12:51:40.404037 dv-cinder-784477-10-iscsi devstack@n-api.service[101658]: INFO nova.api.openstack.requestlog [None req-757b57e1-37ab-4a48-af05-92eb15f61f03 admin admin] 10.222.0.49 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.074269 Dec 14 12:51:40.409092 dv-cinder-784477-10-iscsi devstack@n-api.service[101658]: [pid: 101658|app: 0|req: 9/17] 10.222.0.49 () {64 vars in 1282 bytes} [Tue Dec 14 12:51:40 2021] POST /compute/v2.1/flavors => generated 404 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 14 12:51:40.417158 dv-cinder-784477-10-iscsi devstack@n-api.service[101659]: DEBUG nova.api.openstack.wsgi [None req-f7257179-bec3-4995-beef-a0196cf0dc6c admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=101659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 14 12:51:40.441454 dv-cinder-784477-10-iscsi devstack@n-api.service[101659]: INFO nova.api.openstack.requestlog [None req-f7257179-bec3-4995-beef-a0196cf0dc6c admin admin] 10.222.0.49 "POST /compute/v2.1/flavors/d4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.027772 Dec 14 12:51:40.442038 dv-cinder-784477-10-iscsi devstack@n-api.service[101659]: [pid: 101659|app: 0|req: 9/18] 10.222.0.49 () {64 vars in 1335 bytes} [Tue Dec 14 12:51:40 2021] POST /compute/v2.1/flavors/d4/os-extra_specs => generated 43 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 14 12:51:42.836255 dv-cinder-784477-10-iscsi devstack@n-api.service[101658]: DEBUG nova.api.openstack.wsgi [None req-757b57e1-37ab-4a48-af05-92eb15f61f03 admin admin] Calling method '>' {{(pid=101658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 12:51:42.837473 dv-cinder-784477-10-iscsi devstack@n-api.service[101658]: INFO nova.api.openstack.requestlog [None req-757b57e1-37ab-4a48-af05-92eb15f61f03 admin admin] 10.222.0.49 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001821 Dec 14 12:51:42.837862 dv-cinder-784477-10-iscsi devstack@n-api.service[101658]: [pid: 101658|app: 0|req: 10/19] 10.222.0.49 () {54 vars in 930 bytes} [Tue Dec 14 12:51:42 2021] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 14 12:51:42.899350 dv-cinder-784477-10-iscsi devstack@n-api.service[101659]: DEBUG nova.api.openstack.wsgi [None req-a163bafb-3452-4151-b0bd-d164fa5eafbb admin admin] Calling method '>' {{(pid=101659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 12:51:42.922725 dv-cinder-784477-10-iscsi devstack@n-api.service[101659]: INFO nova.api.openstack.requestlog [None req-a163bafb-3452-4151-b0bd-d164fa5eafbb admin admin] 10.222.0.49 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 2106 microversion: 2.61 time: 0.076380 Dec 14 12:51:42.923493 dv-cinder-784477-10-iscsi devstack@n-api.service[101659]: [pid: 101659|app: 0|req: 10/20] 10.222.0.49 () {60 vars in 1291 bytes} [Tue Dec 14 12:51:42 2021] GET /compute/v2.1/flavors/detail?is_public=True => generated 2106 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Dec 14 12:51:45.904790 dv-cinder-784477-10-iscsi devstack@n-api.service[101658]: DEBUG nova.api.openstack.wsgi [None req-757b57e1-37ab-4a48-af05-92eb15f61f03 admin admin] Calling method '>' {{(pid=101658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 12:51:45.905860 dv-cinder-784477-10-iscsi devstack@n-api.service[101658]: INFO nova.api.openstack.requestlog [None req-757b57e1-37ab-4a48-af05-92eb15f61f03 admin admin] 10.222.0.49 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001592 Dec 14 12:51:45.906421 dv-cinder-784477-10-iscsi devstack@n-api.service[101658]: [pid: 101658|app: 0|req: 11/21] 10.222.0.49 () {54 vars in 930 bytes} [Tue Dec 14 12:51:45 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 14 12:51:45.966316 dv-cinder-784477-10-iscsi devstack@n-api.service[101659]: DEBUG nova.api.openstack.wsgi [None req-c695c6a0-d792-4710-b052-b929943dfad9 admin admin] Action: 'create', calling method: >, body: {"flavor": {"swap": 0, "id": "1", "OS-FLV-EXT-DATA:ephemeral": 0, "vcpus": 1, "name": "m1.tiny", "disk": 1, "os-flavor-access:is_public": true, "ram": 512, "rxtx_factor": 1.0}} {{(pid=101659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 14 12:51:45.988402 dv-cinder-784477-10-iscsi devstack@n-api.service[101659]: INFO nova.api.openstack.requestlog [None req-c695c6a0-d792-4710-b052-b929943dfad9 admin admin] 10.222.0.49 "POST /compute/v2.1/flavors" status: 200 len: 402 microversion: 2.61 time: 0.075600 Dec 14 12:51:45.988955 dv-cinder-784477-10-iscsi devstack@n-api.service[101659]: [pid: 101659|app: 0|req: 11/22] 10.222.0.49 () {64 vars in 1282 bytes} [Tue Dec 14 12:51:45 2021] POST /compute/v2.1/flavors => generated 402 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 14 12:51:46.001518 dv-cinder-784477-10-iscsi devstack@n-api.service[101658]: DEBUG nova.api.openstack.wsgi [None req-4b9fc6bb-08c7-4751-9284-82eca9f10803 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=101658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 14 12:51:46.024941 dv-cinder-784477-10-iscsi devstack@n-api.service[101658]: INFO nova.api.openstack.requestlog [None req-4b9fc6bb-08c7-4751-9284-82eca9f10803 admin admin] 10.222.0.49 "POST /compute/v2.1/flavors/1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.027119 Dec 14 12:51:46.025561 dv-cinder-784477-10-iscsi devstack@n-api.service[101658]: [pid: 101658|app: 0|req: 12/23] 10.222.0.49 () {64 vars in 1332 bytes} [Tue Dec 14 12:51:45 2021] POST /compute/v2.1/flavors/1/os-extra_specs => generated 43 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 14 12:51:48.518416 dv-cinder-784477-10-iscsi devstack@n-api.service[101659]: DEBUG nova.api.openstack.wsgi [None req-c695c6a0-d792-4710-b052-b929943dfad9 admin admin] Calling method '>' {{(pid=101659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 12:51:48.519441 dv-cinder-784477-10-iscsi devstack@n-api.service[101659]: INFO nova.api.openstack.requestlog [None req-c695c6a0-d792-4710-b052-b929943dfad9 admin admin] 10.222.0.49 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001530 Dec 14 12:51:48.519884 dv-cinder-784477-10-iscsi devstack@n-api.service[101659]: [pid: 101659|app: 0|req: 12/24] 10.222.0.49 () {54 vars in 930 bytes} [Tue Dec 14 12:51:48 2021] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 14 12:51:48.580705 dv-cinder-784477-10-iscsi devstack@n-api.service[101658]: DEBUG nova.api.openstack.wsgi [None req-2ed60777-b327-4b27-b7bf-d2097cc1ce3b admin admin] Action: 'create', calling method: >, body: {"flavor": {"swap": 0, "disk": 20, "vcpus": 1, "id": "2", "OS-FLV-EXT-DATA:ephemeral": 0, "name": "m1.small", "ram": 2048, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=101658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 14 12:51:48.599591 dv-cinder-784477-10-iscsi devstack@n-api.service[101658]: INFO nova.api.openstack.requestlog [None req-2ed60777-b327-4b27-b7bf-d2097cc1ce3b admin admin] 10.222.0.49 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.072912 Dec 14 12:51:48.600142 dv-cinder-784477-10-iscsi devstack@n-api.service[101658]: [pid: 101658|app: 0|req: 13/25] 10.222.0.49 () {64 vars in 1282 bytes} [Tue Dec 14 12:51:48 2021] POST /compute/v2.1/flavors => generated 405 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 14 12:51:48.612714 dv-cinder-784477-10-iscsi devstack@n-api.service[101659]: DEBUG nova.api.openstack.wsgi [None req-ee792ba9-e80a-4924-8b75-47584cc96d4b admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=101659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 14 12:51:48.635843 dv-cinder-784477-10-iscsi devstack@n-api.service[101659]: INFO nova.api.openstack.requestlog [None req-ee792ba9-e80a-4924-8b75-47584cc96d4b admin admin] 10.222.0.49 "POST /compute/v2.1/flavors/2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.026863 Dec 14 12:51:48.636396 dv-cinder-784477-10-iscsi devstack@n-api.service[101659]: [pid: 101659|app: 0|req: 13/26] 10.222.0.49 () {64 vars in 1332 bytes} [Tue Dec 14 12:51:48 2021] POST /compute/v2.1/flavors/2/os-extra_specs => generated 43 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 14 12:51:51.020706 dv-cinder-784477-10-iscsi devstack@n-api.service[101658]: DEBUG nova.api.openstack.wsgi [None req-2ed60777-b327-4b27-b7bf-d2097cc1ce3b admin admin] Calling method '>' {{(pid=101658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 12:51:51.021816 dv-cinder-784477-10-iscsi devstack@n-api.service[101658]: INFO nova.api.openstack.requestlog [None req-2ed60777-b327-4b27-b7bf-d2097cc1ce3b admin admin] 10.222.0.49 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001530 Dec 14 12:51:51.022187 dv-cinder-784477-10-iscsi devstack@n-api.service[101658]: [pid: 101658|app: 0|req: 14/27] 10.222.0.49 () {54 vars in 930 bytes} [Tue Dec 14 12:51:51 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 14 12:51:51.079735 dv-cinder-784477-10-iscsi devstack@n-api.service[101659]: DEBUG nova.api.openstack.wsgi [None req-d53c1490-490e-42c4-b955-a38cf83731c0 admin admin] Action: 'create', calling method: >, body: {"flavor": {"os-flavor-access:is_public": true, "disk": 40, "ram": 4096, "name": "m1.medium", "vcpus": 2, "OS-FLV-EXT-DATA:ephemeral": 0, "id": "3", "swap": 0, "rxtx_factor": 1.0}} {{(pid=101659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 14 12:51:51.098826 dv-cinder-784477-10-iscsi devstack@n-api.service[101659]: INFO nova.api.openstack.requestlog [None req-d53c1490-490e-42c4-b955-a38cf83731c0 admin admin] 10.222.0.49 "POST /compute/v2.1/flavors" status: 200 len: 406 microversion: 2.61 time: 0.070038 Dec 14 12:51:51.099629 dv-cinder-784477-10-iscsi devstack@n-api.service[101659]: [pid: 101659|app: 0|req: 14/28] 10.222.0.49 () {64 vars in 1282 bytes} [Tue Dec 14 12:51:51 2021] POST /compute/v2.1/flavors => generated 406 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 14 12:51:51.112429 dv-cinder-784477-10-iscsi devstack@n-api.service[101658]: DEBUG nova.api.openstack.wsgi [None req-d28da28f-3588-4c88-b065-0cd8f2034bb0 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=101658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 14 12:51:51.139300 dv-cinder-784477-10-iscsi devstack@n-api.service[101658]: INFO nova.api.openstack.requestlog [None req-d28da28f-3588-4c88-b065-0cd8f2034bb0 admin admin] 10.222.0.49 "POST /compute/v2.1/flavors/3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.028259 Dec 14 12:51:51.139300 dv-cinder-784477-10-iscsi devstack@n-api.service[101658]: [pid: 101658|app: 0|req: 15/29] 10.222.0.49 () {64 vars in 1332 bytes} [Tue Dec 14 12:51:51 2021] POST /compute/v2.1/flavors/3/os-extra_specs => generated 43 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 14 12:51:53.639070 dv-cinder-784477-10-iscsi devstack@n-api.service[101659]: DEBUG nova.api.openstack.wsgi [None req-d53c1490-490e-42c4-b955-a38cf83731c0 admin admin] Calling method '>' {{(pid=101659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 12:51:53.640076 dv-cinder-784477-10-iscsi devstack@n-api.service[101659]: INFO nova.api.openstack.requestlog [None req-d53c1490-490e-42c4-b955-a38cf83731c0 admin admin] 10.222.0.49 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001478 Dec 14 12:51:53.640471 dv-cinder-784477-10-iscsi devstack@n-api.service[101659]: [pid: 101659|app: 0|req: 15/30] 10.222.0.49 () {54 vars in 930 bytes} [Tue Dec 14 12:51:53 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 14 12:51:53.704006 dv-cinder-784477-10-iscsi devstack@n-api.service[101658]: DEBUG nova.api.openstack.wsgi [None req-2a504ad4-62be-4dc3-8bab-d9ebc3ca88d7 admin admin] Action: 'create', calling method: >, body: {"flavor": {"swap": 0, "id": "4", "disk": 80, "name": "m1.large", "rxtx_factor": 1.0, "os-flavor-access:is_public": true, "OS-FLV-EXT-DATA:ephemeral": 0, "ram": 8192, "vcpus": 4}} {{(pid=101658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 14 12:51:53.723975 dv-cinder-784477-10-iscsi devstack@n-api.service[101658]: INFO nova.api.openstack.requestlog [None req-2a504ad4-62be-4dc3-8bab-d9ebc3ca88d7 admin admin] 10.222.0.49 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.076582 Dec 14 12:51:53.734657 dv-cinder-784477-10-iscsi devstack@n-api.service[101658]: [pid: 101658|app: 0|req: 16/31] 10.222.0.49 () {64 vars in 1282 bytes} [Tue Dec 14 12:51:53 2021] POST /compute/v2.1/flavors => generated 405 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 14 12:51:53.738550 dv-cinder-784477-10-iscsi devstack@n-api.service[101659]: DEBUG nova.api.openstack.wsgi [None req-76fb3c43-651f-4771-b3e2-5b2df45f6c8b admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=101659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 14 12:51:53.764151 dv-cinder-784477-10-iscsi devstack@n-api.service[101659]: INFO nova.api.openstack.requestlog [None req-76fb3c43-651f-4771-b3e2-5b2df45f6c8b admin admin] 10.222.0.49 "POST /compute/v2.1/flavors/4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.029966 Dec 14 12:51:53.764766 dv-cinder-784477-10-iscsi devstack@n-api.service[101659]: [pid: 101659|app: 0|req: 16/32] 10.222.0.49 () {64 vars in 1332 bytes} [Tue Dec 14 12:51:53 2021] POST /compute/v2.1/flavors/4/os-extra_specs => generated 43 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 14 12:51:56.163805 dv-cinder-784477-10-iscsi devstack@n-api.service[101658]: DEBUG nova.api.openstack.wsgi [None req-2a504ad4-62be-4dc3-8bab-d9ebc3ca88d7 admin admin] Calling method '>' {{(pid=101658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 12:51:56.164814 dv-cinder-784477-10-iscsi devstack@n-api.service[101658]: INFO nova.api.openstack.requestlog [None req-2a504ad4-62be-4dc3-8bab-d9ebc3ca88d7 admin admin] 10.222.0.49 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001466 Dec 14 12:51:56.165250 dv-cinder-784477-10-iscsi devstack@n-api.service[101658]: [pid: 101658|app: 0|req: 17/33] 10.222.0.49 () {54 vars in 930 bytes} [Tue Dec 14 12:51:56 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 14 12:51:56.233004 dv-cinder-784477-10-iscsi devstack@n-api.service[101659]: DEBUG nova.api.openstack.wsgi [None req-dbb1b4c8-5f61-460d-851d-7a5cb2d8c893 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.xlarge", "OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0, "os-flavor-access:is_public": true, "disk": 160, "vcpus": 8, "rxtx_factor": 1.0, "id": "5", "ram": 16384}} {{(pid=101659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 14 12:51:56.254110 dv-cinder-784477-10-iscsi devstack@n-api.service[101659]: INFO nova.api.openstack.requestlog [None req-dbb1b4c8-5f61-460d-851d-7a5cb2d8c893 admin admin] 10.222.0.49 "POST /compute/v2.1/flavors" status: 200 len: 408 microversion: 2.61 time: 0.081854 Dec 14 12:51:56.255134 dv-cinder-784477-10-iscsi devstack@n-api.service[101659]: [pid: 101659|app: 0|req: 17/34] 10.222.0.49 () {64 vars in 1282 bytes} [Tue Dec 14 12:51:56 2021] POST /compute/v2.1/flavors => generated 408 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 14 12:51:56.267454 dv-cinder-784477-10-iscsi devstack@n-api.service[101658]: DEBUG nova.api.openstack.wsgi [None req-3717d1db-6754-44ed-9d80-824daff5de1e admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=101658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 14 12:51:56.295641 dv-cinder-784477-10-iscsi devstack@n-api.service[101658]: INFO nova.api.openstack.requestlog [None req-3717d1db-6754-44ed-9d80-824daff5de1e admin admin] 10.222.0.49 "POST /compute/v2.1/flavors/5/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.031766 Dec 14 12:51:56.297334 dv-cinder-784477-10-iscsi devstack@n-api.service[101658]: [pid: 101658|app: 0|req: 18/35] 10.222.0.49 () {64 vars in 1332 bytes} [Tue Dec 14 12:51:56 2021] POST /compute/v2.1/flavors/5/os-extra_specs => generated 43 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 14 12:52:16.764100 dv-cinder-784477-10-iscsi devstack@n-api.service[101659]: DEBUG nova.api.openstack.wsgi [None req-dbb1b4c8-5f61-460d-851d-7a5cb2d8c893 admin admin] Calling method '>' {{(pid=101659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 12:52:16.765278 dv-cinder-784477-10-iscsi devstack@n-api.service[101659]: INFO nova.api.openstack.requestlog [None req-dbb1b4c8-5f61-460d-851d-7a5cb2d8c893 admin admin] 10.222.0.49 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001561 Dec 14 12:52:16.765686 dv-cinder-784477-10-iscsi devstack@n-api.service[101659]: [pid: 101659|app: 0|req: 18/36] 10.222.0.49 () {54 vars in 930 bytes} [Tue Dec 14 12:52:16 2021] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 14 12:52:16.836240 dv-cinder-784477-10-iscsi devstack@n-api.service[101658]: DEBUG nova.api.openstack.wsgi [None req-1bce04ae-40fc-4387-9f5d-56c9d916df85 admin admin] Calling method '>' {{(pid=101658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 12:52:16.853141 dv-cinder-784477-10-iscsi devstack@n-api.service[101658]: INFO nova.api.openstack.requestlog [None req-1bce04ae-40fc-4387-9f5d-56c9d916df85 admin admin] 10.222.0.49 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 4202 microversion: 2.61 time: 0.080219 Dec 14 12:52:16.854396 dv-cinder-784477-10-iscsi devstack@n-api.service[101658]: [pid: 101658|app: 0|req: 19/37] 10.222.0.49 () {60 vars in 1291 bytes} [Tue Dec 14 12:52:16 2021] GET /compute/v2.1/flavors/detail?is_public=True => generated 4202 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 14 12:52:18.521207 dv-cinder-784477-10-iscsi devstack@n-api.service[101659]: DEBUG nova.api.openstack.wsgi [None req-dbb1b4c8-5f61-460d-851d-7a5cb2d8c893 admin admin] Calling method '>' {{(pid=101659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 12:52:18.522332 dv-cinder-784477-10-iscsi devstack@n-api.service[101659]: INFO nova.api.openstack.requestlog [None req-dbb1b4c8-5f61-460d-851d-7a5cb2d8c893 admin admin] 10.222.0.49 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001546 Dec 14 12:52:18.522715 dv-cinder-784477-10-iscsi devstack@n-api.service[101659]: [pid: 101659|app: 0|req: 19/38] 10.222.0.49 () {56 vars in 1074 bytes} [Tue Dec 14 12:52:18 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 14 12:52:18.723558 dv-cinder-784477-10-iscsi devstack@n-api.service[101658]: DEBUG nova.api.openstack.wsgi [None req-3c3662e8-e1dc-4000-9d62-92730822a759 admin admin] Calling method '>' {{(pid=101658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 12:52:18.729489 dv-cinder-784477-10-iscsi devstack@n-api.service[101658]: INFO nova.api.openstack.wsgi [None req-3c3662e8-e1dc-4000-9d62-92730822a759 admin admin] HTTP exception thrown: Flavor 42 could not be found. Dec 14 12:52:18.730066 dv-cinder-784477-10-iscsi devstack@n-api.service[101658]: DEBUG nova.api.openstack.wsgi [None req-3c3662e8-e1dc-4000-9d62-92730822a759 admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=101658) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 14 12:52:18.730864 dv-cinder-784477-10-iscsi devstack@n-api.service[101658]: INFO nova.api.openstack.requestlog [None req-3c3662e8-e1dc-4000-9d62-92730822a759 admin admin] 10.222.0.49 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.071627 Dec 14 12:52:18.731382 dv-cinder-784477-10-iscsi devstack@n-api.service[101658]: [pid: 101658|app: 0|req: 20/39] 10.222.0.49 () {60 vars in 1190 bytes} [Tue Dec 14 12:52:18 2021] GET /compute/v2.1/flavors/42 => generated 75 bytes in 73 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Dec 14 12:52:18.741560 dv-cinder-784477-10-iscsi devstack@n-api.service[101659]: DEBUG nova.api.openstack.wsgi [None req-04e5d092-0435-442e-83b3-a77c3b2c17ff admin admin] Calling method '>' {{(pid=101659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 12:52:18.762597 dv-cinder-784477-10-iscsi devstack@n-api.service[101659]: INFO nova.api.openstack.requestlog [None req-04e5d092-0435-442e-83b3-a77c3b2c17ff admin admin] 10.222.0.49 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.024638 Dec 14 12:52:18.763210 dv-cinder-784477-10-iscsi devstack@n-api.service[101659]: [pid: 101659|app: 0|req: 20/40] 10.222.0.49 () {60 vars in 1210 bytes} [Tue Dec 14 12:52:18 2021] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 26 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 14 12:52:18.773441 dv-cinder-784477-10-iscsi devstack@n-api.service[101658]: DEBUG nova.api.openstack.wsgi [None req-cd04a28e-1309-4c8e-ae1c-02fcf7322f56 admin admin] Calling method '>' {{(pid=101658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 12:52:18.794659 dv-cinder-784477-10-iscsi devstack@n-api.service[101658]: INFO nova.api.openstack.requestlog [None req-cd04a28e-1309-4c8e-ae1c-02fcf7322f56 admin admin] 10.222.0.49 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.024709 Dec 14 12:52:18.795187 dv-cinder-784477-10-iscsi devstack@n-api.service[101658]: [pid: 101658|app: 0|req: 21/41] 10.222.0.49 () {60 vars in 1210 bytes} [Tue Dec 14 12:52:18 2021] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 26 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 14 12:52:18.807639 dv-cinder-784477-10-iscsi devstack@n-api.service[101659]: DEBUG nova.api.openstack.wsgi [None req-0186e0f6-613c-477c-afa0-6be012f2f2a3 admin admin] Calling method '>' {{(pid=101659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 12:52:18.814697 dv-cinder-784477-10-iscsi devstack@n-api.service[101659]: INFO nova.api.openstack.wsgi [None req-0186e0f6-613c-477c-afa0-6be012f2f2a3 admin admin] HTTP exception thrown: Flavor 42 could not be found. Dec 14 12:52:18.815263 dv-cinder-784477-10-iscsi devstack@n-api.service[101659]: DEBUG nova.api.openstack.wsgi [None req-0186e0f6-613c-477c-afa0-6be012f2f2a3 admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=101659) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 14 12:52:18.816054 dv-cinder-784477-10-iscsi devstack@n-api.service[101659]: INFO nova.api.openstack.requestlog [None req-0186e0f6-613c-477c-afa0-6be012f2f2a3 admin admin] 10.222.0.49 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.014003 Dec 14 12:52:18.816543 dv-cinder-784477-10-iscsi devstack@n-api.service[101659]: [pid: 101659|app: 0|req: 21/42] 10.222.0.49 () {60 vars in 1190 bytes} [Tue Dec 14 12:52:18 2021] GET /compute/v2.1/flavors/42 => generated 75 bytes in 15 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Dec 14 12:52:20.342683 dv-cinder-784477-10-iscsi devstack@n-api.service[101658]: DEBUG nova.api.openstack.wsgi [None req-cd04a28e-1309-4c8e-ae1c-02fcf7322f56 admin admin] Calling method '>' {{(pid=101658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 12:52:20.343717 dv-cinder-784477-10-iscsi devstack@n-api.service[101658]: INFO nova.api.openstack.requestlog [None req-cd04a28e-1309-4c8e-ae1c-02fcf7322f56 admin admin] 10.222.0.49 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001572 Dec 14 12:52:20.344110 dv-cinder-784477-10-iscsi devstack@n-api.service[101658]: [pid: 101658|app: 0|req: 22/43] 10.222.0.49 () {56 vars in 1074 bytes} [Tue Dec 14 12:52:20 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 14 12:52:20.546884 dv-cinder-784477-10-iscsi devstack@n-api.service[101659]: DEBUG nova.api.openstack.wsgi [None req-0c62b369-f8a6-4451-8ec7-26626fc6e811 admin admin] Calling method '>' {{(pid=101659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 12:52:20.552385 dv-cinder-784477-10-iscsi devstack@n-api.service[101659]: INFO nova.api.openstack.wsgi [None req-0c62b369-f8a6-4451-8ec7-26626fc6e811 admin admin] HTTP exception thrown: Flavor 84 could not be found. Dec 14 12:52:20.553002 dv-cinder-784477-10-iscsi devstack@n-api.service[101659]: DEBUG nova.api.openstack.wsgi [None req-0c62b369-f8a6-4451-8ec7-26626fc6e811 admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=101659) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 14 12:52:20.553788 dv-cinder-784477-10-iscsi devstack@n-api.service[101659]: INFO nova.api.openstack.requestlog [None req-0c62b369-f8a6-4451-8ec7-26626fc6e811 admin admin] 10.222.0.49 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.070801 Dec 14 12:52:20.554310 dv-cinder-784477-10-iscsi devstack@n-api.service[101659]: [pid: 101659|app: 0|req: 22/44] 10.222.0.49 () {60 vars in 1190 bytes} [Tue Dec 14 12:52:20 2021] GET /compute/v2.1/flavors/84 => generated 75 bytes in 72 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Dec 14 12:52:20.564346 dv-cinder-784477-10-iscsi devstack@n-api.service[101658]: DEBUG nova.api.openstack.wsgi [None req-1a60a357-50bf-4f00-827c-afe566e646dc admin admin] Calling method '>' {{(pid=101658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 12:52:20.577751 dv-cinder-784477-10-iscsi devstack@n-api.service[101658]: INFO nova.api.openstack.requestlog [None req-1a60a357-50bf-4f00-827c-afe566e646dc admin admin] 10.222.0.49 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.017045 Dec 14 12:52:20.578233 dv-cinder-784477-10-iscsi devstack@n-api.service[101658]: [pid: 101658|app: 0|req: 23/45] 10.222.0.49 () {60 vars in 1210 bytes} [Tue Dec 14 12:52:20 2021] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 18 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 14 12:52:20.588021 dv-cinder-784477-10-iscsi devstack@n-api.service[101659]: DEBUG nova.api.openstack.wsgi [None req-c4c6239b-e3e6-48e3-9379-7deb853caafa admin admin] Calling method '>' {{(pid=101659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 12:52:20.601849 dv-cinder-784477-10-iscsi devstack@n-api.service[101659]: INFO nova.api.openstack.requestlog [None req-c4c6239b-e3e6-48e3-9379-7deb853caafa admin admin] 10.222.0.49 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.017276 Dec 14 12:52:20.602357 dv-cinder-784477-10-iscsi devstack@n-api.service[101659]: [pid: 101659|app: 0|req: 23/46] 10.222.0.49 () {60 vars in 1210 bytes} [Tue Dec 14 12:52:20 2021] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 18 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Dec 14 12:52:20.611983 dv-cinder-784477-10-iscsi devstack@n-api.service[101658]: DEBUG nova.api.openstack.wsgi [None req-6fedc659-fd3f-447c-bd0f-dd256319b83e admin admin] Calling method '>' {{(pid=101658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 12:52:20.617196 dv-cinder-784477-10-iscsi devstack@n-api.service[101658]: INFO nova.api.openstack.wsgi [None req-6fedc659-fd3f-447c-bd0f-dd256319b83e admin admin] HTTP exception thrown: Flavor 84 could not be found. Dec 14 12:52:20.617755 dv-cinder-784477-10-iscsi devstack@n-api.service[101658]: DEBUG nova.api.openstack.wsgi [None req-6fedc659-fd3f-447c-bd0f-dd256319b83e admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=101658) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 14 12:52:20.618515 dv-cinder-784477-10-iscsi devstack@n-api.service[101658]: INFO nova.api.openstack.requestlog [None req-6fedc659-fd3f-447c-bd0f-dd256319b83e admin admin] 10.222.0.49 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.010012 Dec 14 12:52:20.618991 dv-cinder-784477-10-iscsi devstack@n-api.service[101658]: [pid: 101658|app: 0|req: 24/47] 10.222.0.49 () {60 vars in 1190 bytes} [Tue Dec 14 12:52:20 2021] GET /compute/v2.1/flavors/84 => generated 75 bytes in 11 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Dec 14 12:52:22.106761 dv-cinder-784477-10-iscsi devstack@n-api.service[101659]: DEBUG nova.api.openstack.wsgi [None req-c4c6239b-e3e6-48e3-9379-7deb853caafa admin admin] Calling method '>' {{(pid=101659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 12:52:22.107847 dv-cinder-784477-10-iscsi devstack@n-api.service[101659]: INFO nova.api.openstack.requestlog [None req-c4c6239b-e3e6-48e3-9379-7deb853caafa admin admin] 10.222.0.49 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001802 Dec 14 12:52:22.108384 dv-cinder-784477-10-iscsi devstack@n-api.service[101659]: [pid: 101659|app: 0|req: 24/48] 10.222.0.49 () {56 vars in 1074 bytes} [Tue Dec 14 12:52:22 2021] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 14 12:52:22.309953 dv-cinder-784477-10-iscsi devstack@n-api.service[101658]: DEBUG nova.api.openstack.wsgi [None req-e6461bd8-3803-45b7-930d-9d767ed9899a admin admin] Calling method '>' {{(pid=101658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 12:52:22.316250 dv-cinder-784477-10-iscsi devstack@n-api.service[101658]: INFO nova.api.openstack.wsgi [None req-e6461bd8-3803-45b7-930d-9d767ed9899a admin admin] HTTP exception thrown: Flavor 451 could not be found. Dec 14 12:52:22.316803 dv-cinder-784477-10-iscsi devstack@n-api.service[101658]: DEBUG nova.api.openstack.wsgi [None req-e6461bd8-3803-45b7-930d-9d767ed9899a admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=101658) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 14 12:52:22.317613 dv-cinder-784477-10-iscsi devstack@n-api.service[101658]: INFO nova.api.openstack.requestlog [None req-e6461bd8-3803-45b7-930d-9d767ed9899a admin admin] 10.222.0.49 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.072125 Dec 14 12:52:22.318110 dv-cinder-784477-10-iscsi devstack@n-api.service[101658]: [pid: 101658|app: 0|req: 25/49] 10.222.0.49 () {60 vars in 1193 bytes} [Tue Dec 14 12:52:22 2021] GET /compute/v2.1/flavors/451 => generated 76 bytes in 74 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Dec 14 12:52:22.328093 dv-cinder-784477-10-iscsi devstack@n-api.service[101659]: DEBUG nova.api.openstack.wsgi [None req-cdb56a1a-ed84-4af5-9060-453c902bcc0e admin admin] Calling method '>' {{(pid=101659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 12:52:22.341784 dv-cinder-784477-10-iscsi devstack@n-api.service[101659]: INFO nova.api.openstack.requestlog [None req-cdb56a1a-ed84-4af5-9060-453c902bcc0e admin admin] 10.222.0.49 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.017214 Dec 14 12:52:22.342302 dv-cinder-784477-10-iscsi devstack@n-api.service[101659]: [pid: 101659|app: 0|req: 25/50] 10.222.0.49 () {60 vars in 1210 bytes} [Tue Dec 14 12:52:22 2021] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 18 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 14 12:52:22.356612 dv-cinder-784477-10-iscsi devstack@n-api.service[101658]: DEBUG nova.api.openstack.wsgi [None req-45e1df4d-621c-425e-868c-334b1fefa411 admin admin] Calling method '>' {{(pid=101658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 12:52:22.376766 dv-cinder-784477-10-iscsi devstack@n-api.service[101658]: INFO nova.api.openstack.requestlog [None req-45e1df4d-621c-425e-868c-334b1fefa411 admin admin] 10.222.0.49 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.027638 Dec 14 12:52:22.377231 dv-cinder-784477-10-iscsi devstack@n-api.service[101658]: [pid: 101658|app: 0|req: 26/51] 10.222.0.49 () {60 vars in 1210 bytes} [Tue Dec 14 12:52:22 2021] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 14 12:52:22.387422 dv-cinder-784477-10-iscsi devstack@n-api.service[101659]: DEBUG nova.api.openstack.wsgi [None req-e68909d9-0c91-44bf-828d-13774b7fca1a admin admin] Calling method '>' {{(pid=101659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 12:52:22.392959 dv-cinder-784477-10-iscsi devstack@n-api.service[101659]: INFO nova.api.openstack.wsgi [None req-e68909d9-0c91-44bf-828d-13774b7fca1a admin admin] HTTP exception thrown: Flavor 451 could not be found. Dec 14 12:52:22.393519 dv-cinder-784477-10-iscsi devstack@n-api.service[101659]: DEBUG nova.api.openstack.wsgi [None req-e68909d9-0c91-44bf-828d-13774b7fca1a admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=101659) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 14 12:52:22.394293 dv-cinder-784477-10-iscsi devstack@n-api.service[101659]: INFO nova.api.openstack.requestlog [None req-e68909d9-0c91-44bf-828d-13774b7fca1a admin admin] 10.222.0.49 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.010505 Dec 14 12:52:22.394811 dv-cinder-784477-10-iscsi devstack@n-api.service[101659]: [pid: 101659|app: 0|req: 26/52] 10.222.0.49 () {60 vars in 1193 bytes} [Tue Dec 14 12:52:22 2021] GET /compute/v2.1/flavors/451 => generated 76 bytes in 11 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Dec 14 12:52:23.870521 dv-cinder-784477-10-iscsi devstack@n-api.service[101658]: DEBUG nova.api.openstack.wsgi [None req-45e1df4d-621c-425e-868c-334b1fefa411 admin admin] Calling method '>' {{(pid=101658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 12:52:23.871572 dv-cinder-784477-10-iscsi devstack@n-api.service[101658]: INFO nova.api.openstack.requestlog [None req-45e1df4d-621c-425e-868c-334b1fefa411 admin admin] 10.222.0.49 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001493 Dec 14 12:52:23.871969 dv-cinder-784477-10-iscsi devstack@n-api.service[101658]: [pid: 101658|app: 0|req: 27/53] 10.222.0.49 () {56 vars in 1074 bytes} [Tue Dec 14 12:52:23 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 14 12:52:24.073167 dv-cinder-784477-10-iscsi devstack@n-api.service[101659]: DEBUG nova.api.openstack.wsgi [None req-ed89b57a-3af0-428d-a8ec-0260ea5b096b admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.nano", "ram": 256, "vcpus": 1, "disk": 1, "id": "42", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=101659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 14 12:52:24.094864 dv-cinder-784477-10-iscsi devstack@n-api.service[101659]: INFO nova.api.openstack.requestlog [None req-ed89b57a-3af0-428d-a8ec-0260ea5b096b admin admin] 10.222.0.49 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.90 time: 0.082338 Dec 14 12:52:24.095416 dv-cinder-784477-10-iscsi devstack@n-api.service[101659]: [pid: 101659|app: 0|req: 27/54] 10.222.0.49 () {64 vars in 1235 bytes} [Tue Dec 14 12:52:24 2021] POST /compute/v2.1/flavors => generated 404 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 14 12:52:25.588085 dv-cinder-784477-10-iscsi devstack@n-api.service[101658]: DEBUG nova.api.openstack.wsgi [None req-45e1df4d-621c-425e-868c-334b1fefa411 admin admin] Calling method '>' {{(pid=101658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 12:52:25.589129 dv-cinder-784477-10-iscsi devstack@n-api.service[101658]: INFO nova.api.openstack.requestlog [None req-45e1df4d-621c-425e-868c-334b1fefa411 admin admin] 10.222.0.49 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001460 Dec 14 12:52:25.589517 dv-cinder-784477-10-iscsi devstack@n-api.service[101658]: [pid: 101658|app: 0|req: 28/55] 10.222.0.49 () {56 vars in 1074 bytes} [Tue Dec 14 12:52:25 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 14 12:52:25.800001 dv-cinder-784477-10-iscsi devstack@n-api.service[101659]: DEBUG nova.api.openstack.wsgi [None req-dcb4f18c-b0c0-452d-bfd7-f82055a30b7a admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.micro", "ram": 256, "vcpus": 1, "disk": 2, "id": "84", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=101659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 14 12:52:25.828556 dv-cinder-784477-10-iscsi devstack@n-api.service[101659]: INFO nova.api.openstack.requestlog [None req-dcb4f18c-b0c0-452d-bfd7-f82055a30b7a admin admin] 10.222.0.49 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.90 time: 0.098729 Dec 14 12:52:25.829140 dv-cinder-784477-10-iscsi devstack@n-api.service[101659]: [pid: 101659|app: 0|req: 28/56] 10.222.0.49 () {64 vars in 1235 bytes} [Tue Dec 14 12:52:25 2021] POST /compute/v2.1/flavors => generated 405 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 14 12:52:27.312860 dv-cinder-784477-10-iscsi devstack@n-api.service[101658]: DEBUG nova.api.openstack.wsgi [None req-45e1df4d-621c-425e-868c-334b1fefa411 admin admin] Calling method '>' {{(pid=101658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 12:52:27.313893 dv-cinder-784477-10-iscsi devstack@n-api.service[101658]: INFO nova.api.openstack.requestlog [None req-45e1df4d-621c-425e-868c-334b1fefa411 admin admin] 10.222.0.49 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001503 Dec 14 12:52:27.314281 dv-cinder-784477-10-iscsi devstack@n-api.service[101658]: [pid: 101658|app: 0|req: 29/57] 10.222.0.49 () {56 vars in 1074 bytes} [Tue Dec 14 12:52:27 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 14 12:52:27.514556 dv-cinder-784477-10-iscsi devstack@n-api.service[101659]: DEBUG nova.api.openstack.wsgi [None req-f9a18db2-d606-4316-9e4b-999c7f275713 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat", "ram": 512, "vcpus": 1, "disk": 1, "id": "451", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=101659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 14 12:52:27.535448 dv-cinder-784477-10-iscsi devstack@n-api.service[101659]: INFO nova.api.openstack.requestlog [None req-f9a18db2-d606-4316-9e4b-999c7f275713 admin admin] 10.222.0.49 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.90 time: 0.083723 Dec 14 12:52:27.536008 dv-cinder-784477-10-iscsi devstack@n-api.service[101659]: [pid: 101659|app: 0|req: 29/58] 10.222.0.49 () {64 vars in 1235 bytes} [Tue Dec 14 12:52:27 2021] POST /compute/v2.1/flavors => generated 407 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 14 12:52:29.020098 dv-cinder-784477-10-iscsi devstack@n-api.service[101658]: DEBUG nova.api.openstack.wsgi [None req-45e1df4d-621c-425e-868c-334b1fefa411 admin admin] Calling method '>' {{(pid=101658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 12:52:29.021138 dv-cinder-784477-10-iscsi devstack@n-api.service[101658]: INFO nova.api.openstack.requestlog [None req-45e1df4d-621c-425e-868c-334b1fefa411 admin admin] 10.222.0.49 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001483 Dec 14 12:52:29.021528 dv-cinder-784477-10-iscsi devstack@n-api.service[101658]: [pid: 101658|app: 0|req: 30/59] 10.222.0.49 () {56 vars in 1074 bytes} [Tue Dec 14 12:52:29 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 14 12:52:29.220257 dv-cinder-784477-10-iscsi devstack@n-api.service[101659]: DEBUG nova.api.openstack.wsgi [None req-ee70954c-2bbf-4baf-bd30-835e4a4fb813 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat2", "ram": 1024, "vcpus": 1, "disk": 1, "id": "452", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=101659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 14 12:52:29.240078 dv-cinder-784477-10-iscsi devstack@n-api.service[101659]: INFO nova.api.openstack.requestlog [None req-ee70954c-2bbf-4baf-bd30-835e4a4fb813 admin admin] 10.222.0.49 "POST /compute/v2.1/flavors" status: 200 len: 409 microversion: 2.90 time: 0.081018 Dec 14 12:52:29.240615 dv-cinder-784477-10-iscsi devstack@n-api.service[101659]: [pid: 101659|app: 0|req: 30/60] 10.222.0.49 () {64 vars in 1235 bytes} [Tue Dec 14 12:52:29 2021] POST /compute/v2.1/flavors => generated 409 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 14 12:52:30.702799 dv-cinder-784477-10-iscsi devstack@n-api.service[101658]: DEBUG nova.api.openstack.wsgi [None req-45e1df4d-621c-425e-868c-334b1fefa411 admin admin] Calling method '>' {{(pid=101658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 12:52:30.703877 dv-cinder-784477-10-iscsi devstack@n-api.service[101658]: INFO nova.api.openstack.requestlog [None req-45e1df4d-621c-425e-868c-334b1fefa411 admin admin] 10.222.0.49 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001514 Dec 14 12:52:30.704258 dv-cinder-784477-10-iscsi devstack@n-api.service[101658]: [pid: 101658|app: 0|req: 31/61] 10.222.0.49 () {56 vars in 1074 bytes} [Tue Dec 14 12:52:30 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 14 12:52:30.901268 dv-cinder-784477-10-iscsi devstack@n-api.service[101659]: DEBUG nova.api.openstack.wsgi [None req-1f9e97eb-38a7-4120-9205-16f9f850d1ab admin admin] Calling method '>' {{(pid=101659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 12:52:30.920602 dv-cinder-784477-10-iscsi devstack@n-api.service[101659]: INFO nova.api.openstack.requestlog [None req-1f9e97eb-38a7-4120-9205-16f9f850d1ab admin admin] 10.222.0.49 "GET /compute/v2.1/flavors/detail" status: 200 len: 5777 microversion: 2.90 time: 0.079041 Dec 14 12:52:30.921117 dv-cinder-784477-10-iscsi devstack@n-api.service[101659]: [pid: 101659|app: 0|req: 31/62] 10.222.0.49 () {60 vars in 1202 bytes} [Tue Dec 14 12:52:30 2021] GET /compute/v2.1/flavors/detail => generated 5777 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 14 12:53:18.448255 dv-cinder-784477-10-iscsi devstack@n-api.service[101658]: DEBUG nova.api.openstack.wsgi [None req-45e1df4d-621c-425e-868c-334b1fefa411 admin admin] Calling method '>' {{(pid=101658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 12:53:18.449570 dv-cinder-784477-10-iscsi devstack@n-api.service[101658]: INFO nova.api.openstack.requestlog [None req-45e1df4d-621c-425e-868c-334b1fefa411 admin admin] 10.222.0.49 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001965 Dec 14 12:53:18.450138 dv-cinder-784477-10-iscsi devstack@n-api.service[101658]: [pid: 101658|app: 0|req: 32/63] 10.222.0.49 () {54 vars in 930 bytes} [Tue Dec 14 12:53:18 2021] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 14 12:53:18.517430 dv-cinder-784477-10-iscsi devstack@n-api.service[101659]: DEBUG nova.api.openstack.wsgi [None req-d95e9c0e-f434-4230-8692-1975b507fe54 admin admin] Calling method '>' {{(pid=101659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 12:53:18.539467 dv-cinder-784477-10-iscsi devstack@n-api.service[101659]: INFO nova.api.openstack.requestlog [None req-d95e9c0e-f434-4230-8692-1975b507fe54 admin admin] 10.222.0.49 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 5791 microversion: 2.61 time: 0.082542 Dec 14 12:53:18.540045 dv-cinder-784477-10-iscsi devstack@n-api.service[101659]: [pid: 101659|app: 0|req: 32/64] 10.222.0.49 () {60 vars in 1291 bytes} [Tue Dec 14 12:53:18 2021] GET /compute/v2.1/flavors/detail?is_public=True => generated 5791 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 14 12:53:18.562729 dv-cinder-784477-10-iscsi devstack@n-api.service[101658]: DEBUG nova.api.openstack.wsgi [None req-f6db1388-43ee-4e00-8284-53b05906211d admin admin] Calling method '>' {{(pid=101658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 12:53:18.570762 dv-cinder-784477-10-iscsi devstack@n-api.service[101658]: INFO nova.api.openstack.requestlog [None req-f6db1388-43ee-4e00-8284-53b05906211d admin admin] 10.222.0.49 "GET /compute/v2.1/flavors/42/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011832 Dec 14 12:53:18.571257 dv-cinder-784477-10-iscsi devstack@n-api.service[101658]: [pid: 101658|app: 0|req: 33/65] 10.222.0.49 () {60 vars in 1282 bytes} [Tue Dec 14 12:53:18 2021] GET /compute/v2.1/flavors/42/os-extra_specs => generated 19 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 14 12:53:18.583165 dv-cinder-784477-10-iscsi devstack@n-api.service[101659]: DEBUG nova.api.openstack.wsgi [None req-ed7a07c3-0759-4a97-a8ce-805d81e15d60 admin admin] Calling method '>' {{(pid=101659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 12:53:18.590866 dv-cinder-784477-10-iscsi devstack@n-api.service[101659]: INFO nova.api.openstack.requestlog [None req-ed7a07c3-0759-4a97-a8ce-805d81e15d60 admin admin] 10.222.0.49 "GET /compute/v2.1/flavors/451/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011164 Dec 14 12:53:18.591369 dv-cinder-784477-10-iscsi devstack@n-api.service[101659]: [pid: 101659|app: 0|req: 33/66] 10.222.0.49 () {60 vars in 1285 bytes} [Tue Dec 14 12:53:18 2021] GET /compute/v2.1/flavors/451/os-extra_specs => generated 19 bytes in 12 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 14 12:53:18.603014 dv-cinder-784477-10-iscsi devstack@n-api.service[101658]: DEBUG nova.api.openstack.wsgi [None req-a91b6421-efa0-4215-8636-07c12ccdb91e admin admin] Calling method '>' {{(pid=101658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 12:53:18.611058 dv-cinder-784477-10-iscsi devstack@n-api.service[101658]: INFO nova.api.openstack.requestlog [None req-a91b6421-efa0-4215-8636-07c12ccdb91e admin admin] 10.222.0.49 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011480 Dec 14 12:53:18.611615 dv-cinder-784477-10-iscsi devstack@n-api.service[101658]: [pid: 101658|app: 0|req: 34/67] 10.222.0.49 () {60 vars in 1285 bytes} [Tue Dec 14 12:53:18 2021] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 14 12:53:18.623209 dv-cinder-784477-10-iscsi devstack@n-api.service[101659]: DEBUG nova.api.openstack.wsgi [None req-8a5d6872-f352-42d5-865a-f5d38dc5f786 admin admin] Calling method '>' {{(pid=101659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 12:53:18.630971 dv-cinder-784477-10-iscsi devstack@n-api.service[101659]: INFO nova.api.openstack.requestlog [None req-8a5d6872-f352-42d5-865a-f5d38dc5f786 admin admin] 10.222.0.49 "GET /compute/v2.1/flavors/84/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011113 Dec 14 12:53:18.631401 dv-cinder-784477-10-iscsi devstack@n-api.service[101659]: [pid: 101659|app: 0|req: 34/68] 10.222.0.49 () {60 vars in 1282 bytes} [Tue Dec 14 12:53:18 2021] GET /compute/v2.1/flavors/84/os-extra_specs => generated 19 bytes in 12 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 14 12:54:41.574288 dv-cinder-784477-10-iscsi devstack@n-api.service[101658]: DEBUG nova.api.openstack.wsgi [None req-42f11e80-0afd-43f6-a45e-3a9d8904f5d1 tempest-verify_tempest_config-832567733 tempest-verify_tempest_config-832567733-project] Calling method '>' {{(pid=101658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 12:54:41.577213 dv-cinder-784477-10-iscsi devstack@n-api.service[101658]: INFO nova.api.openstack.requestlog [None req-42f11e80-0afd-43f6-a45e-3a9d8904f5d1 tempest-verify_tempest_config-832567733 tempest-verify_tempest_config-832567733-project] 10.222.0.49 "GET /compute/v2.1/extensions" status: 200 len: 22700 microversion: 2.1 time: 0.121777 Dec 14 12:54:41.577986 dv-cinder-784477-10-iscsi devstack@n-api.service[101658]: [pid: 101658|app: 0|req: 35/69] 10.222.0.49 () {58 vars in 1133 bytes} [Tue Dec 14 12:54:41 2021] GET /compute/v2.1/extensions => generated 22700 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 14 12:56:08.952890 dv-cinder-784477-10-iscsi devstack@n-api.service[101659]: DEBUG nova.api.openstack.wsgi [None req-8a5d6872-f352-42d5-865a-f5d38dc5f786 admin admin] Calling method '>' {{(pid=101659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 12:56:08.954250 dv-cinder-784477-10-iscsi devstack@n-api.service[101659]: INFO nova.api.openstack.requestlog [None req-8a5d6872-f352-42d5-865a-f5d38dc5f786 admin admin] 10.222.0.49 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002004 Dec 14 12:56:08.954769 dv-cinder-784477-10-iscsi devstack@n-api.service[101659]: [pid: 101659|app: 0|req: 35/70] 10.222.0.49 () {56 vars in 1074 bytes} [Tue Dec 14 12:56:08 2021] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 14 12:56:09.228392 dv-cinder-784477-10-iscsi devstack@n-api.service[101658]: DEBUG nova.api.openstack.wsgi [None req-eeb45a83-c60e-448c-9130-544c3af8d527 admin admin] Calling method '>' {{(pid=101658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 12:56:09.229592 dv-cinder-784477-10-iscsi devstack@n-api.service[101658]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-services:list": "rule:system_reader_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 14 12:56:09.229592 dv-cinder-784477-10-iscsi devstack@n-api.service[101658]: warnings.warn(msg) Dec 14 12:56:09.231129 dv-cinder-784477-10-iscsi devstack@n-api.service[101658]: DEBUG oslo_concurrency.lockutils [None req-eeb45a83-c60e-448c-9130-544c3af8d527 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 12:56:09.231569 dv-cinder-784477-10-iscsi devstack@n-api.service[101658]: DEBUG oslo_concurrency.lockutils [None req-eeb45a83-c60e-448c-9130-544c3af8d527 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 12:56:09.232392 dv-cinder-784477-10-iscsi devstack@n-api.service[101658]: DEBUG oslo_concurrency.lockutils [None req-eeb45a83-c60e-448c-9130-544c3af8d527 admin admin] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 12:56:09.232814 dv-cinder-784477-10-iscsi devstack@n-api.service[101658]: DEBUG oslo_concurrency.lockutils [None req-eeb45a83-c60e-448c-9130-544c3af8d527 admin admin] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 12:56:09.265675 dv-cinder-784477-10-iscsi devstack@n-api.service[101658]: INFO nova.api.openstack.requestlog [None req-eeb45a83-c60e-448c-9130-544c3af8d527 admin admin] 10.222.0.49 "GET /compute/v2.1/os-services" status: 200 len: 794 microversion: 2.90 time: 0.170273 Dec 14 12:56:09.266234 dv-cinder-784477-10-iscsi devstack@n-api.service[101658]: [pid: 101658|app: 0|req: 36/71] 10.222.0.49 () {60 vars in 1193 bytes} [Tue Dec 14 12:56:09 2021] GET /compute/v2.1/os-services => generated 794 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 14 12:56:10.792509 dv-cinder-784477-10-iscsi devstack@n-api.service[101659]: DEBUG nova.api.openstack.wsgi [None req-8a5d6872-f352-42d5-865a-f5d38dc5f786 admin admin] Calling method '>' {{(pid=101659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 12:56:10.793569 dv-cinder-784477-10-iscsi devstack@n-api.service[101659]: INFO nova.api.openstack.requestlog [None req-8a5d6872-f352-42d5-865a-f5d38dc5f786 admin admin] 10.222.0.49 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001520 Dec 14 12:56:10.793945 dv-cinder-784477-10-iscsi devstack@n-api.service[101659]: [pid: 101659|app: 0|req: 36/72] 10.222.0.49 () {56 vars in 1074 bytes} [Tue Dec 14 12:56:10 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 14 12:56:10.985716 dv-cinder-784477-10-iscsi devstack@n-api.service[101658]: DEBUG nova.api.openstack.wsgi [None req-ea9118e8-d6d0-4b4d-93c1-69781212ca92 admin admin] Calling method '>' {{(pid=101658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 12:56:10.986882 dv-cinder-784477-10-iscsi devstack@n-api.service[101658]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-services:list": "rule:system_reader_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 14 12:56:10.986882 dv-cinder-784477-10-iscsi devstack@n-api.service[101658]: warnings.warn(msg) Dec 14 12:56:10.988607 dv-cinder-784477-10-iscsi devstack@n-api.service[101658]: DEBUG oslo_concurrency.lockutils [None req-ea9118e8-d6d0-4b4d-93c1-69781212ca92 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 12:56:10.989169 dv-cinder-784477-10-iscsi devstack@n-api.service[101658]: DEBUG oslo_concurrency.lockutils [None req-ea9118e8-d6d0-4b4d-93c1-69781212ca92 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 12:56:10.990078 dv-cinder-784477-10-iscsi devstack@n-api.service[101658]: DEBUG oslo_concurrency.lockutils [None req-ea9118e8-d6d0-4b4d-93c1-69781212ca92 admin admin] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 12:56:10.990494 dv-cinder-784477-10-iscsi devstack@n-api.service[101658]: DEBUG oslo_concurrency.lockutils [None req-ea9118e8-d6d0-4b4d-93c1-69781212ca92 admin admin] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 12:56:11.014745 dv-cinder-784477-10-iscsi devstack@n-api.service[101658]: INFO nova.api.openstack.requestlog [None req-ea9118e8-d6d0-4b4d-93c1-69781212ca92 admin admin] 10.222.0.49 "GET /compute/v2.1/os-services" status: 200 len: 1014 microversion: 2.90 time: 0.081053 Dec 14 12:56:11.015310 dv-cinder-784477-10-iscsi devstack@n-api.service[101658]: [pid: 101658|app: 0|req: 37/73] 10.222.0.49 () {60 vars in 1193 bytes} [Tue Dec 14 12:56:10 2021] GET /compute/v2.1/os-services => generated 1014 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 14 12:56:22.952841 dv-cinder-784477-10-iscsi devstack@n-api.service[101659]: DEBUG nova.api.openstack.wsgi [None req-8a5d6872-f352-42d5-865a-f5d38dc5f786 admin admin] Calling method '>' {{(pid=101659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 12:56:22.954209 dv-cinder-784477-10-iscsi devstack@n-api.service[101659]: INFO nova.api.openstack.requestlog [None req-8a5d6872-f352-42d5-865a-f5d38dc5f786 admin admin] 10.222.0.49 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001900 Dec 14 12:56:22.954691 dv-cinder-784477-10-iscsi devstack@n-api.service[101659]: [pid: 101659|app: 0|req: 37/74] 10.222.0.49 () {56 vars in 1074 bytes} [Tue Dec 14 12:56:22 2021] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 14 12:56:23.167051 dv-cinder-784477-10-iscsi devstack@n-api.service[101658]: DEBUG nova.api.openstack.wsgi [None req-c235512e-51e7-44c6-b1f5-02a28213b7f5 admin admin] Calling method '>' {{(pid=101658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 12:56:23.168201 dv-cinder-784477-10-iscsi devstack@n-api.service[101658]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-services:list": "rule:system_reader_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 14 12:56:23.168201 dv-cinder-784477-10-iscsi devstack@n-api.service[101658]: warnings.warn(msg) Dec 14 12:56:23.169772 dv-cinder-784477-10-iscsi devstack@n-api.service[101658]: DEBUG oslo_concurrency.lockutils [None req-c235512e-51e7-44c6-b1f5-02a28213b7f5 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 12:56:23.170194 dv-cinder-784477-10-iscsi devstack@n-api.service[101658]: DEBUG oslo_concurrency.lockutils [None req-c235512e-51e7-44c6-b1f5-02a28213b7f5 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 12:56:23.170969 dv-cinder-784477-10-iscsi devstack@n-api.service[101658]: DEBUG oslo_concurrency.lockutils [None req-c235512e-51e7-44c6-b1f5-02a28213b7f5 admin admin] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 12:56:23.171386 dv-cinder-784477-10-iscsi devstack@n-api.service[101658]: DEBUG oslo_concurrency.lockutils [None req-c235512e-51e7-44c6-b1f5-02a28213b7f5 admin admin] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 12:56:23.192311 dv-cinder-784477-10-iscsi devstack@n-api.service[101658]: INFO nova.api.openstack.requestlog [None req-c235512e-51e7-44c6-b1f5-02a28213b7f5 admin admin] 10.222.0.49 "GET /compute/v2.1/os-services" status: 200 len: 1038 microversion: 2.90 time: 0.089897 Dec 14 12:56:23.192865 dv-cinder-784477-10-iscsi devstack@n-api.service[101658]: [pid: 101658|app: 0|req: 38/75] 10.222.0.49 () {60 vars in 1193 bytes} [Tue Dec 14 12:56:23 2021] GET /compute/v2.1/os-services => generated 1038 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 14 12:56:24.660028 dv-cinder-784477-10-iscsi devstack@n-api.service[101659]: DEBUG nova.api.openstack.wsgi [None req-8a5d6872-f352-42d5-865a-f5d38dc5f786 admin admin] Calling method '>' {{(pid=101659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 12:56:24.661246 dv-cinder-784477-10-iscsi devstack@n-api.service[101659]: INFO nova.api.openstack.requestlog [None req-8a5d6872-f352-42d5-865a-f5d38dc5f786 admin admin] 10.222.0.49 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001662 Dec 14 12:56:24.661668 dv-cinder-784477-10-iscsi devstack@n-api.service[101659]: [pid: 101659|app: 0|req: 38/76] 10.222.0.49 () {56 vars in 1074 bytes} [Tue Dec 14 12:56:24 2021] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 14 12:56:24.873080 dv-cinder-784477-10-iscsi devstack@n-api.service[101658]: DEBUG nova.api.openstack.wsgi [None req-163486bf-71fc-4286-aa4d-e640c9ffeea1 admin admin] Calling method '>' {{(pid=101658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 12:56:24.874258 dv-cinder-784477-10-iscsi devstack@n-api.service[101658]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-services:list": "rule:system_reader_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 14 12:56:24.874258 dv-cinder-784477-10-iscsi devstack@n-api.service[101658]: warnings.warn(msg) Dec 14 12:56:24.875778 dv-cinder-784477-10-iscsi devstack@n-api.service[101658]: DEBUG oslo_concurrency.lockutils [None req-163486bf-71fc-4286-aa4d-e640c9ffeea1 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 12:56:24.876224 dv-cinder-784477-10-iscsi devstack@n-api.service[101658]: DEBUG oslo_concurrency.lockutils [None req-163486bf-71fc-4286-aa4d-e640c9ffeea1 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 12:56:24.877069 dv-cinder-784477-10-iscsi devstack@n-api.service[101658]: DEBUG oslo_concurrency.lockutils [None req-163486bf-71fc-4286-aa4d-e640c9ffeea1 admin admin] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 12:56:24.877486 dv-cinder-784477-10-iscsi devstack@n-api.service[101658]: DEBUG oslo_concurrency.lockutils [None req-163486bf-71fc-4286-aa4d-e640c9ffeea1 admin admin] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 12:56:24.898262 dv-cinder-784477-10-iscsi devstack@n-api.service[101658]: INFO nova.api.openstack.requestlog [None req-163486bf-71fc-4286-aa4d-e640c9ffeea1 admin admin] 10.222.0.49 "GET /compute/v2.1/os-services" status: 200 len: 1038 microversion: 2.90 time: 0.086215 Dec 14 12:56:24.898816 dv-cinder-784477-10-iscsi devstack@n-api.service[101658]: [pid: 101658|app: 0|req: 39/77] 10.222.0.49 () {60 vars in 1193 bytes} [Tue Dec 14 12:56:24 2021] GET /compute/v2.1/os-services => generated 1038 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 14 12:57:22.706425 dv-cinder-784477-10-iscsi systemd[1]: Stopping Devstack devstack@n-api.service... Dec 14 12:57:22.707094 dv-cinder-784477-10-iscsi devstack@n-api.service[101657]: Tue Dec 14 12:57:22 2021 - graceful shutdown triggered... Dec 14 12:57:22.707546 dv-cinder-784477-10-iscsi devstack@n-api.service[101658]: Gracefully killing worker 1 (pid: 101658)... Dec 14 12:57:22.707944 dv-cinder-784477-10-iscsi devstack@n-api.service[101659]: Gracefully killing worker 2 (pid: 101659)... Dec 14 12:57:23.708091 dv-cinder-784477-10-iscsi devstack@n-api.service[101657]: worker 1 buried after 1 seconds Dec 14 12:57:23.708091 dv-cinder-784477-10-iscsi devstack@n-api.service[101657]: worker 2 buried after 1 seconds Dec 14 12:57:23.708091 dv-cinder-784477-10-iscsi devstack@n-api.service[101657]: goodbye to uWSGI. Dec 14 12:57:23.710519 dv-cinder-784477-10-iscsi systemd[1]: devstack@n-api.service: Succeeded. Dec 14 12:57:23.711398 dv-cinder-784477-10-iscsi systemd[1]: Stopped Devstack devstack@n-api.service. Dec 14 12:57:23.715784 dv-cinder-784477-10-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Dec 14 12:57:23.730124 dv-cinder-784477-10-iscsi devstack@n-api.service[116051]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Dec 14 12:57:23.732615 dv-cinder-784477-10-iscsi devstack@n-api.service[116051]: *** Starting uWSGI 2.0.18-debian (64bit) on [Tue Dec 14 12:57:23 2021] *** Dec 14 12:57:23.732615 dv-cinder-784477-10-iscsi devstack@n-api.service[116051]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Dec 14 12:57:23.732615 dv-cinder-784477-10-iscsi devstack@n-api.service[116051]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Dec 14 12:57:23.732615 dv-cinder-784477-10-iscsi devstack@n-api.service[116051]: nodename: dv-cinder-784477-10-iscsi Dec 14 12:57:23.732615 dv-cinder-784477-10-iscsi devstack@n-api.service[116051]: machine: x86_64 Dec 14 12:57:23.732615 dv-cinder-784477-10-iscsi devstack@n-api.service[116051]: clock source: unix Dec 14 12:57:23.733276 dv-cinder-784477-10-iscsi devstack@n-api.service[116051]: pcre jit disabled Dec 14 12:57:23.733276 dv-cinder-784477-10-iscsi devstack@n-api.service[116051]: detected number of CPU cores: 4 Dec 14 12:57:23.733276 dv-cinder-784477-10-iscsi devstack@n-api.service[116051]: current working directory: / Dec 14 12:57:23.733276 dv-cinder-784477-10-iscsi devstack@n-api.service[116051]: detected binary path: /usr/bin/uwsgi-core Dec 14 12:57:23.733276 dv-cinder-784477-10-iscsi devstack@n-api.service[116051]: your processes number limit is 47680 Dec 14 12:57:23.733276 dv-cinder-784477-10-iscsi devstack@n-api.service[116051]: your memory page size is 4096 bytes Dec 14 12:57:23.733276 dv-cinder-784477-10-iscsi devstack@n-api.service[116051]: detected max file descriptor number: 2048 Dec 14 12:57:23.733276 dv-cinder-784477-10-iscsi devstack@n-api.service[116051]: lock engine: pthread robust mutexes Dec 14 12:57:23.733276 dv-cinder-784477-10-iscsi devstack@n-api.service[116051]: thunder lock: enabled Dec 14 12:57:23.733276 dv-cinder-784477-10-iscsi devstack@n-api.service[116051]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Dec 14 12:57:23.734254 dv-cinder-784477-10-iscsi devstack@n-api.service[116051]: Python version: 3.8.10 (default, Sep 28 2021, 16:10:42) [GCC 9.3.0] Dec 14 12:57:23.781184 dv-cinder-784477-10-iscsi devstack@n-api.service[116051]: Python main interpreter initialized at 0x55e1f40189c0 Dec 14 12:57:23.781184 dv-cinder-784477-10-iscsi devstack@n-api.service[116051]: python threads support enabled Dec 14 12:57:23.781184 dv-cinder-784477-10-iscsi devstack@n-api.service[116051]: your server socket listen backlog is limited to 100 connections Dec 14 12:57:23.781184 dv-cinder-784477-10-iscsi devstack@n-api.service[116051]: your mercy for graceful operations on workers is 90 seconds Dec 14 12:57:23.781615 dv-cinder-784477-10-iscsi devstack@n-api.service[116051]: mapped 403077 bytes (393 KB) for 2 cores Dec 14 12:57:23.781615 dv-cinder-784477-10-iscsi devstack@n-api.service[116051]: *** Operational MODE: preforking *** Dec 14 12:57:23.781918 dv-cinder-784477-10-iscsi devstack@n-api.service[116051]: *** uWSGI is running in multiple interpreter mode *** Dec 14 12:57:23.781918 dv-cinder-784477-10-iscsi devstack@n-api.service[116051]: spawned uWSGI master process (pid: 116051) Dec 14 12:57:23.782139 dv-cinder-784477-10-iscsi systemd[1]: Started Devstack devstack@n-api.service. Dec 14 12:57:23.786850 dv-cinder-784477-10-iscsi devstack@n-api.service[116051]: spawned uWSGI worker 1 (pid: 116063, cores: 1) Dec 14 12:57:23.786850 dv-cinder-784477-10-iscsi devstack@n-api.service[116051]: spawned uWSGI worker 2 (pid: 116064, cores: 1) Dec 14 12:57:23.786850 dv-cinder-784477-10-iscsi devstack@n-api.service[116051]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Dec 14 12:57:25.642649 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Dec 14 12:57:25.642649 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: from cryptography.utils import int_from_bytes Dec 14 12:57:25.643339 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Dec 14 12:57:25.643339 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: from cryptography.utils import int_from_bytes Dec 14 12:57:25.647482 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Dec 14 12:57:25.647482 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: from cryptography.utils import int_from_bytes Dec 14 12:57:25.648011 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Dec 14 12:57:25.648011 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: from cryptography.utils import int_from_bytes Dec 14 12:57:28.005893 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=116063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Dec 14 12:57:28.006546 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=116063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Dec 14 12:57:28.006639 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=116063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Dec 14 12:57:28.006956 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=116063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Dec 14 12:57:28.007212 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=116063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Dec 14 12:57:28.007600 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=116063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 12:57:28.007957 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=116063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 12:57:28.008279 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=116063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 12:57:28.008571 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=116063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 12:57:28.008994 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=116063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 12:57:28.009261 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=116063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 12:57:28.009579 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=116063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 12:57:28.009901 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=116063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 12:57:28.010262 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=116063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 12:57:28.010483 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=116063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 12:57:28.010826 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=116063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 12:57:28.011151 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-784477-10-iscsi {{(pid=116063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 12:57:28.011472 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=116063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 12:57:28.011808 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=116063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 12:57:28.012120 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=116063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 12:57:28.012436 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=116063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 12:57:28.012738 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=116063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 12:57:28.013079 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=116063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 12:57:28.013378 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=116063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 12:57:28.013881 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=116063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 12:57:28.015331 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=116063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 12:57:28.015331 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=116063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 12:57:28.015331 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=116063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 12:57:28.015331 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=116063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 12:57:28.015654 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=116063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 12:57:28.015891 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=116063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 12:57:28.016133 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=116063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 12:57:28.016459 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=116063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 12:57:28.016785 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=116063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 12:57:28.017100 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=116063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 12:57:28.017508 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-784477-10-iscsi {{(pid=116063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 12:57:28.017825 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=116063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 12:57:28.018164 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=116063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 12:57:28.018457 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=116063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 12:57:28.018871 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=116063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 12:57:28.019210 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=116063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 12:57:28.019501 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=116063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 12:57:28.019811 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=116063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 12:57:28.020157 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=116063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 12:57:28.020465 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=116063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 12:57:28.020814 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=116063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 12:57:28.021142 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=116063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 12:57:28.021479 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=116063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 12:57:28.021798 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=116063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 12:57:28.022096 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=116063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 12:57:28.022410 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=116063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 12:57:28.022720 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=116063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 12:57:28.023035 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=116063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 12:57:28.023322 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=116063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 12:57:28.023644 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=116063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 12:57:28.023894 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=116063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 12:57:28.024201 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=116063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 12:57:28.024526 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=116063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 12:57:28.024865 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=116063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 12:57:28.025193 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=116063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 12:57:28.025445 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=116063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 12:57:28.025693 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=116063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 12:57:28.026015 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=116063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 12:57:28.026336 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(tenant)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=116063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 12:57:28.026645 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=116063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 12:57:28.026956 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=116063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 12:57:28.027264 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=116063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 12:57:28.027631 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=116063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 12:57:28.027925 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=116063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 12:57:28.028236 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=116063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 12:57:28.028544 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=116063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 12:57:28.028906 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=116063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 12:57:28.029103 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=116064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Dec 14 12:57:28.029623 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=116063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 12:57:28.029782 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=116064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Dec 14 12:57:28.029935 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=116063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 12:57:28.029935 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=116063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 12:57:28.030251 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=116064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Dec 14 12:57:28.030398 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=116063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 12:57:28.030588 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=116064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Dec 14 12:57:28.030767 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=116063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 12:57:28.030923 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=116064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Dec 14 12:57:28.031076 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.49 {{(pid=116063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 12:57:28.031247 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=116064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 12:57:28.031402 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.49 {{(pid=116063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 12:57:28.031572 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=116064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 12:57:28.031733 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=116063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 12:57:28.031886 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=116064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 12:57:28.032035 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=116063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 12:57:28.032194 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=116064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 12:57:28.032346 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=116063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 12:57:28.032497 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=116064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 12:57:28.032976 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=116063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 12:57:28.033135 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=116064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 12:57:28.033287 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=116063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 12:57:28.033436 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=116064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 12:57:28.033580 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=116063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 12:57:28.033973 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=116064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 12:57:28.034132 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=116063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 12:57:28.034287 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=116064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 12:57:28.034523 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=116063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 12:57:28.034672 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=116064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 12:57:28.034861 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=116063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 12:57:28.035022 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=116064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 12:57:28.035175 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=116063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 12:57:28.035318 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-784477-10-iscsi {{(pid=116064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 12:57:28.035471 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=116063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 12:57:28.035619 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=116064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 12:57:28.035772 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=116063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 12:57:28.035932 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=116064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 12:57:28.036075 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=116063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 12:57:28.036224 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=116064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 12:57:28.036377 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=116063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 12:57:28.036518 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=116064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 12:57:28.036671 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=116063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 12:57:28.036836 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=116064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 12:57:28.037040 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=116063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 12:57:28.037040 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=116063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 12:57:28.037325 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=116064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 12:57:28.037473 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=116063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 12:57:28.037640 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=116064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 12:57:28.037915 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=116063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 12:57:28.038085 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=116064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 12:57:28.038249 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=116063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 12:57:28.038401 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=116064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 12:57:28.038585 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=116063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 12:57:28.038812 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=116064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 12:57:28.038984 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=116063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 12:57:28.039205 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=116064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 12:57:28.039359 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=116063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 12:57:28.039359 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=116063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 12:57:28.039647 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=116064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 12:57:28.039789 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=116063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 12:57:28.039940 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=116064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 12:57:28.040089 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=116063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 12:57:28.040231 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=116064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 12:57:28.040385 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=116063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 12:57:28.040679 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=116064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 12:57:28.040834 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=116063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 12:57:28.041022 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=116064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 12:57:28.041164 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=116063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 12:57:28.041318 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=116064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 12:57:28.041591 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=116063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 12:57:28.041743 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=116064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 12:57:28.041895 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=116063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 12:57:28.042050 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-784477-10-iscsi {{(pid=116064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 12:57:28.042193 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=116063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 12:57:28.042351 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=116064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 12:57:28.042493 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=116063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 12:57:28.042640 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=116064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 12:57:28.043036 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=116063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 12:57:28.043193 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=116064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 12:57:28.043357 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=116063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 12:57:28.043357 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=116063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 12:57:28.043634 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=116064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 12:57:28.043802 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=116063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 12:57:28.044203 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=116064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 12:57:28.044916 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=116063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 12:57:28.045036 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=116064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 12:57:28.045116 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=116063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 12:57:28.045195 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=116064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 12:57:28.045282 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=116063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 12:57:28.045355 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=116064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 12:57:28.045431 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=116063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 12:57:28.045501 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=116064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 12:57:28.045570 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=116063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 12:57:28.045639 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=116064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 12:57:28.045716 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=116063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 12:57:28.045795 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=116064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 12:57:28.045888 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=116063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 12:57:28.045978 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=116064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 12:57:28.045978 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=116064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 12:57:28.046131 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=116063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 12:57:28.046231 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=116064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 12:57:28.046314 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=116063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 12:57:28.046403 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=116064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 12:57:28.046480 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=116063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 12:57:28.046567 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=116064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 12:57:28.046657 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=116063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 12:57:28.046738 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=116064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 12:57:28.046815 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=116063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 12:57:28.046904 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=116064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 12:57:28.046990 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=116063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 12:57:28.047081 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=116064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 12:57:28.047170 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=116063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 12:57:28.047263 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=116064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 12:57:28.047347 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=116063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 12:57:28.047435 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=116064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 12:57:28.047512 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=116063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 12:57:28.047593 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=116064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 12:57:28.047682 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=116063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 12:57:28.047767 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=116064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 12:57:28.047857 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=116063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 12:57:28.047939 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=116064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 12:57:28.048033 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=116063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 12:57:28.048123 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=116064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 12:57:28.048222 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=116063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 12:57:28.048311 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=116064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 12:57:28.048469 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=116063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 12:57:28.049027 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=116064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 12:57:28.049363 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=116063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 12:57:28.049545 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(tenant)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=116064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 12:57:28.049695 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=116063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 12:57:28.049839 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=116064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 12:57:28.049988 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=116063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 12:57:28.050139 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=116064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 12:57:28.050289 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=116063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 12:57:28.050443 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=116064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 12:57:28.050587 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=116063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 12:57:28.050816 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=116064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 12:57:28.050969 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=116063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:57:28.051112 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=116064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 12:57:28.051268 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=116063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:57:28.051411 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=116064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 12:57:28.051566 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=116063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:57:28.051709 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=116064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 12:57:28.051862 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=116063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:57:28.052030 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=116064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 12:57:28.052296 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=116063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:57:28.052460 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=116064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 12:57:28.052613 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=116063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:57:28.052756 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=116064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 12:57:28.053229 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=116063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:57:28.053397 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=116064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 12:57:28.053554 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=116063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:57:28.053702 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=116064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 12:57:28.053862 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=116063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:57:28.054025 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=116064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 12:57:28.054434 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=116063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:57:28.054592 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.49 {{(pid=116064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 12:57:28.054749 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=116063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:57:28.054893 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.49 {{(pid=116064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 12:57:28.055042 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=116063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:57:28.055200 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=116064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 12:57:28.055353 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=116063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:57:28.055504 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=116064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 12:57:28.055656 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=116063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:57:28.055806 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=116064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 12:57:28.055949 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=116063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:57:28.056109 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=116064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 12:57:28.056253 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=116063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:57:28.056407 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=116064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 12:57:28.056550 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=116063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:57:28.056692 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=116064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 12:57:28.056842 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=116063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:57:28.057009 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=116064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 12:57:28.057161 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=116063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:57:28.057316 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=116064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 12:57:28.057472 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=116063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:57:28.057623 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=116064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 12:57:28.057774 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=116063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:57:28.057916 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=116064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 12:57:28.058068 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=116063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:57:28.058225 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=116064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 12:57:28.058375 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=116063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:57:28.058518 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=116064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 12:57:28.058711 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=116063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:57:28.058866 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=116064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 12:57:28.059027 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=116063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:57:28.059170 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=116064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 12:57:28.059465 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=116063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:57:28.059626 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=116064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 12:57:28.059782 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=116063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:57:28.059933 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=116064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 12:57:28.060097 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=116063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:57:28.060246 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=116064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 12:57:28.060389 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=116063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:57:28.060530 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=116064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 12:57:28.060671 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=116063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:57:28.060838 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=116064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 12:57:28.061093 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=116063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:57:28.061248 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=116064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 12:57:28.061399 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=116063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:57:28.061548 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=116064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 12:57:28.061703 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=116063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:57:28.061846 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=116064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 12:57:28.061997 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=116063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:57:28.062158 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=116064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 12:57:28.062301 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=116063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:57:28.062443 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=116064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 12:57:28.062585 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=116063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:57:28.062734 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=116064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 12:57:28.062734 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=116064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 12:57:28.063042 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=116063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:57:28.063372 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=116064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 12:57:28.063529 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=116063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:57:28.063673 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=116064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 12:57:28.063824 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=116063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:57:28.063967 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=116064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 12:57:28.064110 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=116063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:57:28.064278 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=116064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 12:57:28.064656 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=116063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:57:28.064814 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=116064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 12:57:28.064997 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=116063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:57:28.064997 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=116063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:57:28.065287 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=116064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 12:57:28.065439 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=116063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:57:28.065581 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=116064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 12:57:28.065581 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=116064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 12:57:28.065859 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=116063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:57:28.066001 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=116064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 12:57:28.066215 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=116063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:57:28.066506 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=116064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 12:57:28.066692 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=116063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:57:28.066839 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=116064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 12:57:28.066982 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=116063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:57:28.067131 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=116064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 12:57:28.067283 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=116063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:57:28.067283 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=116063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:57:28.067564 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=116064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 12:57:28.067714 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=116063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:57:28.067864 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=116064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 12:57:28.068007 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=116063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:57:28.068157 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=116064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 12:57:28.068301 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=116063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:57:28.068512 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=116064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 12:57:28.068683 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=116063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:57:28.068827 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=116064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 12:57:28.069047 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=116063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:57:28.069200 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=116064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 12:57:28.069354 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=116063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:57:28.069666 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=116064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 12:57:28.069825 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=116063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:57:28.069976 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=116064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 12:57:28.070126 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=116063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:57:28.070277 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=116064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 12:57:28.070433 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=116063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:57:28.070589 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=116064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 12:57:28.070745 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=116063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:57:28.070888 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=116064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 12:57:28.071038 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=116063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:57:28.071275 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=116064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 12:57:28.071424 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=116063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:57:28.071575 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=116064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 12:57:28.071718 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=116063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:57:28.071869 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=116064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 12:57:28.072019 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=116063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:57:28.072175 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=116064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 12:57:28.072175 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=116064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 12:57:28.072470 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=116063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:57:28.072621 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=116064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 12:57:28.072783 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=116063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:57:28.072960 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=116064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 12:57:28.073114 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=116063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:57:28.073474 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=116064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 12:57:28.073627 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=116063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:57:28.073778 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=116064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 12:57:28.073921 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=116063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:57:28.074062 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=116064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 12:57:28.074212 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=116063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:57:28.074363 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=116064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 12:57:28.074535 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=116063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:57:28.074939 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=116064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 12:57:28.075093 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=116063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:57:28.075266 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=116064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 12:57:28.075413 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=116063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:57:28.075555 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=116064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 12:57:28.075707 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=116063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:57:28.075851 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=116064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:57:28.076001 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=116063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:57:28.076158 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=116064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:57:28.076310 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=116063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:57:28.076461 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=116064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:57:28.076612 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=116063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:57:28.076763 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=116064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:57:28.076992 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=116063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:57:28.076992 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=116063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:57:28.077289 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=116064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:57:28.077441 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=116063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:57:28.077591 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=116064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:57:28.077735 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=116063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:57:28.077886 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=116064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:57:28.078040 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=116063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:57:28.078194 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=116064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:57:28.078345 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=116063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:57:28.078487 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=116064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:57:28.078630 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=116063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:57:28.078786 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=116064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:57:28.078929 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=116063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:57:28.079080 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=116064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:57:28.079236 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=116063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:57:28.079386 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=116064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:57:28.079538 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=116063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:57:28.079842 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=116064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:57:28.079993 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=116063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:57:28.080144 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=116064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:57:28.080296 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=116063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:57:28.080438 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=116064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:57:28.080588 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=116063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:57:28.080740 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=116064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:57:28.080937 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=116063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:57:28.081121 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=116064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:57:28.081304 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=116063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:57:28.081525 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=116064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:57:28.081679 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=116063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:57:28.081836 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=116064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:57:28.081980 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=116063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:57:28.082123 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=116064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:57:28.082272 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=116063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:57:28.082423 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=116064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:57:28.082576 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=116063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:57:28.082727 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=116064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:57:28.082870 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=116063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:57:28.083012 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=116064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:57:28.083160 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=116063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:57:28.083321 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=116064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:57:28.083669 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=116063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:57:28.083826 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=116064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:57:28.083980 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=116063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:57:28.084130 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=116064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:57:28.084279 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=116063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:57:28.084421 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=116064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:57:28.084575 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=116063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:57:28.084745 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=116064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:57:28.085142 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=116063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:57:28.085300 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=116064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:57:28.085444 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=116063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:57:28.085609 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=116064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:57:28.085763 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=116063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:57:28.085763 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=116063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:57:28.086044 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=116064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:57:28.086195 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=116063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:57:28.086346 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=116064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:57:28.086572 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=116063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:57:28.086720 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=116064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:57:28.086869 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=116063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:57:28.087011 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=116064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:57:28.087154 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=116063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:57:28.087296 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=116064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:57:28.087446 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=116063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:57:28.087599 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=116064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:57:28.087749 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=116063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:57:28.087893 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=116064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:57:28.088043 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=116063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:57:28.088189 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=116064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:57:28.088344 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=116063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:57:28.088487 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=116064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:57:28.088637 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=116063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:57:28.088787 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=116064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:57:28.088965 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=116063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:57:28.089110 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=116064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:57:28.089262 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=116063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:57:28.089405 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=116064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:57:28.089558 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=116063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:57:28.089701 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=116064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:57:28.090043 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=116063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:57:28.090212 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=116064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:57:28.090357 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=116063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:57:28.090509 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=116064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:57:28.090651 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=116063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:57:28.090794 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=116064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:57:28.090944 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=116063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:57:28.091096 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=116064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:57:28.091247 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=116063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:57:28.091391 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=116064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:57:28.091550 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=116063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:57:28.091770 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=116064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:57:28.091916 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=116063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:57:28.092069 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=116064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:57:28.092213 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=116063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:57:28.092356 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=116064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:57:28.092499 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=116063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:57:28.092641 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=116064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:57:28.092783 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=116063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:57:28.093056 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=116064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:57:28.093212 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=116063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:57:28.093354 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=116064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:57:28.093506 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=116063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:57:28.093880 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=116064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:57:28.094035 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=116063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:57:28.094179 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=116064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:57:28.094329 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=116063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:57:28.094475 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=116064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:57:28.094624 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=116063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:57:28.094767 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=116064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:57:28.094919 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=116063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:57:28.095323 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=116064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:57:28.095472 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=116063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:57:28.095615 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=116064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:57:28.095767 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=116063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:57:28.095911 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=116064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:57:28.096077 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=116063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:57:28.096229 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=116064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:57:28.096372 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=116063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:57:28.096514 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=116064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:57:28.096667 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=116063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:57:28.096810 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=116064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:57:28.096987 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=116063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:57:28.097132 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=116064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:57:28.097274 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=116063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:57:28.097425 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=116064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:57:28.097568 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=116063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:57:28.097729 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=116064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:57:28.097880 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=116063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:57:28.098052 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=116064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:57:28.098211 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=116063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:57:28.099280 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=116064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:57:28.099439 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=116063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:57:28.099439 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=116063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:57:28.099748 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=116064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:57:28.099899 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=116063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:57:28.100211 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=116064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:57:28.100386 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=116063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:57:28.100546 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=116064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:57:28.100698 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=116063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:57:28.100876 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=116064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:57:28.101056 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=116063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:57:28.101216 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=116064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:57:28.101380 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=116063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:57:28.101538 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=116064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:57:28.101695 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=116063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:57:28.101943 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=116064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:57:28.102100 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=116063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:57:28.102264 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=116064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:57:28.102415 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=116063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:57:28.102565 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=116064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:57:28.102714 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=116063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:57:28.102874 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=116064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:57:28.103024 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=116063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:57:28.103201 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=116064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:57:28.103360 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=116063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:57:28.103510 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=116064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:57:28.103678 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=116063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:57:28.104046 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=116064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:57:28.104198 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=116063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:57:28.104362 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=116064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:57:28.104513 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=116063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:57:28.104669 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=116064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:57:28.104827 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=116063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:57:28.105011 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=116064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:57:28.105181 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=116063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:57:28.105647 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=116064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:57:28.105817 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=116063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:57:28.105969 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=116064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:57:28.106119 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=116063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:57:28.106275 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=116064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:57:28.106440 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=116063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:57:28.106591 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=116064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:57:28.106741 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=116063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:57:28.106899 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=116064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:57:28.107137 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=116063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:57:28.107310 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=116064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:57:28.107472 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=116063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:57:28.107670 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=116064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:57:28.107865 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=116063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:57:28.108025 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=116064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:57:28.108183 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=116063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:57:28.108334 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=116064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:57:28.108492 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=116063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:57:28.108704 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=116064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:57:28.108930 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=116063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:57:28.109088 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=116064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:57:28.109239 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=116063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:57:28.109400 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=116064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:57:28.109565 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=116063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:57:28.109565 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=116063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:57:28.110080 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=116064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:57:28.110426 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=116063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:57:28.110590 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=116064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:57:28.110751 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=116063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:57:28.110916 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=116064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:57:28.111055 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=116063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:57:28.111359 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=116064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:57:28.111500 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=116063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:57:28.111644 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=116064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:57:28.111790 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=116063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:57:28.111933 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=116064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:57:28.112151 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=116063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:57:28.112272 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=116064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:57:28.112448 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=116063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:57:28.112542 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=116064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:57:28.112739 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=116063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:57:28.112890 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=116064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:57:28.112995 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=116063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:57:28.113090 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=116064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:57:28.113090 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=116064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:57:28.113244 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=116063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:57:28.113343 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=116064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:57:28.113438 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=116063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:57:28.113522 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=116064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:57:28.113612 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=116063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:57:28.113696 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=116064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:57:28.113792 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=116063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:57:28.113918 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=116064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:57:28.114172 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=116063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:57:28.114259 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=116064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:57:28.114354 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=116063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:57:28.114445 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=116064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:57:28.114538 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=116063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:57:28.114624 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=116064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:57:28.114706 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=116063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:57:28.114789 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=116064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:57:28.114873 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=116063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:57:28.114956 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=116064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:57:28.115049 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=116063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:57:28.115139 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=116064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:57:28.115227 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=116063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:57:28.115318 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=116064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:57:28.115421 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=116063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:57:28.115507 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=116064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:57:28.115801 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=116063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:57:28.115900 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=116064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:57:28.115995 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=116063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:57:28.116087 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=116064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:57:28.116171 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=116063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:57:28.116264 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=116064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:57:28.116349 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=116063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:57:28.116439 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=116064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:57:28.116531 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=116063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:57:28.116531 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=116063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:57:28.116692 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=116064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:57:28.116783 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=116063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:57:28.116924 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=116064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:57:28.117013 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=116063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:57:28.117096 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=116064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:57:28.117187 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=116063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:57:28.117270 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=116064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:57:28.117362 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=116063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:57:28.117454 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=116064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:57:28.117550 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=116063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:57:28.117640 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=116064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:57:28.117737 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=116063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:57:28.117822 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=116064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:57:28.117905 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=116063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:57:28.117988 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=116064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:57:28.118078 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=116063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:57:28.118169 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=116064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:57:28.118254 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=116063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:57:28.118337 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=116064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:57:28.118427 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=116063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:57:28.118510 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=116064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:57:28.118599 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=116063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:57:28.118691 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=116064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:57:28.118775 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=116063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:57:28.118865 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=116064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:57:28.118955 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=116063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:57:28.119046 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=116064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:57:28.119130 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=116063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:57:28.119289 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=116064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:57:28.119375 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=116063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:57:28.119465 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=116064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:57:28.119548 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=116063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:57:28.119631 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=116064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:57:28.119720 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=116063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:57:28.119812 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=116064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:57:28.119903 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=116063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:57:28.119984 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=116064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:57:28.120054 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=116063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:57:28.120123 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=116064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:57:28.120207 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=116063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:57:28.120278 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=116064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:57:28.120367 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=116063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:57:28.120599 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=116064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:57:28.120687 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=116063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:57:28.120770 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=116064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:57:28.120886 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=116063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:57:28.120973 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=116064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:57:28.121092 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=116063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:57:28.121212 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=116064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:57:28.121304 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=116063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:57:28.121395 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=116064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:57:28.121489 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=116063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:57:28.121574 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=116064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:57:28.121665 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=116063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:57:28.121756 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=116064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:57:28.121847 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=116063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:57:28.121931 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=116064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:57:28.122022 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=116063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:57:28.122022 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=116063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:57:28.122201 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=116064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:57:28.122274 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=116063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:57:28.122363 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=116064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:57:28.122455 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=116063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:57:28.122546 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=116064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:57:28.122629 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=116063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:57:28.122723 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=116064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:57:28.122814 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=116063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:57:28.122898 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=116064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:57:28.122991 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=116063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:57:28.123075 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=116064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:57:28.123158 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=116063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:57:28.123259 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=116064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:57:28.123350 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=116063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:57:28.123434 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=116064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:57:28.123615 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=116063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:57:28.123741 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=116064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:57:28.123925 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=116063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:57:28.124151 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=116064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:57:28.124256 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=116063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:57:28.124376 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=116064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:57:28.124523 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=116063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:57:28.124701 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=116064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:57:28.124832 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=116063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:57:28.125065 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=116064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:57:28.125157 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=116063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:57:28.125384 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=116064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:57:28.125477 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=116063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:57:28.125711 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=116064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:57:28.125821 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=116063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:57:28.126034 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=116064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:57:28.126138 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=116063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:57:28.126332 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=116063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:57:28.126431 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=116064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:57:28.126642 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=116063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:57:28.126741 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=116064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:57:28.126951 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=116063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:57:28.127051 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=116064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:57:28.127257 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=116063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:57:28.127350 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=116064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:57:28.127580 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=116063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:57:28.127673 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=116064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:57:28.127893 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=116063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:57:28.127986 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=116064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:57:28.128200 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=116063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:57:28.128299 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=116064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:57:28.128507 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=116063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:57:28.128598 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=116064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:57:28.128817 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=116063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:57:28.128993 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=116064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:57:28.129151 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=116063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:57:28.129244 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=116064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:57:28.129459 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=116063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:57:28.129683 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=116064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:57:28.129775 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=116063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:57:28.130083 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=116063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:57:28.130268 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=116064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:57:28.130403 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=116063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:57:28.130712 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=116063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:57:28.130824 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=116064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:57:28.131022 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=116063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:57:28.131328 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=116063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:57:28.131419 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=116064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:57:28.131635 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=116063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:57:28.131909 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=116064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:57:28.132000 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=116063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:57:28.132241 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=116063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:57:28.132546 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=116063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:57:28.132869 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=116063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:57:28.133001 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=116064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:57:28.133176 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=116063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:57:28.133483 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=116063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:57:28.133584 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=116064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:57:28.133794 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=116063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:57:28.134146 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=116063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:57:28.134267 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=116064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:57:28.134637 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=116064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:57:28.134750 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=116063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:57:28.134990 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=116063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:57:28.135095 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=116064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:57:28.135315 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=116064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:57:28.135719 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=116064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:57:28.136183 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=116063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:57:28.136386 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=116063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:57:28.136764 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=116063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:57:28.137122 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=116063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:57:28.137485 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=116063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:57:28.137795 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=116063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:57:28.138112 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=116063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:57:28.138436 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=116063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:57:28.138753 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=116063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:57:28.139193 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=116063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:57:28.139376 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=116063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:57:28.139682 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=116063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:57:28.139999 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=116063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:57:28.140312 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=116063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:57:28.140625 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=116063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:57:28.140956 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=116063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:57:28.141265 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=116063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:57:28.141359 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=116064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:57:28.141602 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=116063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:57:28.141814 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=116064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:57:28.141910 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=116063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:57:28.142152 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=116064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:57:28.142236 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=116063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:57:28.142579 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=116063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:57:28.142672 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=116064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:57:28.142866 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=116063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:57:28.142950 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=116064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:57:28.143190 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=116063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:57:28.143387 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=116064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:57:28.143481 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=116063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:57:28.143731 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=116064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:57:28.143830 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=116063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:57:28.144059 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=116064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:57:28.144142 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=116063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:57:28.144425 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=116063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:57:28.144519 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=116064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:57:28.144716 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=116063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:57:28.144837 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=116064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:57:28.145057 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=116063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:57:28.145368 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=116063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:57:28.145459 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=116064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:57:28.145696 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=116063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:57:28.145808 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=116064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:57:28.146012 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=116063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:57:28.146184 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=116064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:57:28.146399 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=116063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:57:28.146658 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=116063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:57:28.146754 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=116064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:57:28.146966 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=116063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:57:28.147068 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=116064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:57:28.147277 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=116063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:57:28.147379 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=116064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:57:28.147588 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=116063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:57:28.147681 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=116064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:57:28.147896 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=116063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:57:28.147987 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=116064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:57:28.148215 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=116064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:57:28.148315 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=116063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:57:28.148523 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=116063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:57:28.148620 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=116064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:57:28.148827 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=116063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:57:28.149012 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=116064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:57:28.149165 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=116063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:57:28.149345 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=116064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:57:28.149473 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=116063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:57:28.149566 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=116064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:57:28.149787 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=116063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:57:28.149880 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=116064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:57:28.150093 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=116063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:57:28.150194 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=116064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:57:28.150438 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=116064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:57:28.150529 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=116063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:57:28.150822 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=116064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:57:28.150948 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=116063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:57:28.151140 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=116063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:57:28.151249 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=116064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:57:28.151445 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=116063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:57:28.151538 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=116064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:57:28.151762 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=116063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:57:28.151868 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=116064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:57:28.152083 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=116063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:57:28.152228 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=116064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:57:28.152455 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=116063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:57:28.152554 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=116064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:57:28.152775 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=116063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:57:28.152890 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=116064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:57:28.153109 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=116063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:57:28.153214 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=116064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:57:28.153429 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=116064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:57:28.153519 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=116063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:57:28.153748 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=116064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:57:28.153850 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=116063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:57:28.154066 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=116064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:57:28.154167 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=116063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:57:28.154376 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=116064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:57:28.154474 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=116063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:57:28.154698 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=116064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:57:28.154816 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=116063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:57:28.155004 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=116063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:57:28.155111 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=116064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:57:28.155316 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=116063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:57:28.155410 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=116064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:57:28.155630 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=116064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:57:28.155741 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=116063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:57:28.155933 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=116063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:57:28.156025 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=116064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:57:28.156239 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=116063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:57:28.156332 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=116064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:57:28.156542 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=116063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:57:28.156650 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=116064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:57:28.156872 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=116064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:57:28.156966 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=116063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:57:28.157188 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=116063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:57:28.157291 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=116064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:57:28.157498 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=116064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:57:28.157601 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=116063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:57:28.157806 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=116064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:57:28.157898 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=116063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:57:28.158121 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=116064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:57:28.158216 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=116063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:57:28.158437 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=116064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:57:28.158531 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=116063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:57:28.158745 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=116064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:57:28.158902 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=116063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:57:28.159059 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=116064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:57:28.159220 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=116063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:57:28.159370 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=116064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:57:28.159534 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=116063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:57:28.159688 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=116064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:57:28.159858 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=116063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:57:28.159995 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=116064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:57:28.160180 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=116063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:57:28.160303 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=116064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:57:28.160505 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=116063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:57:28.160607 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=116064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:57:28.160811 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=116063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:57:28.160956 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=116064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:57:28.161150 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=116063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:57:28.161248 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=116064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:57:28.161461 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=116063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:57:28.161612 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=116064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:57:28.161784 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=116063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:57:28.161873 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=116064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:57:28.162107 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=116063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:57:28.162191 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=116064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:57:28.162418 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=116063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:57:28.162501 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=116064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:57:28.162733 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=116063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:57:28.162825 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=116064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:57:28.163039 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=116063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:57:28.163141 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=116064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:57:28.163345 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=116064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:57:28.163443 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=116063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:57:28.163656 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=116064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:57:28.163748 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=116063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:57:28.163970 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=116063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:57:28.164063 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=116064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:57:28.164291 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=116063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:57:28.164392 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=116064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:57:28.164610 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=116064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:57:28.164709 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=116063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:57:28.164956 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=116064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:57:28.165076 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=116063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:57:28.165270 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=116064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:57:28.165372 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=116063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:57:28.165580 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=116064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:57:28.165683 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=116063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:57:28.165891 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=116064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:57:28.165992 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=116063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:57:28.166258 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=116063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:57:28.166357 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=116064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:57:28.166564 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=116063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:57:28.166686 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=116064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:57:28.166890 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=116063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:57:28.166995 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=116064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:57:28.167197 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=116063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:57:28.167303 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=116064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:57:28.167504 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=116063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:57:28.167601 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=116064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:57:28.167827 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=116063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:57:28.167936 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=116064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:57:28.168171 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=116063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:57:28.168262 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=116064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:57:28.168484 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=116063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:57:28.168576 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=116064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:57:28.168795 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=116063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:57:28.168987 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=116064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:57:28.169137 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=116063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:57:28.169221 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=116064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:57:28.169440 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=116063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:57:28.169524 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=116064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:57:28.169743 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=116063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:57:28.169834 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=116064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:57:28.170062 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=116063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:57:28.170153 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=116064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:57:28.170366 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=116063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:57:28.170450 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=116064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:57:28.170687 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=116063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:57:28.170778 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=116064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:57:28.171002 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=116063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:57:28.171085 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=116064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:57:28.172212 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=116063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:57:28.172317 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=116064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:57:28.172393 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=116063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:57:28.172464 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=116064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:57:28.172535 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=116063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:57:28.172673 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=116064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:57:28.172764 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=116063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:57:28.172880 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=116064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:57:28.174133 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=116063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:57:28.174231 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=116064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:57:28.174306 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=116063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:57:28.174389 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=116064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:57:28.174389 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=116064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:57:28.174533 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=116063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:57:28.174612 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=116064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:57:28.174691 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=116063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:57:28.174770 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=116064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:57:28.174855 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=116063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:57:28.174935 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=116064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:57:28.175027 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=116063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:57:28.175114 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=116064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:57:28.175188 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=116063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:57:28.175265 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=116064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:57:28.175413 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=116063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:57:28.175510 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=116063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:57:28.175594 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=116064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:57:28.175746 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=116063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:57:28.175876 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=116064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:57:28.176085 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=116063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:57:28.176202 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=116064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:57:28.176410 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=116063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:57:28.176502 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=116064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:57:28.176727 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=116063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:57:28.176816 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=116064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:57:28.177060 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=116064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:57:28.177155 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=116063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:57:28.177374 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=116064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:57:28.177468 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=116063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:57:28.177678 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=116063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:57:28.177772 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=116064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:57:28.177983 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=116063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:57:28.178077 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=116064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:57:28.178295 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=116063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:57:28.178398 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=116064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:57:28.178599 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=116063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:57:28.178700 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=116064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:57:28.178902 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=116063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:57:28.178998 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=116064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:57:28.179211 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=116063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:57:28.179313 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=116064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:57:28.179520 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=116063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:57:28.179613 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=116064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:57:28.179821 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=116063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:57:28.179926 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=116064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:57:28.180125 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=116063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:57:28.180218 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=116064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:57:28.180429 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=116063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:57:28.180522 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=116064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:57:28.180737 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=116064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:57:28.180836 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=116063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:57:28.181069 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=116063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:57:28.181161 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=116064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:57:28.181376 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=116064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:57:28.181477 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=116063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:57:28.181687 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=116063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:57:28.181794 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=116064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:57:28.181991 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=116063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:57:28.182084 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=116064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:57:28.182362 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=116064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:57:28.182460 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=116063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:57:28.182667 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=116063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:57:28.183009 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=116063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:57:28.183312 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=116063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:57:28.183700 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=116063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:57:28.183787 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=116064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:57:28.184022 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=116063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:57:28.184342 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=116063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:57:28.184424 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=116064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:57:28.184670 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=116063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:57:28.184768 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=116064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:57:28.185005 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=116063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:57:28.185091 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=116064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:57:28.185334 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=116063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:57:28.185497 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=116064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:57:28.185652 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=116063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:57:28.185866 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=116064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:57:28.185963 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=116063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:57:28.186137 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=116064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:57:28.186272 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=116063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:57:28.186451 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=116064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:57:28.186589 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=116063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:57:28.186770 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=116064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:57:28.186990 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=116063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:57:28.187085 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=116064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:57:28.187222 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=116063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:57:28.187401 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=116064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:57:28.187538 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=116063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:57:28.187725 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=116064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:57:28.187846 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=116063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:57:28.188036 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=116064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:57:28.188162 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=116063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:57:28.188455 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=116064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:57:28.188553 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=116063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:57:28.188775 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=116064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:57:28.189048 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=116063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:57:28.189130 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=116064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:57:28.189376 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=116063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:57:28.189471 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=116064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:57:28.189708 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=116063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:57:28.189813 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=116064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:57:28.190018 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=116064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:57:28.190118 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=116063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:57:28.190331 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=116063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:57:28.190431 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=116064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:57:28.190645 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=116063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:57:28.190746 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=116064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:57:28.190953 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=116064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:57:28.191039 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=116063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:57:28.191261 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=116064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:57:28.191354 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=116063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:57:28.191569 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=116064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:57:28.191672 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=116063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:57:28.191879 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=116063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:57:28.191980 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=116064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:57:28.192191 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=116063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:57:28.192294 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=116064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:57:28.192502 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=116063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:57:28.192596 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=116064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:57:28.192830 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=116063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:57:28.192941 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=116064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:57:28.193175 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=116063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:57:28.193280 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=116064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:57:28.193503 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=116063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:57:28.193597 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=116064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:57:28.193839 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=116063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:57:28.193933 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=116064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:57:28.194155 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=116063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:57:28.194325 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=116064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:57:28.194472 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=116063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:57:28.194567 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=116064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:57:28.194786 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=116063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:57:28.194879 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=116064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:57:28.195102 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=116063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:57:28.195199 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=116064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:57:28.195460 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=116063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:57:28.195553 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=116064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:57:28.195776 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=116064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:57:28.195880 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=116063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:57:28.196101 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=116063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:57:28.196211 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=116064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:57:28.196406 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=116063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:57:28.196652 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=116064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:57:28.196783 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=116063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:57:28.197041 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=116064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:57:28.197143 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=116063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:57:28.197364 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=116064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:57:28.197730 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=116064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:57:28.198153 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=116063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:57:28.198251 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=116064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:57:28.198482 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=116063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:57:28.198589 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=116064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:57:28.198801 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=116063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:57:28.198892 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=116064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:57:28.199141 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=116063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:57:28.199254 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=116064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:57:28.199468 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=116063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:57:28.199561 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=116064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:57:28.199784 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=116063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:57:28.199890 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=116064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:57:28.200100 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=116063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:57:28.200312 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=116064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:57:28.200406 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=116063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:57:28.200639 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=116064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:57:28.200723 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=116063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:57:28.201861 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=116064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:57:28.202051 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=116063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:57:28.202199 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=116064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:57:28.202324 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=116063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:57:28.202439 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=116064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:57:28.202558 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=116063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:57:28.202558 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=116063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:57:28.202826 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=116064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:57:28.203029 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=116063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:57:28.203144 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=116064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:57:28.203263 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=116063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:57:28.203383 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=116064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:57:28.203497 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=116063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:57:28.204137 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=116064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:57:28.204332 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=116063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:57:28.204458 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=116064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:57:28.204591 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=116063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:57:28.204752 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=116064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:57:28.204905 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=116063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:57:28.204905 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=116063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:57:28.205247 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=116064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:57:28.205353 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=116063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:57:28.205440 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=116064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:57:28.205522 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=116063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:57:28.205594 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=116063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:57:28.205804 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=116064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:57:28.205989 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=116063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:57:28.206093 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=116064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:57:28.206377 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=116063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:57:28.206494 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=116064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:57:28.206570 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=116063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:57:28.206805 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=116063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:57:28.206895 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=116064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:57:28.207134 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=116063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:57:28.207502 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=116063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:57:28.207622 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=116064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:57:28.207860 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=116063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:57:28.208638 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=116063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:57:28.208748 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=116064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:57:28.208839 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=116063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:57:28.209390 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=116064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:57:28.209550 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=116063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:57:28.209659 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=116064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:57:28.209789 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=116063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:57:28.209789 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=116063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:57:28.210109 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=116063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:57:28.210440 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=116063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:57:28.210540 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=116064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:57:28.210761 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=116063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:57:28.210856 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=116064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:57:28.211161 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=116063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:57:28.211413 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=116063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:57:28.211728 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=116063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:57:28.211936 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=116064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:57:28.212056 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=116063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:57:28.212397 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=116063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:57:28.212507 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=116064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:57:28.212697 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=116063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:57:28.212882 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=116064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:57:28.213033 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=116063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:57:28.213325 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=116064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:57:28.213430 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=116063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:57:28.213689 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=116063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:57:28.213790 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=116064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:57:28.214017 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=116063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:57:28.214132 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=116064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:57:28.214330 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=116063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:57:28.214493 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=116064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:57:28.214730 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=116063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:57:28.215003 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=116063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:57:28.215321 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=116063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:57:28.215482 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=116064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:57:28.215631 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=116063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:57:28.215826 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=116064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:57:28.215956 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=116063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:57:28.216179 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=116064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:57:28.216345 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=116063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:57:28.216527 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=116064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:57:28.216649 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=116063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:57:28.216840 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=116063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:57:28.216960 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=116064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:57:28.217183 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=116063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:57:28.217296 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=116064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:57:28.217496 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=116063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:57:28.217604 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=116064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:57:28.217806 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=116063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:57:28.217911 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=116064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:57:28.218121 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=116063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:57:28.218232 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=116064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:57:28.218432 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=116063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:57:28.218536 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=116064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:57:28.218746 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=116063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:57:28.218840 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=116064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:57:28.219059 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=116063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:57:28.219177 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=116064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:57:28.219388 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=116063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:57:28.219537 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=116064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:57:28.219679 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=116064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:57:28.219808 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=116063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:57:28.219978 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=116064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:57:28.220083 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=116063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:57:28.220285 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=116063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:57:28.220378 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=116064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:57:28.220602 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=116064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:57:28.220703 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=116063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:57:28.220937 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=116064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:57:28.221048 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=116063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:57:28.221248 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=116063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:57:28.221498 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=116064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:57:28.221609 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=116063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:57:28.221814 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=116064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:57:28.221929 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=116063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:57:28.222140 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=116064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:57:28.222245 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=116063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:57:28.222447 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=116064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:57:28.222553 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=116063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:57:28.222772 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=116064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:57:28.222880 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=116063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:57:28.223085 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=116064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:57:28.223183 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=116063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:57:28.223459 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=116064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:57:28.223733 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=116063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:57:28.223865 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=116064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:57:28.223951 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=116063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:57:28.224026 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=116064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:57:28.224326 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=116063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:57:28.224431 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=116064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:57:28.224647 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=116064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:57:28.224769 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=116063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:57:28.225027 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=116063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:57:28.225192 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=116064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:57:28.225372 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=116063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:57:28.225479 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=116064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:57:28.225683 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=116063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:57:28.225793 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=116064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:57:28.225994 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=116063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:57:28.226088 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=116064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:57:28.226294 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=116063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:57:28.226398 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=116064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:57:28.226627 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=116063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:57:28.226746 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=116064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:57:28.226919 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=116063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:57:28.227262 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=116063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:57:28.227378 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=116064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:57:28.227582 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=116063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:57:28.227693 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=116064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:57:28.227973 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=116063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:57:28.228088 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=116064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:57:28.228287 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=116063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:57:28.228401 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=116064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:57:28.228602 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=116063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:57:28.228736 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=116064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:57:28.228972 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=116063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:57:28.229109 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=116064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:57:28.229247 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=116063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:57:28.229356 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=116064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:57:28.229561 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=116063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:57:28.229763 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=116064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:57:28.229881 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=116063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:57:28.229977 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=116064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:57:28.230203 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=116064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:57:28.230305 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=116063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:57:28.230547 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=116063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:57:28.230689 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=116064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:57:28.230871 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=116063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:57:28.231111 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=116064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:57:28.231206 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=116063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:57:28.231448 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=116064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:57:28.231559 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=116063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:57:28.231771 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=116064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:57:28.231911 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=116063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:57:28.232091 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=116064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:57:28.232187 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=116063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:57:28.232400 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=116063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:57:28.232502 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=116064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:57:28.232711 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=116063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:57:28.232805 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=116064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:57:28.233056 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=116064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:57:28.233160 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=116063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:57:28.233377 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=116064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:57:28.233482 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=116063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:57:28.233696 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=116064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:57:28.233791 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=116063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:57:28.234001 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=116063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:57:28.234135 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=116064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:57:28.234441 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=116063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:57:28.234539 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=116064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:57:28.234756 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=116063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:57:28.234882 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=116064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:57:28.235077 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=116063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:57:28.235197 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=116064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:57:28.236062 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=116063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:57:28.236245 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=116064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:57:28.236428 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=116063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:57:28.236592 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=116064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:57:28.236838 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=116063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:57:28.237036 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=116064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:57:28.237210 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=116063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:57:28.237377 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=116064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:57:28.237543 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=116063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:57:28.237697 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=116064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:57:28.237858 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=116063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:57:28.238041 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=116064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:57:28.238301 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=116063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:57:28.238466 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=116064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:57:28.238645 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=116063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:57:28.238806 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=116064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:57:28.238968 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=116063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:57:28.239196 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=116064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:57:28.239353 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=116063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:57:28.239451 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=116064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:57:28.239548 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=116063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:57:28.239643 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=116064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:57:28.239737 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=116063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:57:28.239833 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=116064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:57:28.239920 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=116063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:57:28.239920 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=116063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:57:28.239920 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=116063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:57:28.240164 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=116063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:57:28.240370 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=116064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:57:28.240499 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=116063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:57:28.240708 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=116064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:57:28.240803 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=116063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:57:28.241076 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=116064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:57:28.241332 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=116063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:57:28.241473 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=116064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:57:28.241674 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=116063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:57:28.241780 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=116064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:57:28.241980 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=116063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:57:28.242416 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=116064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:57:28.242506 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=116063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:57:28.242596 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=116064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:57:28.242677 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=116063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:57:28.242979 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=116064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:57:28.243136 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=116063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:57:28.243218 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=116064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:57:28.243351 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=116063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:57:28.243521 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=116063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:57:28.243625 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=116064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:57:28.243858 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=116063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:57:28.243995 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=116064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:57:28.244170 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=116063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:57:28.244309 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=116064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:57:28.244485 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=116063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:57:28.244618 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=116064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:57:28.244800 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=116063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:57:28.244973 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=116064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:57:28.245141 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=116063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:57:28.245381 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=116064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:57:28.245487 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=116063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:57:28.245705 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=116064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:57:28.245807 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=116063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:57:28.246065 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=116064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:57:28.246210 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=116063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:57:28.246423 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=116064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:57:28.246528 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=116063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:57:28.246727 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=116063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:57:28.246848 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=116064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:57:28.247055 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=116063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:57:28.247229 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=116064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:57:28.247372 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=116064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:57:28.247466 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=116063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:57:28.247690 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=116063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:57:28.247782 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=116064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:57:28.248003 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=116064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:57:28.248105 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=116063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:57:28.248317 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=116063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:57:28.248438 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=116064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:57:28.248649 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=116064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:57:28.248746 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=116063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:57:28.248991 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=116064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:57:28.249123 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=116063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:57:28.249271 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=116064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:57:28.249379 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=116063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:57:28.249585 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=116063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:57:28.249691 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=116064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:57:28.249900 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=116063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:57:28.250038 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=116064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:57:28.250206 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=116064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:57:28.250309 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=116063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:57:28.250523 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=116063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:57:28.250627 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=116064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:57:28.250837 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=116064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:57:28.250931 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=116063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:57:28.251163 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=116063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:57:28.251376 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=116064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:57:28.251474 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=116063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:57:28.251739 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=116064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:57:28.251843 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=116063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:57:28.252065 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=116064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:57:28.252170 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=116063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:57:28.252402 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=116064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:57:28.252495 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=116063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:57:28.252735 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=116064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:57:28.252843 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=116063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:57:28.253083 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=116064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:57:28.253191 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=116063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:57:28.253401 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=116064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:57:28.253497 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=116063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:57:28.253728 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=116063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:57:28.253822 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=116064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:57:28.254036 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=116063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:57:28.254141 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=116064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:57:28.254282 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=116063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Dec 14 12:57:28.254897 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=116064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:57:28.255250 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=116064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:57:28.255571 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=116064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:57:28.255888 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=116064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:57:28.256201 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=116064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:57:28.256521 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=116064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:57:28.256839 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=116064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:57:28.257175 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=116064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:57:28.257490 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=116064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:57:28.257800 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=116064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:57:28.258135 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=116064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:57:28.258454 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=116064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:57:28.258766 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=116064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:57:28.259076 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=116064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:57:28.259395 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=116064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:57:28.259714 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=116064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:57:28.260015 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=116064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:57:28.260330 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=116064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:57:28.260637 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=116064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:57:28.261124 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=116064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:57:28.261447 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=116064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:57:28.261860 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=116064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:57:28.262211 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=116064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:57:28.262724 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=116064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:57:28.263292 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=116064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:57:28.263614 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=116064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:57:28.263936 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=116064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:57:28.264586 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=116064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:57:28.264938 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=116064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:57:28.265256 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=116064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:57:28.266260 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=116064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:57:28.266260 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=116064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:57:28.266260 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=116064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:57:28.266555 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=116064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:57:28.266821 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=116064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:57:28.267186 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=116064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:57:28.267497 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=116064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:57:28.268054 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=116064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:57:28.268436 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=116064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:57:28.268762 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=116064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:57:28.269158 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=116064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:57:28.269505 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=116064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:57:28.269820 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=116064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:57:28.270133 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=116064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:57:28.270443 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=116064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:57:28.270770 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=116064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:57:28.271085 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=116064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:57:28.271415 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=116064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:57:28.271714 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=116064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:57:28.272031 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=116064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:57:28.272347 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=116064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:57:28.272662 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=116064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:57:28.273072 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=116064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:57:28.273392 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=116064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:57:28.273706 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=116064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:57:28.274024 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=116064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:57:28.274367 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=116064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:57:28.274693 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=116064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:57:28.275017 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=116064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:57:28.275337 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=116064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:57:28.275659 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=116064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:57:28.275974 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=116064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:57:28.276288 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=116064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:57:28.276607 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=116064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:57:28.276960 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=116064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:57:28.277328 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=116064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:57:28.277878 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=116064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:57:28.278200 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=116064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:57:28.278516 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=116064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:57:28.278955 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=116064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:57:28.279275 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=116064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:57:28.279598 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=116064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:57:28.279924 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=116064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:57:28.280239 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=116064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:57:28.280561 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=116064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:57:28.280916 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=116064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:57:28.281238 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=116064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:57:28.281564 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=116064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:57:28.281878 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=116064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:57:28.282210 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=116064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:57:28.282553 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=116064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:57:28.282884 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=116064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:57:28.283213 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=116064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:57:28.283523 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=116064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:57:28.283832 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=116064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:57:28.284139 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=116064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:57:28.284451 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=116064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:57:28.284782 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=116064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:57:28.285159 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=116064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:57:28.286051 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=116064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:57:28.286051 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=116064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:57:28.286242 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=116064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:57:28.286414 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=116064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:57:28.286725 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=116064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:57:28.287226 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=116064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:57:28.287570 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=116064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:57:28.287879 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=116064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:57:28.288195 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=116064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:57:28.288531 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=116064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:57:28.288891 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=116064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:57:28.290718 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=116064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:57:28.290718 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=116064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:57:28.290718 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=116064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:57:28.290718 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=116064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:57:28.290718 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=116064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:57:28.291180 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_db.sqlalchemy.engines [None req-47569d32-db09-4e87-a45e-3f6db2aab091 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=116063) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Dec 14 12:57:28.291275 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=116064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:57:28.291275 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=116064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:57:28.291435 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=116064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:57:28.292270 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=116064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:57:28.292270 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=116064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:57:28.292270 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=116064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:57:28.292585 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=116064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:57:28.292902 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=116064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:57:28.293486 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=116064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:57:28.293809 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=116064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:57:28.294132 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=116064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:57:28.294449 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=116064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:57:28.295270 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=116064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:57:28.295270 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=116064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:57:28.295455 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=116064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:57:28.295702 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=116064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:57:28.296030 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=116064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:57:28.296360 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=116064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:57:28.296691 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=116064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:57:28.297068 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=116064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:57:28.297385 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=116064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:57:28.297738 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=116064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:57:28.298067 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=116064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:57:28.298380 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=116064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:57:28.299006 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=116064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:57:28.299316 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=116064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 12:57:28.299560 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=116064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Dec 14 12:57:28.322406 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_db.sqlalchemy.engines [None req-251bf018-5230-4adf-a72a-75ea35038894 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=116064) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Dec 14 12:57:28.358941 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.context [None req-47569d32-db09-4e87-a45e-3f6db2aab091 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),c72c70dc-282a-4dd4-bee2-2334d6bc15ce(cell1) {{(pid=116063) load_cells /opt/stack/nova/nova/context.py:464}} Dec 14 12:57:28.363239 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-47569d32-db09-4e87-a45e-3f6db2aab091 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 12:57:28.364865 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-47569d32-db09-4e87-a45e-3f6db2aab091 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 12:57:28.365708 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-47569d32-db09-4e87-a45e-3f6db2aab091 None None] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 12:57:28.367680 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-47569d32-db09-4e87-a45e-3f6db2aab091 None None] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 12:57:28.381658 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_db.sqlalchemy.engines [None req-47569d32-db09-4e87-a45e-3f6db2aab091 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=116063) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Dec 14 12:57:28.382968 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_db.sqlalchemy.engines [None req-47569d32-db09-4e87-a45e-3f6db2aab091 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=116063) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Dec 14 12:57:28.394564 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.context [None req-251bf018-5230-4adf-a72a-75ea35038894 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),c72c70dc-282a-4dd4-bee2-2334d6bc15ce(cell1) {{(pid=116064) load_cells /opt/stack/nova/nova/context.py:464}} Dec 14 12:57:28.399288 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-251bf018-5230-4adf-a72a-75ea35038894 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 12:57:28.401163 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-251bf018-5230-4adf-a72a-75ea35038894 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 12:57:28.402306 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-251bf018-5230-4adf-a72a-75ea35038894 None None] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 12:57:28.404397 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-251bf018-5230-4adf-a72a-75ea35038894 None None] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 12:57:28.417364 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_db.sqlalchemy.engines [None req-251bf018-5230-4adf-a72a-75ea35038894 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=116064) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Dec 14 12:57:28.425604 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_db.sqlalchemy.engines [None req-251bf018-5230-4adf-a72a-75ea35038894 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=116064) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Dec 14 12:57:28.548480 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_db.sqlalchemy.engines [None req-47569d32-db09-4e87-a45e-3f6db2aab091 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=116063) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Dec 14 12:57:28.584657 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_db.sqlalchemy.engines [None req-251bf018-5230-4adf-a72a-75ea35038894 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=116064) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Dec 14 12:57:28.866908 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: WARNING keystonemiddleware.auth_token [None req-47569d32-db09-4e87-a45e-3f6db2aab091 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Dec 14 12:57:28.873946 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: WARNING keystonemiddleware.auth_token [None req-47569d32-db09-4e87-a45e-3f6db2aab091 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Dec 14 12:57:28.899732 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: WARNING keystonemiddleware.auth_token [None req-251bf018-5230-4adf-a72a-75ea35038894 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Dec 14 12:57:28.906288 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: WARNING keystonemiddleware.auth_token [None req-251bf018-5230-4adf-a72a-75ea35038894 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Dec 14 12:57:29.218719 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: WARNING keystonemiddleware.auth_token [None req-47569d32-db09-4e87-a45e-3f6db2aab091 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Dec 14 12:57:29.223928 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: WARNING keystonemiddleware.auth_token [None req-47569d32-db09-4e87-a45e-3f6db2aab091 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Dec 14 12:57:29.229442 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55e1f40189c0 pid: 116063 (default app) Dec 14 12:57:29.242520 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: WARNING keystonemiddleware.auth_token [None req-251bf018-5230-4adf-a72a-75ea35038894 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Dec 14 12:57:29.247730 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: WARNING keystonemiddleware.auth_token [None req-251bf018-5230-4adf-a72a-75ea35038894 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Dec 14 12:57:29.253199 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55e1f40189c0 pid: 116064 (default app) Dec 14 12:58:03.247623 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.api.openstack.wsgi [None req-63a07015-2f81-4110-9a21-cc038a3c1b67 tempest-VolumesGetTestJSON-603457841 tempest-VolumesGetTestJSON-603457841-project] Action: 'create', calling method: .version_select at 0x7f2acfa15e50>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesGetTestJSON-Volume-1560148633", "metadata": {"Type": "work"}}} {{(pid=116064) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 14 12:58:03.460497 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.api.openstack.wsgi [None req-57357638-6d6b-4ee3-a7c2-e3c38ef6a387 tempest-VolumesSnapshotsTestJSON-319198890 tempest-VolumesSnapshotsTestJSON-319198890-project] Action: 'create', calling method: .version_select at 0x7f2acfa15e50>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesSnapshotsTestJSON-volume-780041038"}} {{(pid=116063) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 14 12:58:04.790352 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: INFO nova.api.openstack.requestlog [None req-63a07015-2f81-4110-9a21-cc038a3c1b67 tempest-VolumesGetTestJSON-603457841 tempest-VolumesGetTestJSON-603457841-project] 10.222.0.49 "POST /compute/v2.1/os-volumes" status: 200 len: 353 microversion: 2.1 time: 2.619955 Dec 14 12:58:04.792109 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: [pid: 116064|app: 0|req: 1/1] 10.222.0.49 () {60 vars in 1155 bytes} [Tue Dec 14 12:58:02 2021] POST /compute/v2.1/os-volumes => generated 353 bytes in 2624 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Dec 14 12:58:04.916665 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.api.openstack.wsgi [None req-c7b36dc8-300c-46a4-927c-cc0ebdab1da4 tempest-DeleteServersTestJSON-1329684180 tempest-DeleteServersTestJSON-1329684180-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-646878813", "imageRef": "1733dcd4-5ded-44e1-8b8d-392adb05c67a", "flavorRef": "452", "networks": [{"uuid": "76a5a2e8-21c1-464a-bc3c-89f463700b17"}]}} {{(pid=116064) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 14 12:58:04.958392 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: INFO nova.api.openstack.requestlog [None req-57357638-6d6b-4ee3-a7c2-e3c38ef6a387 tempest-VolumesSnapshotsTestJSON-319198890 tempest-VolumesSnapshotsTestJSON-319198890-project] 10.222.0.49 "POST /compute/v2.1/os-volumes" status: 200 len: 344 microversion: 2.1 time: 3.005003 Dec 14 12:58:04.964073 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: [pid: 116063|app: 0|req: 1/2] 10.222.0.49 () {60 vars in 1154 bytes} [Tue Dec 14 12:58:01 2021] POST /compute/v2.1/os-volumes => generated 344 bytes in 3014 msecs (HTTP/1.1 200) 10 headers in 448 bytes (2 switches on core 0) Dec 14 12:58:04.978503 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.api.openstack.wsgi [None req-dd0c559f-2679-4fd5-aad7-6f722c45f0c5 tempest-VolumesGetTestJSON-603457841 tempest-VolumesGetTestJSON-603457841-project] Calling method '.version_select at 0x7f2acf8e99d0>' {{(pid=116063) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 12:58:05.129002 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.network.neutron [None req-c7b36dc8-300c-46a4-927c-cc0ebdab1da4 tempest-DeleteServersTestJSON-1329684180 tempest-DeleteServersTestJSON-1329684180-project] validate_networks() for [('76a5a2e8-21c1-464a-bc3c-89f463700b17', None, None, None, None, None)] {{(pid=116064) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Dec 14 12:58:05.203439 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: INFO nova.api.openstack.requestlog [None req-dd0c559f-2679-4fd5-aad7-6f722c45f0c5 tempest-VolumesGetTestJSON-603457841 tempest-VolumesGetTestJSON-603457841-project] 10.222.0.49 "GET /compute/v2.1/os-volumes/60c349fe-be86-4e12-885f-397cb3072269" status: 200 len: 353 microversion: 2.1 time: 0.228951 Dec 14 12:58:05.204299 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: [pid: 116063|app: 0|req: 2/3] 10.222.0.49 () {58 vars in 1244 bytes} [Tue Dec 14 12:58:04 2021] GET /compute/v2.1/os-volumes/60c349fe-be86-4e12-885f-397cb3072269 => generated 353 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 14 12:58:05.209799 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.api.openstack.wsgi [None req-4ae439b6-5e09-4557-a19a-e3f7336c21ff tempest-VolumesSnapshotsTestJSON-319198890 tempest-VolumesSnapshotsTestJSON-319198890-project] Calling method '.version_select at 0x7f2acf8e9d30>' {{(pid=116063) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 12:58:05.302207 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: INFO nova.api.openstack.requestlog [None req-4ae439b6-5e09-4557-a19a-e3f7336c21ff tempest-VolumesSnapshotsTestJSON-319198890 tempest-VolumesSnapshotsTestJSON-319198890-project] 10.222.0.49 "GET /compute/v2.1/os-volumes/54b79b0a-dce6-439d-9c62-d3826a3a11b6" status: 200 len: 344 microversion: 2.1 time: 0.096567 Dec 14 12:58:05.307952 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: [pid: 116063|app: 0|req: 3/4] 10.222.0.49 () {58 vars in 1244 bytes} [Tue Dec 14 12:58:05 2021] GET /compute/v2.1/os-volumes/54b79b0a-dce6-439d-9c62-d3826a3a11b6 => generated 344 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 14 12:58:05.412285 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.api.openstack.wsgi [None req-d2a45371-7934-4617-871f-1ea4c5989be9 tempest-AttachVolumeNegativeTest-1000400951 tempest-AttachVolumeNegativeTest-1000400951-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1927036245", "imageRef": "1733dcd4-5ded-44e1-8b8d-392adb05c67a", "flavorRef": "452", "networks": [{"uuid": "f9d231ae-628f-4043-969c-cf414631d868"}]}} {{(pid=116063) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 14 12:58:05.583299 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.network.neutron [None req-d2a45371-7934-4617-871f-1ea4c5989be9 tempest-AttachVolumeNegativeTest-1000400951 tempest-AttachVolumeNegativeTest-1000400951-project] validate_networks() for [('f9d231ae-628f-4043-969c-cf414631d868', None, None, None, None, None)] {{(pid=116063) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Dec 14 12:58:06.278072 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.virt.hardware [None req-c7b36dc8-300c-46a4-927c-cc0ebdab1da4 tempest-DeleteServersTestJSON-1329684180 tempest-DeleteServersTestJSON-1329684180-project] Flavor limits 0:0:0 {{(pid=116064) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Dec 14 12:58:06.279725 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.virt.hardware [None req-c7b36dc8-300c-46a4-927c-cc0ebdab1da4 tempest-DeleteServersTestJSON-1329684180 tempest-DeleteServersTestJSON-1329684180-project] Image limits 0:0:0 {{(pid=116064) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Dec 14 12:58:06.279725 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.virt.hardware [None req-c7b36dc8-300c-46a4-927c-cc0ebdab1da4 tempest-DeleteServersTestJSON-1329684180 tempest-DeleteServersTestJSON-1329684180-project] Flavor pref 0:0:0 {{(pid=116064) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Dec 14 12:58:06.279725 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.virt.hardware [None req-c7b36dc8-300c-46a4-927c-cc0ebdab1da4 tempest-DeleteServersTestJSON-1329684180 tempest-DeleteServersTestJSON-1329684180-project] Image pref 0:0:0 {{(pid=116064) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Dec 14 12:58:06.279725 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.virt.hardware [None req-c7b36dc8-300c-46a4-927c-cc0ebdab1da4 tempest-DeleteServersTestJSON-1329684180 tempest-DeleteServersTestJSON-1329684180-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=116064) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Dec 14 12:58:06.306112 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-c7b36dc8-300c-46a4-927c-cc0ebdab1da4 tempest-DeleteServersTestJSON-1329684180 tempest-DeleteServersTestJSON-1329684180-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 12:58:06.306442 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-c7b36dc8-300c-46a4-927c-cc0ebdab1da4 tempest-DeleteServersTestJSON-1329684180 tempest-DeleteServersTestJSON-1329684180-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 12:58:06.307432 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-c7b36dc8-300c-46a4-927c-cc0ebdab1da4 tempest-DeleteServersTestJSON-1329684180 tempest-DeleteServersTestJSON-1329684180-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 12:58:06.308179 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-c7b36dc8-300c-46a4-927c-cc0ebdab1da4 tempest-DeleteServersTestJSON-1329684180 tempest-DeleteServersTestJSON-1329684180-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 12:58:06.387389 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.quota [None req-c7b36dc8-300c-46a4-927c-cc0ebdab1da4 tempest-DeleteServersTestJSON-1329684180 tempest-DeleteServersTestJSON-1329684180-project] Getting quotas for project cb24e38ec8e34dd9a93459b7ff9ba97a. Resources: {'cores', 'instances', 'ram'} {{(pid=116064) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 14 12:58:06.407760 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.quota [None req-c7b36dc8-300c-46a4-927c-cc0ebdab1da4 tempest-DeleteServersTestJSON-1329684180 tempest-DeleteServersTestJSON-1329684180-project] Getting quotas for user 3f4dc5a1bdfc4430b8fa39a5eec81f33 and project cb24e38ec8e34dd9a93459b7ff9ba97a. Resources: {'cores', 'instances', 'ram'} {{(pid=116064) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 14 12:58:06.436561 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.compute.api [None req-c7b36dc8-300c-46a4-927c-cc0ebdab1da4 tempest-DeleteServersTestJSON-1329684180 tempest-DeleteServersTestJSON-1329684180-project] Going to run 1 instances... {{(pid=116064) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Dec 14 12:58:06.440357 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.compute.api [None req-c7b36dc8-300c-46a4-927c-cc0ebdab1da4 tempest-DeleteServersTestJSON-1329684180 tempest-DeleteServersTestJSON-1329684180-project] [instance: 0632db38-ebd1-43c1-8ab9-04fbb19edfa7] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='1733dcd4-5ded-44e1-8b8d-392adb05c67a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=116064) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Dec 14 12:58:06.513378 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.virt.hardware [None req-d2a45371-7934-4617-871f-1ea4c5989be9 tempest-AttachVolumeNegativeTest-1000400951 tempest-AttachVolumeNegativeTest-1000400951-project] Flavor limits 0:0:0 {{(pid=116063) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Dec 14 12:58:06.515724 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.virt.hardware [None req-d2a45371-7934-4617-871f-1ea4c5989be9 tempest-AttachVolumeNegativeTest-1000400951 tempest-AttachVolumeNegativeTest-1000400951-project] Image limits 0:0:0 {{(pid=116063) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Dec 14 12:58:06.516504 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.virt.hardware [None req-d2a45371-7934-4617-871f-1ea4c5989be9 tempest-AttachVolumeNegativeTest-1000400951 tempest-AttachVolumeNegativeTest-1000400951-project] Flavor pref 0:0:0 {{(pid=116063) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Dec 14 12:58:06.517138 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.virt.hardware [None req-d2a45371-7934-4617-871f-1ea4c5989be9 tempest-AttachVolumeNegativeTest-1000400951 tempest-AttachVolumeNegativeTest-1000400951-project] Image pref 0:0:0 {{(pid=116063) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Dec 14 12:58:06.517750 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.virt.hardware [None req-d2a45371-7934-4617-871f-1ea4c5989be9 tempest-AttachVolumeNegativeTest-1000400951 tempest-AttachVolumeNegativeTest-1000400951-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=116063) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Dec 14 12:58:06.620650 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-d2a45371-7934-4617-871f-1ea4c5989be9 tempest-AttachVolumeNegativeTest-1000400951 tempest-AttachVolumeNegativeTest-1000400951-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 12:58:06.620650 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-d2a45371-7934-4617-871f-1ea4c5989be9 tempest-AttachVolumeNegativeTest-1000400951 tempest-AttachVolumeNegativeTest-1000400951-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 12:58:06.620650 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-d2a45371-7934-4617-871f-1ea4c5989be9 tempest-AttachVolumeNegativeTest-1000400951 tempest-AttachVolumeNegativeTest-1000400951-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 12:58:06.620650 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-d2a45371-7934-4617-871f-1ea4c5989be9 tempest-AttachVolumeNegativeTest-1000400951 tempest-AttachVolumeNegativeTest-1000400951-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 12:58:06.625006 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.quota [None req-d2a45371-7934-4617-871f-1ea4c5989be9 tempest-AttachVolumeNegativeTest-1000400951 tempest-AttachVolumeNegativeTest-1000400951-project] Getting quotas for project ad27b8951cae4eeeafa257f45217653a. Resources: {'cores', 'instances', 'ram'} {{(pid=116063) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 14 12:58:06.628054 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.quota [None req-d2a45371-7934-4617-871f-1ea4c5989be9 tempest-AttachVolumeNegativeTest-1000400951 tempest-AttachVolumeNegativeTest-1000400951-project] Getting quotas for user 57d0ec01f0784c8ea87d339980bed3cf and project ad27b8951cae4eeeafa257f45217653a. Resources: {'cores', 'instances', 'ram'} {{(pid=116063) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 14 12:58:06.637504 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: INFO nova.api.openstack.requestlog [None req-c7b36dc8-300c-46a4-927c-cc0ebdab1da4 tempest-DeleteServersTestJSON-1329684180 tempest-DeleteServersTestJSON-1329684180-project] 10.222.0.49 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.843784 Dec 14 12:58:06.638144 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: [pid: 116064|app: 0|req: 2/5] 10.222.0.49 () {60 vars in 1146 bytes} [Tue Dec 14 12:58:04 2021] POST /compute/v2.1/servers => generated 380 bytes in 1845 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Dec 14 12:58:06.649104 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.api.openstack.wsgi [None req-99e368aa-e4a1-420f-a51b-ba4d6870238a tempest-VolumesGetTestJSON-603457841 tempest-VolumesGetTestJSON-603457841-project] Calling method '.version_select at 0x7f2acf7fc700>' {{(pid=116064) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 12:58:06.707019 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.compute.api [None req-d2a45371-7934-4617-871f-1ea4c5989be9 tempest-AttachVolumeNegativeTest-1000400951 tempest-AttachVolumeNegativeTest-1000400951-project] Going to run 1 instances... {{(pid=116063) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Dec 14 12:58:06.713158 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.compute.api [None req-d2a45371-7934-4617-871f-1ea4c5989be9 tempest-AttachVolumeNegativeTest-1000400951 tempest-AttachVolumeNegativeTest-1000400951-project] [instance: 824eca5b-954f-402d-aa22-14f24ddd77ba] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='1733dcd4-5ded-44e1-8b8d-392adb05c67a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=116063) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Dec 14 12:58:06.801269 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: INFO nova.api.openstack.requestlog [None req-99e368aa-e4a1-420f-a51b-ba4d6870238a tempest-VolumesGetTestJSON-603457841 tempest-VolumesGetTestJSON-603457841-project] 10.222.0.49 "GET /compute/v2.1/os-volumes/60c349fe-be86-4e12-885f-397cb3072269" status: 200 len: 354 microversion: 2.1 time: 0.161530 Dec 14 12:58:06.801847 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: [pid: 116064|app: 0|req: 3/6] 10.222.0.49 () {58 vars in 1244 bytes} [Tue Dec 14 12:58:06 2021] GET /compute/v2.1/os-volumes/60c349fe-be86-4e12-885f-397cb3072269 => generated 354 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 14 12:58:06.811730 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.api.openstack.wsgi [None req-daff6a49-05d8-4ff2-a8dd-4951d7b3d5a6 tempest-VolumesSnapshotsTestJSON-319198890 tempest-VolumesSnapshotsTestJSON-319198890-project] Calling method '.version_select at 0x7f2acef96310>' {{(pid=116064) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 12:58:06.963851 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: INFO nova.api.openstack.requestlog [None req-d2a45371-7934-4617-871f-1ea4c5989be9 tempest-AttachVolumeNegativeTest-1000400951 tempest-AttachVolumeNegativeTest-1000400951-project] 10.222.0.49 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.653705 Dec 14 12:58:06.964525 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: [pid: 116063|app: 0|req: 4/7] 10.222.0.49 () {60 vars in 1146 bytes} [Tue Dec 14 12:58:05 2021] POST /compute/v2.1/servers => generated 380 bytes in 1656 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Dec 14 12:58:06.984009 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: INFO nova.api.openstack.requestlog [None req-daff6a49-05d8-4ff2-a8dd-4951d7b3d5a6 tempest-VolumesSnapshotsTestJSON-319198890 tempest-VolumesSnapshotsTestJSON-319198890-project] 10.222.0.49 "GET /compute/v2.1/os-volumes/54b79b0a-dce6-439d-9c62-d3826a3a11b6" status: 200 len: 345 microversion: 2.1 time: 0.180873 Dec 14 12:58:06.984635 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: [pid: 116064|app: 0|req: 4/8] 10.222.0.49 () {58 vars in 1244 bytes} [Tue Dec 14 12:58:06 2021] GET /compute/v2.1/os-volumes/54b79b0a-dce6-439d-9c62-d3826a3a11b6 => generated 345 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 14 12:58:06.991032 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.api.openstack.wsgi [None req-27a0500e-70c2-4089-9256-e77197a29d3d tempest-VolumesGetTestJSON-603457841 tempest-VolumesGetTestJSON-603457841-project] Calling method '.version_select at 0x7f2acf7fcf70>' {{(pid=116064) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 12:58:06.994727 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.api.openstack.wsgi [None req-ab1e3c4c-3ae8-4e34-937b-f48444c43386 tempest-DeleteServersTestJSON-1329684180 tempest-DeleteServersTestJSON-1329684180-project] Calling method '>' {{(pid=116063) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 12:58:06.995425 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.compute.api [None req-ab1e3c4c-3ae8-4e34-937b-f48444c43386 tempest-DeleteServersTestJSON-1329684180 tempest-DeleteServersTestJSON-1329684180-project] [instance: 0632db38-ebd1-43c1-8ab9-04fbb19edfa7] Fetching instance by UUID {{(pid=116063) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 12:58:07.094266 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: INFO nova.api.openstack.requestlog [None req-27a0500e-70c2-4089-9256-e77197a29d3d tempest-VolumesGetTestJSON-603457841 tempest-VolumesGetTestJSON-603457841-project] 10.222.0.49 "GET /compute/v2.1/os-volumes/60c349fe-be86-4e12-885f-397cb3072269" status: 200 len: 354 microversion: 2.1 time: 0.107788 Dec 14 12:58:07.094865 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: [pid: 116064|app: 0|req: 5/9] 10.222.0.49 () {58 vars in 1244 bytes} [Tue Dec 14 12:58:06 2021] GET /compute/v2.1/os-volumes/60c349fe-be86-4e12-885f-397cb3072269 => generated 354 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 14 12:58:07.110488 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.api.openstack.wsgi [None req-d341d7d9-e46d-440d-baa5-7f8dbe0f664b tempest-AttachVolumeNegativeTest-1000400951 tempest-AttachVolumeNegativeTest-1000400951-project] Calling method '>' {{(pid=116064) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 12:58:07.111108 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.compute.api [None req-d341d7d9-e46d-440d-baa5-7f8dbe0f664b tempest-AttachVolumeNegativeTest-1000400951 tempest-AttachVolumeNegativeTest-1000400951-project] [instance: 824eca5b-954f-402d-aa22-14f24ddd77ba] Fetching instance by UUID {{(pid=116064) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 12:58:07.299304 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.policy [None req-ab1e3c4c-3ae8-4e34-937b-f48444c43386 tempest-DeleteServersTestJSON-1329684180 tempest-DeleteServersTestJSON-1329684180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f4dc5a1bdfc4430b8fa39a5eec81f33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb24e38ec8e34dd9a93459b7ff9ba97a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116063) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 12:58:07.347875 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: INFO nova.api.openstack.requestlog [None req-ab1e3c4c-3ae8-4e34-937b-f48444c43386 tempest-DeleteServersTestJSON-1329684180 tempest-DeleteServersTestJSON-1329684180-project] 10.222.0.49 "GET /compute/v2.1/servers/0632db38-ebd1-43c1-8ab9-04fbb19edfa7" status: 200 len: 1214 microversion: 2.1 time: 0.376582 Dec 14 12:58:07.352584 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: [pid: 116063|app: 0|req: 5/10] 10.222.0.49 () {58 vars in 1235 bytes} [Tue Dec 14 12:58:06 2021] GET /compute/v2.1/servers/0632db38-ebd1-43c1-8ab9-04fbb19edfa7 => generated 1214 bytes in 387 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 14 12:58:07.355392 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.policy [None req-d341d7d9-e46d-440d-baa5-7f8dbe0f664b tempest-AttachVolumeNegativeTest-1000400951 tempest-AttachVolumeNegativeTest-1000400951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57d0ec01f0784c8ea87d339980bed3cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad27b8951cae4eeeafa257f45217653a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116064) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 12:58:07.369132 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.api.openstack.wsgi [None req-45a553a0-528b-423d-8a05-09ce5d4a2620 tempest-VolumesSnapshotsTestJSON-319198890 tempest-VolumesSnapshotsTestJSON-319198890-project] Action: 'create', calling method: .version_select at 0x7f2acefa8160>, body: {"snapshot": {"volume_id": "54b79b0a-dce6-439d-9c62-d3826a3a11b6", "display_name": "tempest-VolumesSnapshotsTestJSON-Snapshot-1671284047"}} {{(pid=116063) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 14 12:58:07.387695 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: INFO nova.api.openstack.requestlog [None req-d341d7d9-e46d-440d-baa5-7f8dbe0f664b tempest-AttachVolumeNegativeTest-1000400951 tempest-AttachVolumeNegativeTest-1000400951-project] 10.222.0.49 "GET /compute/v2.1/servers/824eca5b-954f-402d-aa22-14f24ddd77ba" status: 200 len: 1218 microversion: 2.1 time: 0.289414 Dec 14 12:58:07.392744 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: [pid: 116064|app: 0|req: 6/11] 10.222.0.49 () {58 vars in 1235 bytes} [Tue Dec 14 12:58:07 2021] GET /compute/v2.1/servers/824eca5b-954f-402d-aa22-14f24ddd77ba => generated 1218 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 14 12:58:07.407899 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.api.openstack.wsgi [None req-9a8db54a-e562-4c19-a5cf-ae3f7340136c tempest-VolumesGetTestJSON-603457841 tempest-VolumesGetTestJSON-603457841-project] Calling method '.version_select at 0x7f2acef96c10>' {{(pid=116064) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 12:58:07.803258 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: INFO nova.api.openstack.requestlog [None req-9a8db54a-e562-4c19-a5cf-ae3f7340136c tempest-VolumesGetTestJSON-603457841 tempest-VolumesGetTestJSON-603457841-project] 10.222.0.49 "DELETE /compute/v2.1/os-volumes/60c349fe-be86-4e12-885f-397cb3072269" status: 202 len: 0 microversion: 2.1 time: 0.409354 Dec 14 12:58:07.804512 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: [pid: 116064|app: 0|req: 7/12] 10.222.0.49 () {58 vars in 1247 bytes} [Tue Dec 14 12:58:07 2021] DELETE /compute/v2.1/os-volumes/60c349fe-be86-4e12-885f-397cb3072269 => generated 0 bytes in 411 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Dec 14 12:58:07.820537 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.api.openstack.wsgi [None req-41005c1c-7022-4d03-950a-de4a9dfed655 tempest-VolumesGetTestJSON-603457841 tempest-VolumesGetTestJSON-603457841-project] Calling method '.version_select at 0x7f2acef96160>' {{(pid=116064) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 12:58:07.917446 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: INFO nova.api.openstack.requestlog [None req-45a553a0-528b-423d-8a05-09ce5d4a2620 tempest-VolumesSnapshotsTestJSON-319198890 tempest-VolumesSnapshotsTestJSON-319198890-project] 10.222.0.49 "POST /compute/v2.1/os-snapshots" status: 200 len: 287 microversion: 2.1 time: 0.559368 Dec 14 12:58:07.918077 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: [pid: 116063|app: 0|req: 6/13] 10.222.0.49 () {60 vars in 1161 bytes} [Tue Dec 14 12:58:07 2021] POST /compute/v2.1/os-snapshots => generated 287 bytes in 561 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 14 12:58:07.929019 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.api.openstack.wsgi [None req-ae5b78ac-172c-4fa5-bbf8-935a2d0ef56d tempest-VolumesSnapshotsTestJSON-319198890 tempest-VolumesSnapshotsTestJSON-319198890-project] Calling method '.version_select at 0x7f2acefa8550>' {{(pid=116063) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 12:58:08.058010 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: INFO nova.api.openstack.requestlog [None req-41005c1c-7022-4d03-950a-de4a9dfed655 tempest-VolumesGetTestJSON-603457841 tempest-VolumesGetTestJSON-603457841-project] 10.222.0.49 "GET /compute/v2.1/os-volumes/60c349fe-be86-4e12-885f-397cb3072269" status: 200 len: 353 microversion: 2.1 time: 0.249335 Dec 14 12:58:08.058972 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: [pid: 116064|app: 0|req: 8/14] 10.222.0.49 () {58 vars in 1244 bytes} [Tue Dec 14 12:58:07 2021] GET /compute/v2.1/os-volumes/60c349fe-be86-4e12-885f-397cb3072269 => generated 353 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 14 12:58:08.104928 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: INFO nova.api.openstack.requestlog [None req-ae5b78ac-172c-4fa5-bbf8-935a2d0ef56d tempest-VolumesSnapshotsTestJSON-319198890 tempest-VolumesSnapshotsTestJSON-319198890-project] 10.222.0.49 "GET /compute/v2.1/os-snapshots/48c8f9fb-26e0-41d8-b7c3-79f6017b2171" status: 200 len: 287 microversion: 2.1 time: 0.179651 Dec 14 12:58:08.105522 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: [pid: 116063|app: 0|req: 7/15] 10.222.0.49 () {58 vars in 1250 bytes} [Tue Dec 14 12:58:07 2021] GET /compute/v2.1/os-snapshots/48c8f9fb-26e0-41d8-b7c3-79f6017b2171 => generated 287 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Dec 14 12:58:08.117343 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.api.openstack.wsgi [None req-1d08717b-a0f7-48c0-af9a-17ffd2e74d19 tempest-VolumesSnapshotsTestJSON-319198890 tempest-VolumesSnapshotsTestJSON-319198890-project] Calling method '.version_select at 0x7f2acefb2e50>' {{(pid=116064) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 12:58:08.211059 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: INFO nova.api.openstack.requestlog [None req-1d08717b-a0f7-48c0-af9a-17ffd2e74d19 tempest-VolumesSnapshotsTestJSON-319198890 tempest-VolumesSnapshotsTestJSON-319198890-project] 10.222.0.49 "GET /compute/v2.1/os-snapshots" status: 200 len: 290 microversion: 2.1 time: 0.097861 Dec 14 12:58:08.211933 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: [pid: 116064|app: 0|req: 9/16] 10.222.0.49 () {58 vars in 1139 bytes} [Tue Dec 14 12:58:08 2021] GET /compute/v2.1/os-snapshots => generated 290 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 14 12:58:08.225108 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.api.openstack.wsgi [None req-e249daf6-0491-441b-b5ec-72a513c0f372 tempest-VolumesSnapshotsTestJSON-319198890 tempest-VolumesSnapshotsTestJSON-319198890-project] Calling method '.version_select at 0x7f2acef811f0>' {{(pid=116063) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 12:58:08.302785 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: INFO nova.api.openstack.requestlog [None req-e249daf6-0491-441b-b5ec-72a513c0f372 tempest-VolumesSnapshotsTestJSON-319198890 tempest-VolumesSnapshotsTestJSON-319198890-project] 10.222.0.49 "GET /compute/v2.1/os-snapshots/48c8f9fb-26e0-41d8-b7c3-79f6017b2171" status: 200 len: 287 microversion: 2.1 time: 0.082727 Dec 14 12:58:08.303406 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: [pid: 116063|app: 0|req: 8/17] 10.222.0.49 () {58 vars in 1250 bytes} [Tue Dec 14 12:58:08 2021] GET /compute/v2.1/os-snapshots/48c8f9fb-26e0-41d8-b7c3-79f6017b2171 => generated 287 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 14 12:58:08.379714 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.api.openstack.wsgi [None req-b5e9fb26-34cf-4005-b8fe-b63616754a5f tempest-DeleteServersTestJSON-1329684180 tempest-DeleteServersTestJSON-1329684180-project] Calling method '>' {{(pid=116064) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 12:58:08.379714 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.compute.api [None req-b5e9fb26-34cf-4005-b8fe-b63616754a5f tempest-DeleteServersTestJSON-1329684180 tempest-DeleteServersTestJSON-1329684180-project] [instance: 0632db38-ebd1-43c1-8ab9-04fbb19edfa7] Fetching instance by UUID {{(pid=116064) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 12:58:08.407624 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.api.openstack.wsgi [None req-88b959de-b01f-4368-add4-795612ed8d09 tempest-AttachVolumeNegativeTest-1000400951 tempest-AttachVolumeNegativeTest-1000400951-project] Calling method '>' {{(pid=116063) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 12:58:08.408237 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.compute.api [None req-88b959de-b01f-4368-add4-795612ed8d09 tempest-AttachVolumeNegativeTest-1000400951 tempest-AttachVolumeNegativeTest-1000400951-project] [instance: 824eca5b-954f-402d-aa22-14f24ddd77ba] Fetching instance by UUID {{(pid=116063) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 12:58:08.599985 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.policy [None req-88b959de-b01f-4368-add4-795612ed8d09 tempest-AttachVolumeNegativeTest-1000400951 tempest-AttachVolumeNegativeTest-1000400951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57d0ec01f0784c8ea87d339980bed3cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad27b8951cae4eeeafa257f45217653a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116063) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 12:58:08.611361 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: INFO nova.api.openstack.requestlog [None req-88b959de-b01f-4368-add4-795612ed8d09 tempest-AttachVolumeNegativeTest-1000400951 tempest-AttachVolumeNegativeTest-1000400951-project] 10.222.0.49 "GET /compute/v2.1/servers/824eca5b-954f-402d-aa22-14f24ddd77ba" status: 200 len: 1218 microversion: 2.1 time: 0.207412 Dec 14 12:58:08.622026 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: [pid: 116063|app: 0|req: 9/18] 10.222.0.49 () {58 vars in 1235 bytes} [Tue Dec 14 12:58:08 2021] GET /compute/v2.1/servers/824eca5b-954f-402d-aa22-14f24ddd77ba => generated 1218 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 14 12:58:08.672438 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.policy [None req-b5e9fb26-34cf-4005-b8fe-b63616754a5f tempest-DeleteServersTestJSON-1329684180 tempest-DeleteServersTestJSON-1329684180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f4dc5a1bdfc4430b8fa39a5eec81f33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb24e38ec8e34dd9a93459b7ff9ba97a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116064) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 12:58:08.686300 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: INFO nova.api.openstack.requestlog [None req-b5e9fb26-34cf-4005-b8fe-b63616754a5f tempest-DeleteServersTestJSON-1329684180 tempest-DeleteServersTestJSON-1329684180-project] 10.222.0.49 "GET /compute/v2.1/servers/0632db38-ebd1-43c1-8ab9-04fbb19edfa7" status: 200 len: 1214 microversion: 2.1 time: 0.320768 Dec 14 12:58:08.721329 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: [pid: 116064|app: 0|req: 10/19] 10.222.0.49 () {58 vars in 1235 bytes} [Tue Dec 14 12:58:08 2021] GET /compute/v2.1/servers/0632db38-ebd1-43c1-8ab9-04fbb19edfa7 => generated 1214 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 14 12:58:09.070842 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.api.openstack.wsgi [None req-df87ff01-6441-4c23-a366-1af50455853c tempest-VolumesGetTestJSON-603457841 tempest-VolumesGetTestJSON-603457841-project] Calling method '.version_select at 0x7f2ad0267670>' {{(pid=116063) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 12:58:09.153154 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: INFO nova.api.openstack.wsgi [None req-df87ff01-6441-4c23-a366-1af50455853c tempest-VolumesGetTestJSON-603457841 tempest-VolumesGetTestJSON-603457841-project] HTTP exception thrown: Volume 60c349fe-be86-4e12-885f-397cb3072269 could not be found. Dec 14 12:58:09.154333 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.api.openstack.wsgi [None req-df87ff01-6441-4c23-a366-1af50455853c tempest-VolumesGetTestJSON-603457841 tempest-VolumesGetTestJSON-603457841-project] Returning 404 to user: Volume 60c349fe-be86-4e12-885f-397cb3072269 could not be found. {{(pid=116063) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 14 12:58:09.155473 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: INFO nova.api.openstack.requestlog [None req-df87ff01-6441-4c23-a366-1af50455853c tempest-VolumesGetTestJSON-603457841 tempest-VolumesGetTestJSON-603457841-project] 10.222.0.49 "GET /compute/v2.1/os-volumes/60c349fe-be86-4e12-885f-397cb3072269" status: 404 len: 109 microversion: 2.1 time: 0.089369 Dec 14 12:58:09.156751 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: [pid: 116063|app: 0|req: 10/20] 10.222.0.49 () {58 vars in 1244 bytes} [Tue Dec 14 12:58:09 2021] GET /compute/v2.1/os-volumes/60c349fe-be86-4e12-885f-397cb3072269 => generated 109 bytes in 91 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Dec 14 12:58:09.314765 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.api.openstack.wsgi [None req-28b4a0dd-2a90-43ea-8414-7621d4ba2214 tempest-VolumesSnapshotsTestJSON-319198890 tempest-VolumesSnapshotsTestJSON-319198890-project] Calling method '.version_select at 0x7f2ace73f3a0>' {{(pid=116064) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 12:58:09.363979 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: INFO nova.api.openstack.requestlog [None req-28b4a0dd-2a90-43ea-8414-7621d4ba2214 tempest-VolumesSnapshotsTestJSON-319198890 tempest-VolumesSnapshotsTestJSON-319198890-project] 10.222.0.49 "GET /compute/v2.1/os-snapshots/48c8f9fb-26e0-41d8-b7c3-79f6017b2171" status: 200 len: 287 microversion: 2.1 time: 0.052708 Dec 14 12:58:09.368154 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: [pid: 116064|app: 0|req: 11/21] 10.222.0.49 () {58 vars in 1250 bytes} [Tue Dec 14 12:58:09 2021] GET /compute/v2.1/os-snapshots/48c8f9fb-26e0-41d8-b7c3-79f6017b2171 => generated 287 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 14 12:58:09.638513 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.api.openstack.wsgi [None req-dd32686f-ef88-4eb2-a42c-1b88da4daf83 tempest-AttachVolumeNegativeTest-1000400951 tempest-AttachVolumeNegativeTest-1000400951-project] Calling method '>' {{(pid=116063) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 12:58:09.639438 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.compute.api [None req-dd32686f-ef88-4eb2-a42c-1b88da4daf83 tempest-AttachVolumeNegativeTest-1000400951 tempest-AttachVolumeNegativeTest-1000400951-project] [instance: 824eca5b-954f-402d-aa22-14f24ddd77ba] Fetching instance by UUID {{(pid=116063) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 12:58:09.668583 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-dd32686f-ef88-4eb2-a42c-1b88da4daf83 tempest-AttachVolumeNegativeTest-1000400951 tempest-AttachVolumeNegativeTest-1000400951-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 12:58:09.671003 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-dd32686f-ef88-4eb2-a42c-1b88da4daf83 tempest-AttachVolumeNegativeTest-1000400951 tempest-AttachVolumeNegativeTest-1000400951-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 12:58:09.674231 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-dd32686f-ef88-4eb2-a42c-1b88da4daf83 tempest-AttachVolumeNegativeTest-1000400951 tempest-AttachVolumeNegativeTest-1000400951-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 12:58:09.676534 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-dd32686f-ef88-4eb2-a42c-1b88da4daf83 tempest-AttachVolumeNegativeTest-1000400951 tempest-AttachVolumeNegativeTest-1000400951-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 12:58:09.709791 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.api.openstack.wsgi [None req-5dab3339-8a32-4cee-9be2-b8dd2f587d89 tempest-DeleteServersTestJSON-1329684180 tempest-DeleteServersTestJSON-1329684180-project] Calling method '>' {{(pid=116064) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 12:58:09.711035 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.compute.api [None req-5dab3339-8a32-4cee-9be2-b8dd2f587d89 tempest-DeleteServersTestJSON-1329684180 tempest-DeleteServersTestJSON-1329684180-project] [instance: 0632db38-ebd1-43c1-8ab9-04fbb19edfa7] Fetching instance by UUID {{(pid=116064) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 12:58:09.737841 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-5dab3339-8a32-4cee-9be2-b8dd2f587d89 tempest-DeleteServersTestJSON-1329684180 tempest-DeleteServersTestJSON-1329684180-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 12:58:09.738326 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-5dab3339-8a32-4cee-9be2-b8dd2f587d89 tempest-DeleteServersTestJSON-1329684180 tempest-DeleteServersTestJSON-1329684180-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 12:58:09.744357 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-5dab3339-8a32-4cee-9be2-b8dd2f587d89 tempest-DeleteServersTestJSON-1329684180 tempest-DeleteServersTestJSON-1329684180-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 12:58:09.744897 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-5dab3339-8a32-4cee-9be2-b8dd2f587d89 tempest-DeleteServersTestJSON-1329684180 tempest-DeleteServersTestJSON-1329684180-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 12:58:10.136204 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.policy [None req-dd32686f-ef88-4eb2-a42c-1b88da4daf83 tempest-AttachVolumeNegativeTest-1000400951 tempest-AttachVolumeNegativeTest-1000400951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57d0ec01f0784c8ea87d339980bed3cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad27b8951cae4eeeafa257f45217653a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116063) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 12:58:10.152042 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: INFO nova.api.openstack.requestlog [None req-dd32686f-ef88-4eb2-a42c-1b88da4daf83 tempest-AttachVolumeNegativeTest-1000400951 tempest-AttachVolumeNegativeTest-1000400951-project] 10.222.0.49 "GET /compute/v2.1/servers/824eca5b-954f-402d-aa22-14f24ddd77ba" status: 200 len: 1222 microversion: 2.1 time: 0.520783 Dec 14 12:58:10.163083 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: [pid: 116063|app: 0|req: 11/22] 10.222.0.49 () {58 vars in 1235 bytes} [Tue Dec 14 12:58:09 2021] GET /compute/v2.1/servers/824eca5b-954f-402d-aa22-14f24ddd77ba => generated 1222 bytes in 532 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 14 12:58:10.175977 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.policy [None req-5dab3339-8a32-4cee-9be2-b8dd2f587d89 tempest-DeleteServersTestJSON-1329684180 tempest-DeleteServersTestJSON-1329684180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f4dc5a1bdfc4430b8fa39a5eec81f33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb24e38ec8e34dd9a93459b7ff9ba97a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116064) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 12:58:10.196055 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: INFO nova.api.openstack.requestlog [None req-5dab3339-8a32-4cee-9be2-b8dd2f587d89 tempest-DeleteServersTestJSON-1329684180 tempest-DeleteServersTestJSON-1329684180-project] 10.222.0.49 "GET /compute/v2.1/servers/0632db38-ebd1-43c1-8ab9-04fbb19edfa7" status: 200 len: 1218 microversion: 2.1 time: 0.488551 Dec 14 12:58:10.197864 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: [pid: 116064|app: 0|req: 12/23] 10.222.0.49 () {58 vars in 1235 bytes} [Tue Dec 14 12:58:09 2021] GET /compute/v2.1/servers/0632db38-ebd1-43c1-8ab9-04fbb19edfa7 => generated 1218 bytes in 492 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 14 12:58:10.376293 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.api.openstack.wsgi [None req-0814ee0f-a7da-482c-be97-c8fec15843ab tempest-VolumesSnapshotsTestJSON-319198890 tempest-VolumesSnapshotsTestJSON-319198890-project] Calling method '.version_select at 0x7f2ace73aa60>' {{(pid=116063) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 12:58:10.416352 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: INFO nova.api.openstack.requestlog [None req-0814ee0f-a7da-482c-be97-c8fec15843ab tempest-VolumesSnapshotsTestJSON-319198890 tempest-VolumesSnapshotsTestJSON-319198890-project] 10.222.0.49 "GET /compute/v2.1/os-snapshots/48c8f9fb-26e0-41d8-b7c3-79f6017b2171" status: 200 len: 287 microversion: 2.1 time: 0.044339 Dec 14 12:58:10.417689 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: [pid: 116063|app: 0|req: 12/24] 10.222.0.49 () {58 vars in 1250 bytes} [Tue Dec 14 12:58:10 2021] GET /compute/v2.1/os-snapshots/48c8f9fb-26e0-41d8-b7c3-79f6017b2171 => generated 287 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 14 12:58:11.169771 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.api.openstack.wsgi [None req-c33030e5-3607-499f-928e-107b68957f9d tempest-AttachVolumeNegativeTest-1000400951 tempest-AttachVolumeNegativeTest-1000400951-project] Calling method '>' {{(pid=116063) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 12:58:11.171278 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.compute.api [None req-c33030e5-3607-499f-928e-107b68957f9d tempest-AttachVolumeNegativeTest-1000400951 tempest-AttachVolumeNegativeTest-1000400951-project] [instance: 824eca5b-954f-402d-aa22-14f24ddd77ba] Fetching instance by UUID {{(pid=116063) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 12:58:11.181350 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-c33030e5-3607-499f-928e-107b68957f9d tempest-AttachVolumeNegativeTest-1000400951 tempest-AttachVolumeNegativeTest-1000400951-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 12:58:11.189958 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-c33030e5-3607-499f-928e-107b68957f9d tempest-AttachVolumeNegativeTest-1000400951 tempest-AttachVolumeNegativeTest-1000400951-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 12:58:11.190857 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-c33030e5-3607-499f-928e-107b68957f9d tempest-AttachVolumeNegativeTest-1000400951 tempest-AttachVolumeNegativeTest-1000400951-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 12:58:11.191311 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-c33030e5-3607-499f-928e-107b68957f9d tempest-AttachVolumeNegativeTest-1000400951 tempest-AttachVolumeNegativeTest-1000400951-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 12:58:11.245365 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.api.openstack.wsgi [None req-52c7a193-b724-4423-b5d6-a061a9ba7788 tempest-ServerRescueNegativeTestJSON-1573931620 tempest-ServerRescueNegativeTestJSON-1573931620-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1430567079", "imageRef": "1733dcd4-5ded-44e1-8b8d-392adb05c67a", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "6092f040-7850-4b5c-8606-0c2c75c91695"}]}} {{(pid=116064) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 14 12:58:11.392670 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.network.neutron [None req-52c7a193-b724-4423-b5d6-a061a9ba7788 tempest-ServerRescueNegativeTestJSON-1573931620 tempest-ServerRescueNegativeTestJSON-1573931620-project] validate_networks() for [('6092f040-7850-4b5c-8606-0c2c75c91695', None, None, None, None, None)] {{(pid=116064) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Dec 14 12:58:11.407807 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.policy [None req-c33030e5-3607-499f-928e-107b68957f9d tempest-AttachVolumeNegativeTest-1000400951 tempest-AttachVolumeNegativeTest-1000400951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57d0ec01f0784c8ea87d339980bed3cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad27b8951cae4eeeafa257f45217653a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116063) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 12:58:11.423954 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: INFO nova.api.openstack.requestlog [None req-c33030e5-3607-499f-928e-107b68957f9d tempest-AttachVolumeNegativeTest-1000400951 tempest-AttachVolumeNegativeTest-1000400951-project] 10.222.0.49 "GET /compute/v2.1/servers/824eca5b-954f-402d-aa22-14f24ddd77ba" status: 200 len: 1222 microversion: 2.1 time: 0.257583 Dec 14 12:58:11.424558 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: [pid: 116063|app: 0|req: 13/25] 10.222.0.49 () {58 vars in 1235 bytes} [Tue Dec 14 12:58:11 2021] GET /compute/v2.1/servers/824eca5b-954f-402d-aa22-14f24ddd77ba => generated 1222 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 14 12:58:11.446966 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.api.openstack.wsgi [None req-b4e2294e-c47f-4e07-8aec-fdb2cb3379ff tempest-DeleteServersTestJSON-1329684180 tempest-DeleteServersTestJSON-1329684180-project] Calling method '>' {{(pid=116063) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 12:58:11.447592 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.compute.api [None req-b4e2294e-c47f-4e07-8aec-fdb2cb3379ff tempest-DeleteServersTestJSON-1329684180 tempest-DeleteServersTestJSON-1329684180-project] [instance: 0632db38-ebd1-43c1-8ab9-04fbb19edfa7] Fetching instance by UUID {{(pid=116063) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 12:58:11.480637 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-b4e2294e-c47f-4e07-8aec-fdb2cb3379ff tempest-DeleteServersTestJSON-1329684180 tempest-DeleteServersTestJSON-1329684180-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 12:58:11.483012 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-b4e2294e-c47f-4e07-8aec-fdb2cb3379ff tempest-DeleteServersTestJSON-1329684180 tempest-DeleteServersTestJSON-1329684180-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 12:58:11.483868 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-b4e2294e-c47f-4e07-8aec-fdb2cb3379ff tempest-DeleteServersTestJSON-1329684180 tempest-DeleteServersTestJSON-1329684180-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 12:58:11.484313 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-b4e2294e-c47f-4e07-8aec-fdb2cb3379ff tempest-DeleteServersTestJSON-1329684180 tempest-DeleteServersTestJSON-1329684180-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 12:58:11.977823 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.policy [None req-b4e2294e-c47f-4e07-8aec-fdb2cb3379ff tempest-DeleteServersTestJSON-1329684180 tempest-DeleteServersTestJSON-1329684180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f4dc5a1bdfc4430b8fa39a5eec81f33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb24e38ec8e34dd9a93459b7ff9ba97a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116063) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 12:58:11.986102 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: INFO nova.api.openstack.requestlog [None req-b4e2294e-c47f-4e07-8aec-fdb2cb3379ff tempest-DeleteServersTestJSON-1329684180 tempest-DeleteServersTestJSON-1329684180-project] 10.222.0.49 "GET /compute/v2.1/servers/0632db38-ebd1-43c1-8ab9-04fbb19edfa7" status: 200 len: 1218 microversion: 2.1 time: 0.549845 Dec 14 12:58:11.991045 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: [pid: 116063|app: 0|req: 14/26] 10.222.0.49 () {58 vars in 1235 bytes} [Tue Dec 14 12:58:11 2021] GET /compute/v2.1/servers/0632db38-ebd1-43c1-8ab9-04fbb19edfa7 => generated 1218 bytes in 566 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 14 12:58:11.999860 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.api.openstack.wsgi [None req-8fde72aa-c096-4008-ae59-92f434a7c09c tempest-VolumesSnapshotsTestJSON-319198890 tempest-VolumesSnapshotsTestJSON-319198890-project] Calling method '.version_select at 0x7f2ace6e8ee0>' {{(pid=116063) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 12:58:12.066556 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: INFO nova.api.openstack.requestlog [None req-8fde72aa-c096-4008-ae59-92f434a7c09c tempest-VolumesSnapshotsTestJSON-319198890 tempest-VolumesSnapshotsTestJSON-319198890-project] 10.222.0.49 "GET /compute/v2.1/os-snapshots/48c8f9fb-26e0-41d8-b7c3-79f6017b2171" status: 200 len: 288 microversion: 2.1 time: 0.074129 Dec 14 12:58:12.068234 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: [pid: 116063|app: 0|req: 15/27] 10.222.0.49 () {58 vars in 1250 bytes} [Tue Dec 14 12:58:11 2021] GET /compute/v2.1/os-snapshots/48c8f9fb-26e0-41d8-b7c3-79f6017b2171 => generated 288 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 14 12:58:12.079367 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.api.openstack.wsgi [None req-14aacf6a-6e8c-4fc2-b5bb-f4b6253bbf71 tempest-VolumesSnapshotsTestJSON-319198890 tempest-VolumesSnapshotsTestJSON-319198890-project] Calling method '.version_select at 0x7f2ace6f5d30>' {{(pid=116063) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 12:58:12.157275 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: INFO nova.api.openstack.requestlog [None req-14aacf6a-6e8c-4fc2-b5bb-f4b6253bbf71 tempest-VolumesSnapshotsTestJSON-319198890 tempest-VolumesSnapshotsTestJSON-319198890-project] 10.222.0.49 "DELETE /compute/v2.1/os-snapshots/48c8f9fb-26e0-41d8-b7c3-79f6017b2171" status: 202 len: 0 microversion: 2.1 time: 0.082418 Dec 14 12:58:12.158437 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: [pid: 116063|app: 0|req: 16/28] 10.222.0.49 () {58 vars in 1253 bytes} [Tue Dec 14 12:58:12 2021] DELETE /compute/v2.1/os-snapshots/48c8f9fb-26e0-41d8-b7c3-79f6017b2171 => generated 0 bytes in 84 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Dec 14 12:58:12.172259 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.api.openstack.wsgi [None req-b78b59d5-dc2c-41b8-ac3c-86cc00524873 tempest-VolumesSnapshotsTestJSON-319198890 tempest-VolumesSnapshotsTestJSON-319198890-project] Calling method '.version_select at 0x7f2ace6c6a60>' {{(pid=116063) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 12:58:12.224375 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: INFO nova.api.openstack.requestlog [None req-b78b59d5-dc2c-41b8-ac3c-86cc00524873 tempest-VolumesSnapshotsTestJSON-319198890 tempest-VolumesSnapshotsTestJSON-319198890-project] 10.222.0.49 "GET /compute/v2.1/os-snapshots/48c8f9fb-26e0-41d8-b7c3-79f6017b2171" status: 200 len: 287 microversion: 2.1 time: 0.055663 Dec 14 12:58:12.225723 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: [pid: 116063|app: 0|req: 17/29] 10.222.0.49 () {58 vars in 1250 bytes} [Tue Dec 14 12:58:12 2021] GET /compute/v2.1/os-snapshots/48c8f9fb-26e0-41d8-b7c3-79f6017b2171 => generated 287 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Dec 14 12:58:12.446669 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.api.openstack.wsgi [None req-a9ce1b54-60a6-4eb6-8547-6a9bd6d7e828 tempest-AttachVolumeNegativeTest-1000400951 tempest-AttachVolumeNegativeTest-1000400951-project] Calling method '>' {{(pid=116063) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 12:58:12.447962 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.compute.api [None req-a9ce1b54-60a6-4eb6-8547-6a9bd6d7e828 tempest-AttachVolumeNegativeTest-1000400951 tempest-AttachVolumeNegativeTest-1000400951-project] [instance: 824eca5b-954f-402d-aa22-14f24ddd77ba] Fetching instance by UUID {{(pid=116063) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 12:58:12.467854 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-a9ce1b54-60a6-4eb6-8547-6a9bd6d7e828 tempest-AttachVolumeNegativeTest-1000400951 tempest-AttachVolumeNegativeTest-1000400951-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 12:58:12.468305 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-a9ce1b54-60a6-4eb6-8547-6a9bd6d7e828 tempest-AttachVolumeNegativeTest-1000400951 tempest-AttachVolumeNegativeTest-1000400951-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 12:58:12.469132 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-a9ce1b54-60a6-4eb6-8547-6a9bd6d7e828 tempest-AttachVolumeNegativeTest-1000400951 tempest-AttachVolumeNegativeTest-1000400951-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 12:58:12.480573 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-a9ce1b54-60a6-4eb6-8547-6a9bd6d7e828 tempest-AttachVolumeNegativeTest-1000400951 tempest-AttachVolumeNegativeTest-1000400951-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 12:58:12.875996 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.policy [None req-a9ce1b54-60a6-4eb6-8547-6a9bd6d7e828 tempest-AttachVolumeNegativeTest-1000400951 tempest-AttachVolumeNegativeTest-1000400951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57d0ec01f0784c8ea87d339980bed3cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad27b8951cae4eeeafa257f45217653a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116063) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 12:58:12.883933 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: INFO nova.api.openstack.requestlog [None req-a9ce1b54-60a6-4eb6-8547-6a9bd6d7e828 tempest-AttachVolumeNegativeTest-1000400951 tempest-AttachVolumeNegativeTest-1000400951-project] 10.222.0.49 "GET /compute/v2.1/servers/824eca5b-954f-402d-aa22-14f24ddd77ba" status: 200 len: 1270 microversion: 2.1 time: 0.446344 Dec 14 12:58:12.886577 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: [pid: 116063|app: 0|req: 18/30] 10.222.0.49 () {58 vars in 1235 bytes} [Tue Dec 14 12:58:12 2021] GET /compute/v2.1/servers/824eca5b-954f-402d-aa22-14f24ddd77ba => generated 1270 bytes in 449 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 14 12:58:12.956303 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.virt.hardware [None req-52c7a193-b724-4423-b5d6-a061a9ba7788 tempest-ServerRescueNegativeTestJSON-1573931620 tempest-ServerRescueNegativeTestJSON-1573931620-project] Flavor limits 0:0:0 {{(pid=116064) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Dec 14 12:58:12.957483 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.virt.hardware [None req-52c7a193-b724-4423-b5d6-a061a9ba7788 tempest-ServerRescueNegativeTestJSON-1573931620 tempest-ServerRescueNegativeTestJSON-1573931620-project] Image limits 0:0:0 {{(pid=116064) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Dec 14 12:58:12.958257 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.virt.hardware [None req-52c7a193-b724-4423-b5d6-a061a9ba7788 tempest-ServerRescueNegativeTestJSON-1573931620 tempest-ServerRescueNegativeTestJSON-1573931620-project] Flavor pref 0:0:0 {{(pid=116064) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Dec 14 12:58:12.959093 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.virt.hardware [None req-52c7a193-b724-4423-b5d6-a061a9ba7788 tempest-ServerRescueNegativeTestJSON-1573931620 tempest-ServerRescueNegativeTestJSON-1573931620-project] Image pref 0:0:0 {{(pid=116064) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Dec 14 12:58:12.959607 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.virt.hardware [None req-52c7a193-b724-4423-b5d6-a061a9ba7788 tempest-ServerRescueNegativeTestJSON-1573931620 tempest-ServerRescueNegativeTestJSON-1573931620-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=116064) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Dec 14 12:58:12.980589 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-52c7a193-b724-4423-b5d6-a061a9ba7788 tempest-ServerRescueNegativeTestJSON-1573931620 tempest-ServerRescueNegativeTestJSON-1573931620-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 12:58:13.011688 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-52c7a193-b724-4423-b5d6-a061a9ba7788 tempest-ServerRescueNegativeTestJSON-1573931620 tempest-ServerRescueNegativeTestJSON-1573931620-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 12:58:13.011688 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-52c7a193-b724-4423-b5d6-a061a9ba7788 tempest-ServerRescueNegativeTestJSON-1573931620 tempest-ServerRescueNegativeTestJSON-1573931620-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 12:58:13.011688 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-52c7a193-b724-4423-b5d6-a061a9ba7788 tempest-ServerRescueNegativeTestJSON-1573931620 tempest-ServerRescueNegativeTestJSON-1573931620-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 12:58:13.015561 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.api.openstack.wsgi [None req-e34d855f-f1d1-4bd6-a667-d881b89b8ac2 tempest-DeleteServersTestJSON-1329684180 tempest-DeleteServersTestJSON-1329684180-project] Calling method '>' {{(pid=116063) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 12:58:13.015561 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.compute.api [None req-e34d855f-f1d1-4bd6-a667-d881b89b8ac2 tempest-DeleteServersTestJSON-1329684180 tempest-DeleteServersTestJSON-1329684180-project] [instance: 0632db38-ebd1-43c1-8ab9-04fbb19edfa7] Fetching instance by UUID {{(pid=116063) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 12:58:13.025299 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-e34d855f-f1d1-4bd6-a667-d881b89b8ac2 tempest-DeleteServersTestJSON-1329684180 tempest-DeleteServersTestJSON-1329684180-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 12:58:13.025691 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-e34d855f-f1d1-4bd6-a667-d881b89b8ac2 tempest-DeleteServersTestJSON-1329684180 tempest-DeleteServersTestJSON-1329684180-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 12:58:13.026520 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-e34d855f-f1d1-4bd6-a667-d881b89b8ac2 tempest-DeleteServersTestJSON-1329684180 tempest-DeleteServersTestJSON-1329684180-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 12:58:13.026958 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-e34d855f-f1d1-4bd6-a667-d881b89b8ac2 tempest-DeleteServersTestJSON-1329684180 tempest-DeleteServersTestJSON-1329684180-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 12:58:13.081163 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.quota [None req-52c7a193-b724-4423-b5d6-a061a9ba7788 tempest-ServerRescueNegativeTestJSON-1573931620 tempest-ServerRescueNegativeTestJSON-1573931620-project] Getting quotas for project 010919ea84eb4eb8b936c63153600eba. Resources: {'cores', 'instances', 'ram'} {{(pid=116064) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 14 12:58:13.103257 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.quota [None req-52c7a193-b724-4423-b5d6-a061a9ba7788 tempest-ServerRescueNegativeTestJSON-1573931620 tempest-ServerRescueNegativeTestJSON-1573931620-project] Getting quotas for user 731cbbfe17214ded8ac66299d66dfc45 and project 010919ea84eb4eb8b936c63153600eba. Resources: {'cores', 'instances', 'ram'} {{(pid=116064) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 14 12:58:13.138409 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.compute.api [None req-52c7a193-b724-4423-b5d6-a061a9ba7788 tempest-ServerRescueNegativeTestJSON-1573931620 tempest-ServerRescueNegativeTestJSON-1573931620-project] Going to run 1 instances... {{(pid=116064) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Dec 14 12:58:13.143599 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.compute.api [None req-52c7a193-b724-4423-b5d6-a061a9ba7788 tempest-ServerRescueNegativeTestJSON-1573931620 tempest-ServerRescueNegativeTestJSON-1573931620-project] [instance: eb6e04a4-8901-47df-9b51-7c1664bd3f6c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='1733dcd4-5ded-44e1-8b8d-392adb05c67a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=116064) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Dec 14 12:58:13.179997 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.policy [None req-e34d855f-f1d1-4bd6-a667-d881b89b8ac2 tempest-DeleteServersTestJSON-1329684180 tempest-DeleteServersTestJSON-1329684180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f4dc5a1bdfc4430b8fa39a5eec81f33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb24e38ec8e34dd9a93459b7ff9ba97a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116063) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 12:58:13.204119 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: INFO nova.api.openstack.requestlog [None req-e34d855f-f1d1-4bd6-a667-d881b89b8ac2 tempest-DeleteServersTestJSON-1329684180 tempest-DeleteServersTestJSON-1329684180-project] 10.222.0.49 "GET /compute/v2.1/servers/0632db38-ebd1-43c1-8ab9-04fbb19edfa7" status: 200 len: 1266 microversion: 2.1 time: 0.199769 Dec 14 12:58:13.220397 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: [pid: 116063|app: 0|req: 19/31] 10.222.0.49 () {58 vars in 1235 bytes} [Tue Dec 14 12:58:13 2021] GET /compute/v2.1/servers/0632db38-ebd1-43c1-8ab9-04fbb19edfa7 => generated 1266 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 14 12:58:13.248111 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.api.openstack.wsgi [None req-38539990-4238-4402-bc73-1f706d69ead9 tempest-VolumesSnapshotsTestJSON-319198890 tempest-VolumesSnapshotsTestJSON-319198890-project] Calling method '.version_select at 0x7f2ace6da430>' {{(pid=116063) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 12:58:13.331043 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: INFO nova.api.openstack.wsgi [None req-38539990-4238-4402-bc73-1f706d69ead9 tempest-VolumesSnapshotsTestJSON-319198890 tempest-VolumesSnapshotsTestJSON-319198890-project] HTTP exception thrown: Snapshot 48c8f9fb-26e0-41d8-b7c3-79f6017b2171 could not be found. Dec 14 12:58:13.332002 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.api.openstack.wsgi [None req-38539990-4238-4402-bc73-1f706d69ead9 tempest-VolumesSnapshotsTestJSON-319198890 tempest-VolumesSnapshotsTestJSON-319198890-project] Returning 404 to user: Snapshot 48c8f9fb-26e0-41d8-b7c3-79f6017b2171 could not be found. {{(pid=116063) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 14 12:58:13.333118 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: INFO nova.api.openstack.requestlog [None req-38539990-4238-4402-bc73-1f706d69ead9 tempest-VolumesSnapshotsTestJSON-319198890 tempest-VolumesSnapshotsTestJSON-319198890-project] 10.222.0.49 "GET /compute/v2.1/os-snapshots/48c8f9fb-26e0-41d8-b7c3-79f6017b2171" status: 404 len: 111 microversion: 2.1 time: 0.093908 Dec 14 12:58:13.335285 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: [pid: 116063|app: 0|req: 20/32] 10.222.0.49 () {58 vars in 1250 bytes} [Tue Dec 14 12:58:13 2021] GET /compute/v2.1/os-snapshots/48c8f9fb-26e0-41d8-b7c3-79f6017b2171 => generated 111 bytes in 97 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Dec 14 12:58:13.344471 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.api.openstack.wsgi [None req-46791785-bc12-4f3c-adc0-00956b0b06df tempest-VolumesSnapshotsTestJSON-319198890 tempest-VolumesSnapshotsTestJSON-319198890-project] Calling method '.version_select at 0x7f2ace73a4c0>' {{(pid=116063) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 12:58:13.360069 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: INFO nova.api.openstack.requestlog [None req-52c7a193-b724-4423-b5d6-a061a9ba7788 tempest-ServerRescueNegativeTestJSON-1573931620 tempest-ServerRescueNegativeTestJSON-1573931620-project] 10.222.0.49 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 2.356021 Dec 14 12:58:13.360732 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: [pid: 116064|app: 0|req: 13/33] 10.222.0.49 () {60 vars in 1146 bytes} [Tue Dec 14 12:58:11 2021] POST /compute/v2.1/servers => generated 383 bytes in 2358 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Dec 14 12:58:13.397219 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.api.openstack.wsgi [None req-794c95a8-bd10-41b5-9b91-c5edb7f2166e tempest-ServerRescueNegativeTestJSON-1573931620 tempest-ServerRescueNegativeTestJSON-1573931620-project] Calling method '>' {{(pid=116064) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 12:58:13.397895 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.compute.api [None req-794c95a8-bd10-41b5-9b91-c5edb7f2166e tempest-ServerRescueNegativeTestJSON-1573931620 tempest-ServerRescueNegativeTestJSON-1573931620-project] [instance: eb6e04a4-8901-47df-9b51-7c1664bd3f6c] Fetching instance by UUID {{(pid=116064) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 12:58:13.510747 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: INFO nova.api.openstack.requestlog [None req-46791785-bc12-4f3c-adc0-00956b0b06df tempest-VolumesSnapshotsTestJSON-319198890 tempest-VolumesSnapshotsTestJSON-319198890-project] 10.222.0.49 "DELETE /compute/v2.1/os-volumes/54b79b0a-dce6-439d-9c62-d3826a3a11b6" status: 202 len: 0 microversion: 2.1 time: 0.170234 Dec 14 12:58:13.511616 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: [pid: 116063|app: 0|req: 21/34] 10.222.0.49 () {58 vars in 1247 bytes} [Tue Dec 14 12:58:13 2021] DELETE /compute/v2.1/os-volumes/54b79b0a-dce6-439d-9c62-d3826a3a11b6 => generated 0 bytes in 173 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Dec 14 12:58:13.523268 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.api.openstack.wsgi [None req-db88214c-b037-4476-95dd-6da41e37df8e tempest-VolumesSnapshotsTestJSON-319198890 tempest-VolumesSnapshotsTestJSON-319198890-project] Calling method '.version_select at 0x7f2ace6c68b0>' {{(pid=116063) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 12:58:14.082864 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: INFO nova.api.openstack.wsgi [None req-db88214c-b037-4476-95dd-6da41e37df8e tempest-VolumesSnapshotsTestJSON-319198890 tempest-VolumesSnapshotsTestJSON-319198890-project] HTTP exception thrown: Volume 54b79b0a-dce6-439d-9c62-d3826a3a11b6 could not be found. Dec 14 12:58:14.083886 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.api.openstack.wsgi [None req-db88214c-b037-4476-95dd-6da41e37df8e tempest-VolumesSnapshotsTestJSON-319198890 tempest-VolumesSnapshotsTestJSON-319198890-project] Returning 404 to user: Volume 54b79b0a-dce6-439d-9c62-d3826a3a11b6 could not be found. {{(pid=116063) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 14 12:58:14.084955 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: INFO nova.api.openstack.requestlog [None req-db88214c-b037-4476-95dd-6da41e37df8e tempest-VolumesSnapshotsTestJSON-319198890 tempest-VolumesSnapshotsTestJSON-319198890-project] 10.222.0.49 "GET /compute/v2.1/os-volumes/54b79b0a-dce6-439d-9c62-d3826a3a11b6" status: 404 len: 109 microversion: 2.1 time: 0.568798 Dec 14 12:58:14.085697 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: [pid: 116063|app: 0|req: 22/35] 10.222.0.49 () {58 vars in 1244 bytes} [Tue Dec 14 12:58:13 2021] GET /compute/v2.1/os-volumes/54b79b0a-dce6-439d-9c62-d3826a3a11b6 => generated 109 bytes in 570 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Dec 14 12:58:14.090603 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.api.openstack.wsgi [None req-d8ac0e61-9f19-40d2-bf49-1a8da58d3a22 tempest-AttachVolumeNegativeTest-1000400951 tempest-AttachVolumeNegativeTest-1000400951-project] Calling method '>' {{(pid=116063) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 12:58:14.091603 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.compute.api [None req-d8ac0e61-9f19-40d2-bf49-1a8da58d3a22 tempest-AttachVolumeNegativeTest-1000400951 tempest-AttachVolumeNegativeTest-1000400951-project] [instance: 824eca5b-954f-402d-aa22-14f24ddd77ba] Fetching instance by UUID {{(pid=116063) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 12:58:14.106530 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-d8ac0e61-9f19-40d2-bf49-1a8da58d3a22 tempest-AttachVolumeNegativeTest-1000400951 tempest-AttachVolumeNegativeTest-1000400951-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 12:58:14.108731 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-d8ac0e61-9f19-40d2-bf49-1a8da58d3a22 tempest-AttachVolumeNegativeTest-1000400951 tempest-AttachVolumeNegativeTest-1000400951-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 12:58:14.109851 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-d8ac0e61-9f19-40d2-bf49-1a8da58d3a22 tempest-AttachVolumeNegativeTest-1000400951 tempest-AttachVolumeNegativeTest-1000400951-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 12:58:14.110871 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-d8ac0e61-9f19-40d2-bf49-1a8da58d3a22 tempest-AttachVolumeNegativeTest-1000400951 tempest-AttachVolumeNegativeTest-1000400951-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 12:58:14.410205 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.policy [None req-794c95a8-bd10-41b5-9b91-c5edb7f2166e tempest-ServerRescueNegativeTestJSON-1573931620 tempest-ServerRescueNegativeTestJSON-1573931620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '731cbbfe17214ded8ac66299d66dfc45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '010919ea84eb4eb8b936c63153600eba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116064) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 12:58:14.417146 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: INFO nova.api.openstack.requestlog [None req-794c95a8-bd10-41b5-9b91-c5edb7f2166e tempest-ServerRescueNegativeTestJSON-1573931620 tempest-ServerRescueNegativeTestJSON-1573931620-project] 10.222.0.49 "GET /compute/v2.1/servers/eb6e04a4-8901-47df-9b51-7c1664bd3f6c" status: 200 len: 1222 microversion: 2.1 time: 1.044334 Dec 14 12:58:14.439423 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: [pid: 116064|app: 0|req: 14/36] 10.222.0.49 () {58 vars in 1235 bytes} [Tue Dec 14 12:58:13 2021] GET /compute/v2.1/servers/eb6e04a4-8901-47df-9b51-7c1664bd3f6c => generated 1222 bytes in 1069 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 14 12:58:14.444112 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.api.openstack.wsgi [None req-6763dfd0-7b77-4565-bc95-2c27660d910d tempest-VolumesSnapshotsTestJSON-319198890 tempest-VolumesSnapshotsTestJSON-319198890-project] Calling method '.version_select at 0x7f2ace724f70>' {{(pid=116064) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 12:58:14.506166 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: INFO nova.api.openstack.wsgi [None req-6763dfd0-7b77-4565-bc95-2c27660d910d tempest-VolumesSnapshotsTestJSON-319198890 tempest-VolumesSnapshotsTestJSON-319198890-project] HTTP exception thrown: Volume 54b79b0a-dce6-439d-9c62-d3826a3a11b6 could not be found. Dec 14 12:58:14.506872 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.api.openstack.wsgi [None req-6763dfd0-7b77-4565-bc95-2c27660d910d tempest-VolumesSnapshotsTestJSON-319198890 tempest-VolumesSnapshotsTestJSON-319198890-project] Returning 404 to user: Volume 54b79b0a-dce6-439d-9c62-d3826a3a11b6 could not be found. {{(pid=116064) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 14 12:58:14.507608 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: INFO nova.api.openstack.requestlog [None req-6763dfd0-7b77-4565-bc95-2c27660d910d tempest-VolumesSnapshotsTestJSON-319198890 tempest-VolumesSnapshotsTestJSON-319198890-project] 10.222.0.49 "DELETE /compute/v2.1/os-volumes/54b79b0a-dce6-439d-9c62-d3826a3a11b6" status: 404 len: 109 microversion: 2.1 time: 0.067152 Dec 14 12:58:14.508171 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: [pid: 116064|app: 0|req: 15/37] 10.222.0.49 () {58 vars in 1247 bytes} [Tue Dec 14 12:58:14 2021] DELETE /compute/v2.1/os-volumes/54b79b0a-dce6-439d-9c62-d3826a3a11b6 => generated 109 bytes in 68 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Dec 14 12:58:14.509008 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.policy [None req-d8ac0e61-9f19-40d2-bf49-1a8da58d3a22 tempest-AttachVolumeNegativeTest-1000400951 tempest-AttachVolumeNegativeTest-1000400951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57d0ec01f0784c8ea87d339980bed3cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad27b8951cae4eeeafa257f45217653a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116063) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 12:58:14.521157 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: INFO nova.api.openstack.requestlog [None req-d8ac0e61-9f19-40d2-bf49-1a8da58d3a22 tempest-AttachVolumeNegativeTest-1000400951 tempest-AttachVolumeNegativeTest-1000400951-project] 10.222.0.49 "GET /compute/v2.1/servers/824eca5b-954f-402d-aa22-14f24ddd77ba" status: 200 len: 1276 microversion: 2.1 time: 0.434175 Dec 14 12:58:14.521637 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.api.openstack.wsgi [None req-5586aea1-f617-4cd7-b0ce-a127f32fb20f tempest-DeleteServersTestJSON-1329684180 tempest-DeleteServersTestJSON-1329684180-project] Calling method '>' {{(pid=116064) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 12:58:14.522472 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.compute.api [None req-5586aea1-f617-4cd7-b0ce-a127f32fb20f tempest-DeleteServersTestJSON-1329684180 tempest-DeleteServersTestJSON-1329684180-project] [instance: 0632db38-ebd1-43c1-8ab9-04fbb19edfa7] Fetching instance by UUID {{(pid=116064) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 12:58:14.534400 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: [pid: 116063|app: 0|req: 23/38] 10.222.0.49 () {58 vars in 1235 bytes} [Tue Dec 14 12:58:14 2021] GET /compute/v2.1/servers/824eca5b-954f-402d-aa22-14f24ddd77ba => generated 1276 bytes in 448 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 14 12:58:14.550908 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-5586aea1-f617-4cd7-b0ce-a127f32fb20f tempest-DeleteServersTestJSON-1329684180 tempest-DeleteServersTestJSON-1329684180-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 12:58:14.551365 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-5586aea1-f617-4cd7-b0ce-a127f32fb20f tempest-DeleteServersTestJSON-1329684180 tempest-DeleteServersTestJSON-1329684180-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 12:58:14.552175 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-5586aea1-f617-4cd7-b0ce-a127f32fb20f tempest-DeleteServersTestJSON-1329684180 tempest-DeleteServersTestJSON-1329684180-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 12:58:14.552627 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-5586aea1-f617-4cd7-b0ce-a127f32fb20f tempest-DeleteServersTestJSON-1329684180 tempest-DeleteServersTestJSON-1329684180-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 12:58:14.887486 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.policy [None req-5586aea1-f617-4cd7-b0ce-a127f32fb20f tempest-DeleteServersTestJSON-1329684180 tempest-DeleteServersTestJSON-1329684180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f4dc5a1bdfc4430b8fa39a5eec81f33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb24e38ec8e34dd9a93459b7ff9ba97a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116064) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 12:58:14.895979 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: INFO nova.api.openstack.requestlog [None req-5586aea1-f617-4cd7-b0ce-a127f32fb20f tempest-DeleteServersTestJSON-1329684180 tempest-DeleteServersTestJSON-1329684180-project] 10.222.0.49 "GET /compute/v2.1/servers/0632db38-ebd1-43c1-8ab9-04fbb19edfa7" status: 200 len: 1272 microversion: 2.1 time: 0.386759 Dec 14 12:58:14.901777 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: [pid: 116064|app: 0|req: 16/39] 10.222.0.49 () {58 vars in 1235 bytes} [Tue Dec 14 12:58:14 2021] GET /compute/v2.1/servers/0632db38-ebd1-43c1-8ab9-04fbb19edfa7 => generated 1272 bytes in 393 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 14 12:58:14.912532 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.api.openstack.wsgi [None req-5e7b0312-2df7-4798-82ba-5055e3b9a522 tempest-VolumesSnapshotsTestJSON-319198890 tempest-VolumesSnapshotsTestJSON-319198890-project] Calling method '.version_select at 0x7f2ace6edaf0>' {{(pid=116064) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 12:58:14.960210 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: INFO nova.api.openstack.wsgi [None req-5e7b0312-2df7-4798-82ba-5055e3b9a522 tempest-VolumesSnapshotsTestJSON-319198890 tempest-VolumesSnapshotsTestJSON-319198890-project] HTTP exception thrown: Volume 54b79b0a-dce6-439d-9c62-d3826a3a11b6 could not be found. Dec 14 12:58:14.961106 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.api.openstack.wsgi [None req-5e7b0312-2df7-4798-82ba-5055e3b9a522 tempest-VolumesSnapshotsTestJSON-319198890 tempest-VolumesSnapshotsTestJSON-319198890-project] Returning 404 to user: Volume 54b79b0a-dce6-439d-9c62-d3826a3a11b6 could not be found. {{(pid=116064) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 14 12:58:14.962109 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: INFO nova.api.openstack.requestlog [None req-5e7b0312-2df7-4798-82ba-5055e3b9a522 tempest-VolumesSnapshotsTestJSON-319198890 tempest-VolumesSnapshotsTestJSON-319198890-project] 10.222.0.49 "GET /compute/v2.1/os-volumes/54b79b0a-dce6-439d-9c62-d3826a3a11b6" status: 404 len: 109 microversion: 2.1 time: 0.059075 Dec 14 12:58:14.962812 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: [pid: 116064|app: 0|req: 17/40] 10.222.0.49 () {58 vars in 1244 bytes} [Tue Dec 14 12:58:14 2021] GET /compute/v2.1/os-volumes/54b79b0a-dce6-439d-9c62-d3826a3a11b6 => generated 109 bytes in 60 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Dec 14 12:58:14.978106 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.api.openstack.wsgi [None req-4d508730-faac-40ce-b3e0-2d26df8ded36 tempest-ServerRescueNegativeTestJSON-1573931620 tempest-ServerRescueNegativeTestJSON-1573931620-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1599188205", "imageRef": "1733dcd4-5ded-44e1-8b8d-392adb05c67a", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "6092f040-7850-4b5c-8606-0c2c75c91695"}]}} {{(pid=116064) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 14 12:58:15.015445 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.api.openstack.wsgi [None req-79f4857f-c5db-4642-9920-84c3c05ed920 tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] Action: 'create', calling method: .version_select at 0x7f2acefa8d30>, body: {"keypair": {"name": "tempest-keypair-1408201028"}} {{(pid=116063) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 14 12:58:15.088998 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.quota [None req-79f4857f-c5db-4642-9920-84c3c05ed920 tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] Getting quotas for project 68a8770b8dbe489a8119016fbee64eb5. Resources: {'key_pairs'} {{(pid=116063) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 14 12:58:15.114946 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.quota [None req-79f4857f-c5db-4642-9920-84c3c05ed920 tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] Getting quotas for user 79d74a2ea1e541d28d085c15cec34032 and project 68a8770b8dbe489a8119016fbee64eb5. Resources: {'key_pairs'} {{(pid=116063) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 14 12:58:15.148997 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.network.neutron [None req-4d508730-faac-40ce-b3e0-2d26df8ded36 tempest-ServerRescueNegativeTestJSON-1573931620 tempest-ServerRescueNegativeTestJSON-1573931620-project] validate_networks() for [('6092f040-7850-4b5c-8606-0c2c75c91695', None, None, None, None, None)] {{(pid=116064) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Dec 14 12:58:15.765802 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.quota [None req-79f4857f-c5db-4642-9920-84c3c05ed920 tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] Getting quotas for project 68a8770b8dbe489a8119016fbee64eb5. Resources: {'key_pairs'} {{(pid=116063) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 14 12:58:15.779059 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.quota [None req-79f4857f-c5db-4642-9920-84c3c05ed920 tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] Getting quotas for user 79d74a2ea1e541d28d085c15cec34032 and project 68a8770b8dbe489a8119016fbee64eb5. Resources: {'key_pairs'} {{(pid=116063) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 14 12:58:15.828890 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: INFO nova.api.openstack.requestlog [None req-79f4857f-c5db-4642-9920-84c3c05ed920 tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] 10.222.0.49 "POST /compute/v2.1/os-keypairs" status: 201 len: 2320 microversion: 2.20 time: 1.293281 Dec 14 12:58:15.830165 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: [pid: 116063|app: 0|req: 24/41] 10.222.0.49 () {62 vars in 1198 bytes} [Tue Dec 14 12:58:14 2021] POST /compute/v2.1/os-keypairs => generated 2320 bytes in 1295 msecs (HTTP/1.1 201) 9 headers in 365 bytes (1 switches on core 0) Dec 14 12:58:15.835219 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.api.openstack.wsgi [None req-e80d551f-5ebe-4556-b469-3d0731624d58 tempest-AttachVolumeNegativeTest-1000400951 tempest-AttachVolumeNegativeTest-1000400951-project] Calling method '>' {{(pid=116063) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 12:58:15.838610 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.compute.api [None req-e80d551f-5ebe-4556-b469-3d0731624d58 tempest-AttachVolumeNegativeTest-1000400951 tempest-AttachVolumeNegativeTest-1000400951-project] [instance: 824eca5b-954f-402d-aa22-14f24ddd77ba] Fetching instance by UUID {{(pid=116063) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 12:58:15.858874 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-e80d551f-5ebe-4556-b469-3d0731624d58 tempest-AttachVolumeNegativeTest-1000400951 tempest-AttachVolumeNegativeTest-1000400951-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 12:58:15.869960 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-e80d551f-5ebe-4556-b469-3d0731624d58 tempest-AttachVolumeNegativeTest-1000400951 tempest-AttachVolumeNegativeTest-1000400951-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 12:58:15.872099 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-e80d551f-5ebe-4556-b469-3d0731624d58 tempest-AttachVolumeNegativeTest-1000400951 tempest-AttachVolumeNegativeTest-1000400951-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 12:58:15.873577 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-e80d551f-5ebe-4556-b469-3d0731624d58 tempest-AttachVolumeNegativeTest-1000400951 tempest-AttachVolumeNegativeTest-1000400951-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 12:58:17.670967 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.policy [None req-e80d551f-5ebe-4556-b469-3d0731624d58 tempest-AttachVolumeNegativeTest-1000400951 tempest-AttachVolumeNegativeTest-1000400951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57d0ec01f0784c8ea87d339980bed3cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad27b8951cae4eeeafa257f45217653a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116063) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 12:58:17.678892 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: INFO nova.api.openstack.requestlog [None req-e80d551f-5ebe-4556-b469-3d0731624d58 tempest-AttachVolumeNegativeTest-1000400951 tempest-AttachVolumeNegativeTest-1000400951-project] 10.222.0.49 "GET /compute/v2.1/servers/824eca5b-954f-402d-aa22-14f24ddd77ba" status: 200 len: 1318 microversion: 2.1 time: 1.847411 Dec 14 12:58:17.679486 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: [pid: 116063|app: 0|req: 25/42] 10.222.0.49 () {58 vars in 1235 bytes} [Tue Dec 14 12:58:15 2021] GET /compute/v2.1/servers/824eca5b-954f-402d-aa22-14f24ddd77ba => generated 1318 bytes in 1849 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 14 12:58:17.714481 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.api.openstack.wsgi [None req-1fb00b0c-70d4-4f61-9bec-1246e32b75ed tempest-DeleteServersTestJSON-1329684180 tempest-DeleteServersTestJSON-1329684180-project] Calling method '>' {{(pid=116063) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 12:58:17.715121 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.compute.api [None req-1fb00b0c-70d4-4f61-9bec-1246e32b75ed tempest-DeleteServersTestJSON-1329684180 tempest-DeleteServersTestJSON-1329684180-project] [instance: 0632db38-ebd1-43c1-8ab9-04fbb19edfa7] Fetching instance by UUID {{(pid=116063) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 12:58:17.737657 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-1fb00b0c-70d4-4f61-9bec-1246e32b75ed tempest-DeleteServersTestJSON-1329684180 tempest-DeleteServersTestJSON-1329684180-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 12:58:17.738114 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-1fb00b0c-70d4-4f61-9bec-1246e32b75ed tempest-DeleteServersTestJSON-1329684180 tempest-DeleteServersTestJSON-1329684180-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 12:58:17.738976 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-1fb00b0c-70d4-4f61-9bec-1246e32b75ed tempest-DeleteServersTestJSON-1329684180 tempest-DeleteServersTestJSON-1329684180-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 12:58:17.739430 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-1fb00b0c-70d4-4f61-9bec-1246e32b75ed tempest-DeleteServersTestJSON-1329684180 tempest-DeleteServersTestJSON-1329684180-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 12:58:18.981395 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.virt.hardware [None req-4d508730-faac-40ce-b3e0-2d26df8ded36 tempest-ServerRescueNegativeTestJSON-1573931620 tempest-ServerRescueNegativeTestJSON-1573931620-project] Flavor limits 0:0:0 {{(pid=116064) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Dec 14 12:58:18.983071 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.virt.hardware [None req-4d508730-faac-40ce-b3e0-2d26df8ded36 tempest-ServerRescueNegativeTestJSON-1573931620 tempest-ServerRescueNegativeTestJSON-1573931620-project] Image limits 0:0:0 {{(pid=116064) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Dec 14 12:58:18.983772 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.virt.hardware [None req-4d508730-faac-40ce-b3e0-2d26df8ded36 tempest-ServerRescueNegativeTestJSON-1573931620 tempest-ServerRescueNegativeTestJSON-1573931620-project] Flavor pref 0:0:0 {{(pid=116064) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Dec 14 12:58:18.984411 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.virt.hardware [None req-4d508730-faac-40ce-b3e0-2d26df8ded36 tempest-ServerRescueNegativeTestJSON-1573931620 tempest-ServerRescueNegativeTestJSON-1573931620-project] Image pref 0:0:0 {{(pid=116064) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Dec 14 12:58:18.985202 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.virt.hardware [None req-4d508730-faac-40ce-b3e0-2d26df8ded36 tempest-ServerRescueNegativeTestJSON-1573931620 tempest-ServerRescueNegativeTestJSON-1573931620-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=116064) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Dec 14 12:58:19.005579 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-4d508730-faac-40ce-b3e0-2d26df8ded36 tempest-ServerRescueNegativeTestJSON-1573931620 tempest-ServerRescueNegativeTestJSON-1573931620-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 12:58:19.008580 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-4d508730-faac-40ce-b3e0-2d26df8ded36 tempest-ServerRescueNegativeTestJSON-1573931620 tempest-ServerRescueNegativeTestJSON-1573931620-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 12:58:19.009723 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-4d508730-faac-40ce-b3e0-2d26df8ded36 tempest-ServerRescueNegativeTestJSON-1573931620 tempest-ServerRescueNegativeTestJSON-1573931620-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 12:58:19.017533 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-4d508730-faac-40ce-b3e0-2d26df8ded36 tempest-ServerRescueNegativeTestJSON-1573931620 tempest-ServerRescueNegativeTestJSON-1573931620-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 12:58:19.045992 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.policy [None req-1fb00b0c-70d4-4f61-9bec-1246e32b75ed tempest-DeleteServersTestJSON-1329684180 tempest-DeleteServersTestJSON-1329684180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f4dc5a1bdfc4430b8fa39a5eec81f33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb24e38ec8e34dd9a93459b7ff9ba97a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116063) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 12:58:19.056895 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: INFO nova.api.openstack.requestlog [None req-1fb00b0c-70d4-4f61-9bec-1246e32b75ed tempest-DeleteServersTestJSON-1329684180 tempest-DeleteServersTestJSON-1329684180-project] 10.222.0.49 "GET /compute/v2.1/servers/0632db38-ebd1-43c1-8ab9-04fbb19edfa7" status: 200 len: 1314 microversion: 2.1 time: 1.356382 Dec 14 12:58:19.063827 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: [pid: 116063|app: 0|req: 26/43] 10.222.0.49 () {58 vars in 1235 bytes} [Tue Dec 14 12:58:17 2021] GET /compute/v2.1/servers/0632db38-ebd1-43c1-8ab9-04fbb19edfa7 => generated 1314 bytes in 1384 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 14 12:58:19.082624 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.quota [None req-4d508730-faac-40ce-b3e0-2d26df8ded36 tempest-ServerRescueNegativeTestJSON-1573931620 tempest-ServerRescueNegativeTestJSON-1573931620-project] Getting quotas for project 010919ea84eb4eb8b936c63153600eba. Resources: {'cores', 'instances', 'ram'} {{(pid=116064) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 14 12:58:19.084135 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.api.openstack.wsgi [None req-90bd0b50-11d3-4135-9c92-998232411511 tempest-AttachVolumeNegativeTest-1000400951 tempest-AttachVolumeNegativeTest-1000400951-project] Calling method '>' {{(pid=116063) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 12:58:19.084135 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.compute.api [None req-90bd0b50-11d3-4135-9c92-998232411511 tempest-AttachVolumeNegativeTest-1000400951 tempest-AttachVolumeNegativeTest-1000400951-project] [instance: 824eca5b-954f-402d-aa22-14f24ddd77ba] Fetching instance by UUID {{(pid=116063) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 12:58:19.090910 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.quota [None req-4d508730-faac-40ce-b3e0-2d26df8ded36 tempest-ServerRescueNegativeTestJSON-1573931620 tempest-ServerRescueNegativeTestJSON-1573931620-project] Getting quotas for user 731cbbfe17214ded8ac66299d66dfc45 and project 010919ea84eb4eb8b936c63153600eba. Resources: {'cores', 'instances', 'ram'} {{(pid=116064) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 14 12:58:19.101888 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-90bd0b50-11d3-4135-9c92-998232411511 tempest-AttachVolumeNegativeTest-1000400951 tempest-AttachVolumeNegativeTest-1000400951-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 12:58:19.102333 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-90bd0b50-11d3-4135-9c92-998232411511 tempest-AttachVolumeNegativeTest-1000400951 tempest-AttachVolumeNegativeTest-1000400951-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 12:58:19.103136 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-90bd0b50-11d3-4135-9c92-998232411511 tempest-AttachVolumeNegativeTest-1000400951 tempest-AttachVolumeNegativeTest-1000400951-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 12:58:19.107794 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-90bd0b50-11d3-4135-9c92-998232411511 tempest-AttachVolumeNegativeTest-1000400951 tempest-AttachVolumeNegativeTest-1000400951-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 12:58:19.140877 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.compute.api [None req-4d508730-faac-40ce-b3e0-2d26df8ded36 tempest-ServerRescueNegativeTestJSON-1573931620 tempest-ServerRescueNegativeTestJSON-1573931620-project] Going to run 1 instances... {{(pid=116064) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Dec 14 12:58:19.143281 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.compute.api [None req-4d508730-faac-40ce-b3e0-2d26df8ded36 tempest-ServerRescueNegativeTestJSON-1573931620 tempest-ServerRescueNegativeTestJSON-1573931620-project] [instance: 60694e1e-d0cb-41c8-adf5-bdda49804385] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='1733dcd4-5ded-44e1-8b8d-392adb05c67a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=116064) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Dec 14 12:58:19.295982 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: INFO nova.api.openstack.requestlog [None req-4d508730-faac-40ce-b3e0-2d26df8ded36 tempest-ServerRescueNegativeTestJSON-1573931620 tempest-ServerRescueNegativeTestJSON-1573931620-project] 10.222.0.49 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 4.322791 Dec 14 12:58:19.320686 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: [pid: 116064|app: 0|req: 18/44] 10.222.0.49 () {60 vars in 1146 bytes} [Tue Dec 14 12:58:14 2021] POST /compute/v2.1/servers => generated 383 bytes in 4354 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Dec 14 12:58:19.348326 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.api.openstack.wsgi [None req-8879bd45-d06c-4085-9357-6c0c22de457f tempest-ServerRescueNegativeTestJSON-1573931620 tempest-ServerRescueNegativeTestJSON-1573931620-project] Calling method '>' {{(pid=116064) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 12:58:19.353227 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.compute.api [None req-8879bd45-d06c-4085-9357-6c0c22de457f tempest-ServerRescueNegativeTestJSON-1573931620 tempest-ServerRescueNegativeTestJSON-1573931620-project] [instance: 60694e1e-d0cb-41c8-adf5-bdda49804385] Fetching instance by UUID {{(pid=116064) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 12:58:19.635533 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.policy [None req-8879bd45-d06c-4085-9357-6c0c22de457f tempest-ServerRescueNegativeTestJSON-1573931620 tempest-ServerRescueNegativeTestJSON-1573931620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '731cbbfe17214ded8ac66299d66dfc45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '010919ea84eb4eb8b936c63153600eba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116064) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 12:58:19.648260 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: INFO nova.api.openstack.requestlog [None req-8879bd45-d06c-4085-9357-6c0c22de457f tempest-ServerRescueNegativeTestJSON-1573931620 tempest-ServerRescueNegativeTestJSON-1573931620-project] 10.222.0.49 "GET /compute/v2.1/servers/60694e1e-d0cb-41c8-adf5-bdda49804385" status: 200 len: 1222 microversion: 2.1 time: 0.319768 Dec 14 12:58:19.672153 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: [pid: 116064|app: 0|req: 19/45] 10.222.0.49 () {58 vars in 1235 bytes} [Tue Dec 14 12:58:19 2021] GET /compute/v2.1/servers/60694e1e-d0cb-41c8-adf5-bdda49804385 => generated 1222 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 14 12:58:20.079458 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.api.openstack.wsgi [None req-ad65fe9d-e6da-4717-a6cf-3df0200d6055 tempest-DeleteServersTestJSON-1329684180 tempest-DeleteServersTestJSON-1329684180-project] Calling method '>' {{(pid=116064) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 12:58:20.080071 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.compute.api [None req-ad65fe9d-e6da-4717-a6cf-3df0200d6055 tempest-DeleteServersTestJSON-1329684180 tempest-DeleteServersTestJSON-1329684180-project] [instance: 0632db38-ebd1-43c1-8ab9-04fbb19edfa7] Fetching instance by UUID {{(pid=116064) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 12:58:20.090616 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-ad65fe9d-e6da-4717-a6cf-3df0200d6055 tempest-DeleteServersTestJSON-1329684180 tempest-DeleteServersTestJSON-1329684180-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 12:58:20.097128 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-ad65fe9d-e6da-4717-a6cf-3df0200d6055 tempest-DeleteServersTestJSON-1329684180 tempest-DeleteServersTestJSON-1329684180-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 12:58:20.102208 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-ad65fe9d-e6da-4717-a6cf-3df0200d6055 tempest-DeleteServersTestJSON-1329684180 tempest-DeleteServersTestJSON-1329684180-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 12:58:20.104190 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-ad65fe9d-e6da-4717-a6cf-3df0200d6055 tempest-DeleteServersTestJSON-1329684180 tempest-DeleteServersTestJSON-1329684180-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 12:58:20.486032 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.policy [None req-90bd0b50-11d3-4135-9c92-998232411511 tempest-AttachVolumeNegativeTest-1000400951 tempest-AttachVolumeNegativeTest-1000400951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57d0ec01f0784c8ea87d339980bed3cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad27b8951cae4eeeafa257f45217653a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116063) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 12:58:20.512553 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: INFO nova.api.openstack.requestlog [None req-90bd0b50-11d3-4135-9c92-998232411511 tempest-AttachVolumeNegativeTest-1000400951 tempest-AttachVolumeNegativeTest-1000400951-project] 10.222.0.49 "GET /compute/v2.1/servers/824eca5b-954f-402d-aa22-14f24ddd77ba" status: 200 len: 1318 microversion: 2.1 time: 1.445876 Dec 14 12:58:20.516349 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: [pid: 116063|app: 0|req: 27/46] 10.222.0.49 () {58 vars in 1235 bytes} [Tue Dec 14 12:58:19 2021] GET /compute/v2.1/servers/824eca5b-954f-402d-aa22-14f24ddd77ba => generated 1318 bytes in 1450 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 14 12:58:20.666624 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.api.openstack.wsgi [None req-715abaa7-0286-463e-81a8-48820c9083c3 tempest-ServerRescueNegativeTestJSON-1573931620 tempest-ServerRescueNegativeTestJSON-1573931620-project] Calling method '>' {{(pid=116063) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 12:58:20.667298 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.compute.api [None req-715abaa7-0286-463e-81a8-48820c9083c3 tempest-ServerRescueNegativeTestJSON-1573931620 tempest-ServerRescueNegativeTestJSON-1573931620-project] [instance: 60694e1e-d0cb-41c8-adf5-bdda49804385] Fetching instance by UUID {{(pid=116063) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 12:58:20.685140 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-715abaa7-0286-463e-81a8-48820c9083c3 tempest-ServerRescueNegativeTestJSON-1573931620 tempest-ServerRescueNegativeTestJSON-1573931620-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 12:58:20.688752 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-715abaa7-0286-463e-81a8-48820c9083c3 tempest-ServerRescueNegativeTestJSON-1573931620 tempest-ServerRescueNegativeTestJSON-1573931620-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 12:58:20.691618 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-715abaa7-0286-463e-81a8-48820c9083c3 tempest-ServerRescueNegativeTestJSON-1573931620 tempest-ServerRescueNegativeTestJSON-1573931620-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 12:58:20.693477 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-715abaa7-0286-463e-81a8-48820c9083c3 tempest-ServerRescueNegativeTestJSON-1573931620 tempest-ServerRescueNegativeTestJSON-1573931620-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 12:58:20.811651 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.policy [None req-ad65fe9d-e6da-4717-a6cf-3df0200d6055 tempest-DeleteServersTestJSON-1329684180 tempest-DeleteServersTestJSON-1329684180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f4dc5a1bdfc4430b8fa39a5eec81f33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb24e38ec8e34dd9a93459b7ff9ba97a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116064) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 12:58:20.822037 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: INFO nova.api.openstack.requestlog [None req-ad65fe9d-e6da-4717-a6cf-3df0200d6055 tempest-DeleteServersTestJSON-1329684180 tempest-DeleteServersTestJSON-1329684180-project] 10.222.0.49 "GET /compute/v2.1/servers/0632db38-ebd1-43c1-8ab9-04fbb19edfa7" status: 200 len: 1314 microversion: 2.1 time: 0.746191 Dec 14 12:58:20.823676 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: [pid: 116064|app: 0|req: 20/47] 10.222.0.49 () {58 vars in 1235 bytes} [Tue Dec 14 12:58:20 2021] GET /compute/v2.1/servers/0632db38-ebd1-43c1-8ab9-04fbb19edfa7 => generated 1314 bytes in 748 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 14 12:58:20.929972 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.policy [None req-715abaa7-0286-463e-81a8-48820c9083c3 tempest-ServerRescueNegativeTestJSON-1573931620 tempest-ServerRescueNegativeTestJSON-1573931620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '731cbbfe17214ded8ac66299d66dfc45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '010919ea84eb4eb8b936c63153600eba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116063) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 12:58:20.938145 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: INFO nova.api.openstack.requestlog [None req-715abaa7-0286-463e-81a8-48820c9083c3 tempest-ServerRescueNegativeTestJSON-1573931620 tempest-ServerRescueNegativeTestJSON-1573931620-project] 10.222.0.49 "GET /compute/v2.1/servers/60694e1e-d0cb-41c8-adf5-bdda49804385" status: 200 len: 1218 microversion: 2.1 time: 0.275454 Dec 14 12:58:20.952351 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: [pid: 116063|app: 0|req: 28/48] 10.222.0.49 () {58 vars in 1235 bytes} [Tue Dec 14 12:58:20 2021] GET /compute/v2.1/servers/60694e1e-d0cb-41c8-adf5-bdda49804385 => generated 1218 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 14 12:58:21.533178 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.api.openstack.wsgi [None req-7819c7dd-f5f9-40c1-b6ca-db2eff2dfd19 tempest-AttachVolumeNegativeTest-1000400951 tempest-AttachVolumeNegativeTest-1000400951-project] Calling method '>' {{(pid=116064) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 12:58:21.534547 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.compute.api [None req-7819c7dd-f5f9-40c1-b6ca-db2eff2dfd19 tempest-AttachVolumeNegativeTest-1000400951 tempest-AttachVolumeNegativeTest-1000400951-project] [instance: 824eca5b-954f-402d-aa22-14f24ddd77ba] Fetching instance by UUID {{(pid=116064) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 12:58:21.547051 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-7819c7dd-f5f9-40c1-b6ca-db2eff2dfd19 tempest-AttachVolumeNegativeTest-1000400951 tempest-AttachVolumeNegativeTest-1000400951-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 12:58:21.547856 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-7819c7dd-f5f9-40c1-b6ca-db2eff2dfd19 tempest-AttachVolumeNegativeTest-1000400951 tempest-AttachVolumeNegativeTest-1000400951-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 12:58:21.549250 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-7819c7dd-f5f9-40c1-b6ca-db2eff2dfd19 tempest-AttachVolumeNegativeTest-1000400951 tempest-AttachVolumeNegativeTest-1000400951-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 12:58:21.553507 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-7819c7dd-f5f9-40c1-b6ca-db2eff2dfd19 tempest-AttachVolumeNegativeTest-1000400951 tempest-AttachVolumeNegativeTest-1000400951-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 12:58:21.840494 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.api.openstack.wsgi [None req-f1a06ccb-a166-497d-a793-c0ef27af9aca tempest-DeleteServersTestJSON-1329684180 tempest-DeleteServersTestJSON-1329684180-project] Calling method '>' {{(pid=116063) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 12:58:21.843514 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.compute.api [None req-f1a06ccb-a166-497d-a793-c0ef27af9aca tempest-DeleteServersTestJSON-1329684180 tempest-DeleteServersTestJSON-1329684180-project] [instance: 0632db38-ebd1-43c1-8ab9-04fbb19edfa7] Fetching instance by UUID {{(pid=116063) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 12:58:21.864122 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-f1a06ccb-a166-497d-a793-c0ef27af9aca tempest-DeleteServersTestJSON-1329684180 tempest-DeleteServersTestJSON-1329684180-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 12:58:21.865422 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-f1a06ccb-a166-497d-a793-c0ef27af9aca tempest-DeleteServersTestJSON-1329684180 tempest-DeleteServersTestJSON-1329684180-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 12:58:21.866949 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-f1a06ccb-a166-497d-a793-c0ef27af9aca tempest-DeleteServersTestJSON-1329684180 tempest-DeleteServersTestJSON-1329684180-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 12:58:21.867536 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-f1a06ccb-a166-497d-a793-c0ef27af9aca tempest-DeleteServersTestJSON-1329684180 tempest-DeleteServersTestJSON-1329684180-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 12:58:23.177763 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.policy [None req-7819c7dd-f5f9-40c1-b6ca-db2eff2dfd19 tempest-AttachVolumeNegativeTest-1000400951 tempest-AttachVolumeNegativeTest-1000400951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57d0ec01f0784c8ea87d339980bed3cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad27b8951cae4eeeafa257f45217653a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116064) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 12:58:23.191846 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: INFO nova.api.openstack.requestlog [None req-7819c7dd-f5f9-40c1-b6ca-db2eff2dfd19 tempest-AttachVolumeNegativeTest-1000400951 tempest-AttachVolumeNegativeTest-1000400951-project] 10.222.0.49 "GET /compute/v2.1/servers/824eca5b-954f-402d-aa22-14f24ddd77ba" status: 200 len: 1318 microversion: 2.1 time: 1.663052 Dec 14 12:58:23.200175 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: [pid: 116064|app: 0|req: 21/49] 10.222.0.49 () {58 vars in 1235 bytes} [Tue Dec 14 12:58:21 2021] GET /compute/v2.1/servers/824eca5b-954f-402d-aa22-14f24ddd77ba => generated 1318 bytes in 1672 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 14 12:58:23.210243 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.api.openstack.wsgi [None req-cde005fc-3199-4172-a5c6-60b2782ece6e tempest-ServerRescueNegativeTestJSON-1573931620 tempest-ServerRescueNegativeTestJSON-1573931620-project] Calling method '>' {{(pid=116064) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 12:58:23.220242 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.compute.api [None req-cde005fc-3199-4172-a5c6-60b2782ece6e tempest-ServerRescueNegativeTestJSON-1573931620 tempest-ServerRescueNegativeTestJSON-1573931620-project] [instance: 60694e1e-d0cb-41c8-adf5-bdda49804385] Fetching instance by UUID {{(pid=116064) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 12:58:23.258692 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-cde005fc-3199-4172-a5c6-60b2782ece6e tempest-ServerRescueNegativeTestJSON-1573931620 tempest-ServerRescueNegativeTestJSON-1573931620-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 12:58:23.263934 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-cde005fc-3199-4172-a5c6-60b2782ece6e tempest-ServerRescueNegativeTestJSON-1573931620 tempest-ServerRescueNegativeTestJSON-1573931620-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 12:58:23.267087 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-cde005fc-3199-4172-a5c6-60b2782ece6e tempest-ServerRescueNegativeTestJSON-1573931620 tempest-ServerRescueNegativeTestJSON-1573931620-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 12:58:23.267880 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-cde005fc-3199-4172-a5c6-60b2782ece6e tempest-ServerRescueNegativeTestJSON-1573931620 tempest-ServerRescueNegativeTestJSON-1573931620-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 12:58:23.479732 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.policy [None req-cde005fc-3199-4172-a5c6-60b2782ece6e tempest-ServerRescueNegativeTestJSON-1573931620 tempest-ServerRescueNegativeTestJSON-1573931620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '731cbbfe17214ded8ac66299d66dfc45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '010919ea84eb4eb8b936c63153600eba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116064) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 12:58:23.486362 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.policy [None req-f1a06ccb-a166-497d-a793-c0ef27af9aca tempest-DeleteServersTestJSON-1329684180 tempest-DeleteServersTestJSON-1329684180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f4dc5a1bdfc4430b8fa39a5eec81f33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb24e38ec8e34dd9a93459b7ff9ba97a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116063) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 12:58:23.510119 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: INFO nova.api.openstack.requestlog [None req-cde005fc-3199-4172-a5c6-60b2782ece6e tempest-ServerRescueNegativeTestJSON-1573931620 tempest-ServerRescueNegativeTestJSON-1573931620-project] 10.222.0.49 "GET /compute/v2.1/servers/60694e1e-d0cb-41c8-adf5-bdda49804385" status: 200 len: 1280 microversion: 2.1 time: 0.304894 Dec 14 12:58:23.515163 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: [pid: 116064|app: 0|req: 22/50] 10.222.0.49 () {58 vars in 1235 bytes} [Tue Dec 14 12:58:23 2021] GET /compute/v2.1/servers/60694e1e-d0cb-41c8-adf5-bdda49804385 => generated 1280 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 14 12:58:23.528214 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: INFO nova.api.openstack.requestlog [None req-f1a06ccb-a166-497d-a793-c0ef27af9aca tempest-DeleteServersTestJSON-1329684180 tempest-DeleteServersTestJSON-1329684180-project] 10.222.0.49 "GET /compute/v2.1/servers/0632db38-ebd1-43c1-8ab9-04fbb19edfa7" status: 200 len: 1314 microversion: 2.1 time: 1.692125 Dec 14 12:58:23.535860 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: [pid: 116063|app: 0|req: 29/51] 10.222.0.49 () {58 vars in 1235 bytes} [Tue Dec 14 12:58:21 2021] GET /compute/v2.1/servers/0632db38-ebd1-43c1-8ab9-04fbb19edfa7 => generated 1314 bytes in 1701 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 14 12:58:24.111959 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.api.openstack.wsgi [req-86b1ff46-5ab7-4230-8c46-98a296d1fb2d req-67c9c8d6-de45-48ad-a2f1-07dfd6dc14a2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0632db38-ebd1-43c1-8ab9-04fbb19edfa7", "tag": "1fe1c28a-b855-4e98-8e95-d0334e66858c"}]} {{(pid=116064) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 14 12:58:24.119624 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 14 12:58:24.119624 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: warnings.warn(msg) Dec 14 12:58:24.191792 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [req-86b1ff46-5ab7-4230-8c46-98a296d1fb2d req-67c9c8d6-de45-48ad-a2f1-07dfd6dc14a2 service nova] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 12:58:24.194436 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [req-86b1ff46-5ab7-4230-8c46-98a296d1fb2d req-67c9c8d6-de45-48ad-a2f1-07dfd6dc14a2 service nova] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 12:58:24.217714 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.api.openstack.wsgi [None req-27037929-5e51-4cee-b13e-c511226cfbca tempest-AttachVolumeNegativeTest-1000400951 tempest-AttachVolumeNegativeTest-1000400951-project] Calling method '>' {{(pid=116063) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 12:58:24.218865 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.compute.api [None req-27037929-5e51-4cee-b13e-c511226cfbca tempest-AttachVolumeNegativeTest-1000400951 tempest-AttachVolumeNegativeTest-1000400951-project] [instance: 824eca5b-954f-402d-aa22-14f24ddd77ba] Fetching instance by UUID {{(pid=116063) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 12:58:24.254979 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-27037929-5e51-4cee-b13e-c511226cfbca tempest-AttachVolumeNegativeTest-1000400951 tempest-AttachVolumeNegativeTest-1000400951-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 12:58:24.257286 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-27037929-5e51-4cee-b13e-c511226cfbca tempest-AttachVolumeNegativeTest-1000400951 tempest-AttachVolumeNegativeTest-1000400951-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 12:58:24.270984 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-27037929-5e51-4cee-b13e-c511226cfbca tempest-AttachVolumeNegativeTest-1000400951 tempest-AttachVolumeNegativeTest-1000400951-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 12:58:24.273285 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-27037929-5e51-4cee-b13e-c511226cfbca tempest-AttachVolumeNegativeTest-1000400951 tempest-AttachVolumeNegativeTest-1000400951-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 12:58:24.348489 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: INFO nova.api.openstack.compute.server_external_events [req-86b1ff46-5ab7-4230-8c46-98a296d1fb2d req-67c9c8d6-de45-48ad-a2f1-07dfd6dc14a2 service nova] Creating event network-changed:1fe1c28a-b855-4e98-8e95-d0334e66858c for instance 0632db38-ebd1-43c1-8ab9-04fbb19edfa7 on hv-cinder-78447 Dec 14 12:58:24.349070 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [req-86b1ff46-5ab7-4230-8c46-98a296d1fb2d req-67c9c8d6-de45-48ad-a2f1-07dfd6dc14a2 service nova] Acquired lock "compute-rpcapi-router" {{(pid=116064) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} Dec 14 12:58:24.350335 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-67a486e1-115b-4954-9bb5-c86714a1b802 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 12:58:24.350681 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-67a486e1-115b-4954-9bb5-c86714a1b802 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 12:58:24.351476 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-67a486e1-115b-4954-9bb5-c86714a1b802 None None] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 12:58:24.351908 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-67a486e1-115b-4954-9bb5-c86714a1b802 None None] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 12:58:24.396701 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: INFO nova.compute.rpcapi [None req-67a486e1-115b-4954-9bb5-c86714a1b802 None None] Automatically selected compute RPC version 6.0 from minimum service version 60 Dec 14 12:58:24.397764 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-67a486e1-115b-4954-9bb5-c86714a1b802 None None] Releasing lock "compute-rpcapi-router" {{(pid=116064) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Dec 14 12:58:24.480050 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: INFO nova.api.openstack.requestlog [None req-67a486e1-115b-4954-9bb5-c86714a1b802 None None] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.960711 Dec 14 12:58:24.481068 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: [pid: 116064|app: 0|req: 23/52] 10.222.0.49 () {64 vars in 1317 bytes} [Tue Dec 14 12:58:23 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 964 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 14 12:58:24.532826 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.api.openstack.wsgi [None req-0781a7b8-f880-47aa-99ee-50663a9d7f58 tempest-ServerRescueNegativeTestJSON-1573931620 tempest-ServerRescueNegativeTestJSON-1573931620-project] Calling method '>' {{(pid=116064) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 12:58:24.533724 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.compute.api [None req-0781a7b8-f880-47aa-99ee-50663a9d7f58 tempest-ServerRescueNegativeTestJSON-1573931620 tempest-ServerRescueNegativeTestJSON-1573931620-project] [instance: 60694e1e-d0cb-41c8-adf5-bdda49804385] Fetching instance by UUID {{(pid=116064) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 12:58:24.547640 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-0781a7b8-f880-47aa-99ee-50663a9d7f58 tempest-ServerRescueNegativeTestJSON-1573931620 tempest-ServerRescueNegativeTestJSON-1573931620-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 12:58:24.548391 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-0781a7b8-f880-47aa-99ee-50663a9d7f58 tempest-ServerRescueNegativeTestJSON-1573931620 tempest-ServerRescueNegativeTestJSON-1573931620-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 12:58:24.549314 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-0781a7b8-f880-47aa-99ee-50663a9d7f58 tempest-ServerRescueNegativeTestJSON-1573931620 tempest-ServerRescueNegativeTestJSON-1573931620-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 12:58:24.549625 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-0781a7b8-f880-47aa-99ee-50663a9d7f58 tempest-ServerRescueNegativeTestJSON-1573931620 tempest-ServerRescueNegativeTestJSON-1573931620-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 12:58:24.849930 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.policy [None req-0781a7b8-f880-47aa-99ee-50663a9d7f58 tempest-ServerRescueNegativeTestJSON-1573931620 tempest-ServerRescueNegativeTestJSON-1573931620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '731cbbfe17214ded8ac66299d66dfc45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '010919ea84eb4eb8b936c63153600eba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116064) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 12:58:24.869205 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: INFO nova.api.openstack.requestlog [None req-0781a7b8-f880-47aa-99ee-50663a9d7f58 tempest-ServerRescueNegativeTestJSON-1573931620 tempest-ServerRescueNegativeTestJSON-1573931620-project] 10.222.0.49 "GET /compute/v2.1/servers/60694e1e-d0cb-41c8-adf5-bdda49804385" status: 200 len: 1280 microversion: 2.1 time: 0.340636 Dec 14 12:58:24.869936 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: [pid: 116064|app: 0|req: 24/53] 10.222.0.49 () {58 vars in 1235 bytes} [Tue Dec 14 12:58:24 2021] GET /compute/v2.1/servers/60694e1e-d0cb-41c8-adf5-bdda49804385 => generated 1280 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 14 12:58:24.874476 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.api.openstack.wsgi [None req-373a468b-009b-44ef-bfef-6e48b6d8cdaf tempest-DeleteServersTestJSON-1329684180 tempest-DeleteServersTestJSON-1329684180-project] Calling method '>' {{(pid=116064) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 12:58:24.875092 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.compute.api [None req-373a468b-009b-44ef-bfef-6e48b6d8cdaf tempest-DeleteServersTestJSON-1329684180 tempest-DeleteServersTestJSON-1329684180-project] [instance: 0632db38-ebd1-43c1-8ab9-04fbb19edfa7] Fetching instance by UUID {{(pid=116064) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 12:58:24.914875 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-373a468b-009b-44ef-bfef-6e48b6d8cdaf tempest-DeleteServersTestJSON-1329684180 tempest-DeleteServersTestJSON-1329684180-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 12:58:24.919572 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-373a468b-009b-44ef-bfef-6e48b6d8cdaf tempest-DeleteServersTestJSON-1329684180 tempest-DeleteServersTestJSON-1329684180-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 12:58:24.921292 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-373a468b-009b-44ef-bfef-6e48b6d8cdaf tempest-DeleteServersTestJSON-1329684180 tempest-DeleteServersTestJSON-1329684180-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 12:58:24.921880 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-373a468b-009b-44ef-bfef-6e48b6d8cdaf tempest-DeleteServersTestJSON-1329684180 tempest-DeleteServersTestJSON-1329684180-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 12:58:25.456482 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.policy [None req-27037929-5e51-4cee-b13e-c511226cfbca tempest-AttachVolumeNegativeTest-1000400951 tempest-AttachVolumeNegativeTest-1000400951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57d0ec01f0784c8ea87d339980bed3cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad27b8951cae4eeeafa257f45217653a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116063) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 12:58:25.471888 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: INFO nova.api.openstack.requestlog [None req-27037929-5e51-4cee-b13e-c511226cfbca tempest-AttachVolumeNegativeTest-1000400951 tempest-AttachVolumeNegativeTest-1000400951-project] 10.222.0.49 "GET /compute/v2.1/servers/824eca5b-954f-402d-aa22-14f24ddd77ba" status: 200 len: 1318 microversion: 2.1 time: 1.258232 Dec 14 12:58:25.472570 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: [pid: 116063|app: 0|req: 30/54] 10.222.0.49 () {58 vars in 1235 bytes} [Tue Dec 14 12:58:24 2021] GET /compute/v2.1/servers/824eca5b-954f-402d-aa22-14f24ddd77ba => generated 1318 bytes in 1260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 14 12:58:25.696592 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.api.openstack.wsgi [req-87970995-7a1f-4d3a-bd3a-7f2bd096cc6a req-92ce481a-c17c-45fa-9c05-0b6a09699d8d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "eb6e04a4-8901-47df-9b51-7c1664bd3f6c", "tag": "97df3dc5-b4a4-4c81-9f39-f292ced202fb"}]} {{(pid=116063) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 14 12:58:25.699271 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 14 12:58:25.699271 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: warnings.warn(msg) Dec 14 12:58:25.723536 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [req-87970995-7a1f-4d3a-bd3a-7f2bd096cc6a req-92ce481a-c17c-45fa-9c05-0b6a09699d8d service nova] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 12:58:25.724006 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [req-87970995-7a1f-4d3a-bd3a-7f2bd096cc6a req-92ce481a-c17c-45fa-9c05-0b6a09699d8d service nova] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 12:58:25.775332 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: INFO nova.api.openstack.compute.server_external_events [req-87970995-7a1f-4d3a-bd3a-7f2bd096cc6a req-92ce481a-c17c-45fa-9c05-0b6a09699d8d service nova] Creating event network-changed:97df3dc5-b4a4-4c81-9f39-f292ced202fb for instance eb6e04a4-8901-47df-9b51-7c1664bd3f6c on hv-cinder-78447 Dec 14 12:58:25.776412 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [req-87970995-7a1f-4d3a-bd3a-7f2bd096cc6a req-92ce481a-c17c-45fa-9c05-0b6a09699d8d service nova] Acquired lock "compute-rpcapi-router" {{(pid=116063) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} Dec 14 12:58:25.785476 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-eabe7830-c35c-4019-9ab7-63e751445398 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 12:58:25.786214 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-eabe7830-c35c-4019-9ab7-63e751445398 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 12:58:25.787256 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-eabe7830-c35c-4019-9ab7-63e751445398 None None] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 12:58:25.788391 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-eabe7830-c35c-4019-9ab7-63e751445398 None None] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 12:58:25.819894 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: INFO nova.compute.rpcapi [None req-eabe7830-c35c-4019-9ab7-63e751445398 None None] Automatically selected compute RPC version 6.0 from minimum service version 60 Dec 14 12:58:25.823353 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-eabe7830-c35c-4019-9ab7-63e751445398 None None] Releasing lock "compute-rpcapi-router" {{(pid=116063) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Dec 14 12:58:25.881818 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: INFO nova.api.openstack.requestlog [None req-eabe7830-c35c-4019-9ab7-63e751445398 None None] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.406559 Dec 14 12:58:25.886372 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: [pid: 116063|app: 0|req: 31/55] 10.222.0.49 () {64 vars in 1317 bytes} [Tue Dec 14 12:58:25 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 411 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 14 12:58:25.895975 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.api.openstack.wsgi [None req-27eb2c20-217b-4841-9579-f8dd76daf131 tempest-ServerRescueNegativeTestJSON-1573931620 tempest-ServerRescueNegativeTestJSON-1573931620-project] Calling method '>' {{(pid=116063) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 12:58:25.896901 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.compute.api [None req-27eb2c20-217b-4841-9579-f8dd76daf131 tempest-ServerRescueNegativeTestJSON-1573931620 tempest-ServerRescueNegativeTestJSON-1573931620-project] [instance: 60694e1e-d0cb-41c8-adf5-bdda49804385] Fetching instance by UUID {{(pid=116063) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 12:58:25.930177 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-27eb2c20-217b-4841-9579-f8dd76daf131 tempest-ServerRescueNegativeTestJSON-1573931620 tempest-ServerRescueNegativeTestJSON-1573931620-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 12:58:25.933166 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-27eb2c20-217b-4841-9579-f8dd76daf131 tempest-ServerRescueNegativeTestJSON-1573931620 tempest-ServerRescueNegativeTestJSON-1573931620-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.017s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 12:58:25.936075 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-27eb2c20-217b-4841-9579-f8dd76daf131 tempest-ServerRescueNegativeTestJSON-1573931620 tempest-ServerRescueNegativeTestJSON-1573931620-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 12:58:25.941416 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-27eb2c20-217b-4841-9579-f8dd76daf131 tempest-ServerRescueNegativeTestJSON-1573931620 tempest-ServerRescueNegativeTestJSON-1573931620-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 12:58:25.954968 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.policy [None req-373a468b-009b-44ef-bfef-6e48b6d8cdaf tempest-DeleteServersTestJSON-1329684180 tempest-DeleteServersTestJSON-1329684180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f4dc5a1bdfc4430b8fa39a5eec81f33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb24e38ec8e34dd9a93459b7ff9ba97a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116064) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 12:58:25.972881 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: INFO nova.api.openstack.requestlog [None req-373a468b-009b-44ef-bfef-6e48b6d8cdaf tempest-DeleteServersTestJSON-1329684180 tempest-DeleteServersTestJSON-1329684180-project] 10.222.0.49 "GET /compute/v2.1/servers/0632db38-ebd1-43c1-8ab9-04fbb19edfa7" status: 200 len: 1314 microversion: 2.1 time: 1.101805 Dec 14 12:58:25.973486 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: [pid: 116064|app: 0|req: 25/56] 10.222.0.49 () {58 vars in 1235 bytes} [Tue Dec 14 12:58:24 2021] GET /compute/v2.1/servers/0632db38-ebd1-43c1-8ab9-04fbb19edfa7 => generated 1314 bytes in 1103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 14 12:58:26.488587 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.api.openstack.wsgi [None req-b6053ba1-64d4-4100-ac1d-e034c9e549cb tempest-AttachVolumeNegativeTest-1000400951 tempest-AttachVolumeNegativeTest-1000400951-project] Calling method '>' {{(pid=116064) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 12:58:26.492171 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.compute.api [None req-b6053ba1-64d4-4100-ac1d-e034c9e549cb tempest-AttachVolumeNegativeTest-1000400951 tempest-AttachVolumeNegativeTest-1000400951-project] [instance: 824eca5b-954f-402d-aa22-14f24ddd77ba] Fetching instance by UUID {{(pid=116064) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 12:58:26.498655 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-b6053ba1-64d4-4100-ac1d-e034c9e549cb tempest-AttachVolumeNegativeTest-1000400951 tempest-AttachVolumeNegativeTest-1000400951-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 12:58:26.500145 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-b6053ba1-64d4-4100-ac1d-e034c9e549cb tempest-AttachVolumeNegativeTest-1000400951 tempest-AttachVolumeNegativeTest-1000400951-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 12:58:26.502228 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-b6053ba1-64d4-4100-ac1d-e034c9e549cb tempest-AttachVolumeNegativeTest-1000400951 tempest-AttachVolumeNegativeTest-1000400951-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 12:58:26.507392 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-b6053ba1-64d4-4100-ac1d-e034c9e549cb tempest-AttachVolumeNegativeTest-1000400951 tempest-AttachVolumeNegativeTest-1000400951-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 12:58:26.664366 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.policy [None req-27eb2c20-217b-4841-9579-f8dd76daf131 tempest-ServerRescueNegativeTestJSON-1573931620 tempest-ServerRescueNegativeTestJSON-1573931620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '731cbbfe17214ded8ac66299d66dfc45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '010919ea84eb4eb8b936c63153600eba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116063) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 12:58:26.675804 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: INFO nova.api.openstack.requestlog [None req-27eb2c20-217b-4841-9579-f8dd76daf131 tempest-ServerRescueNegativeTestJSON-1573931620 tempest-ServerRescueNegativeTestJSON-1573931620-project] 10.222.0.49 "GET /compute/v2.1/servers/60694e1e-d0cb-41c8-adf5-bdda49804385" status: 200 len: 1280 microversion: 2.1 time: 0.786835 Dec 14 12:58:26.688112 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: [pid: 116063|app: 0|req: 32/57] 10.222.0.49 () {58 vars in 1235 bytes} [Tue Dec 14 12:58:25 2021] GET /compute/v2.1/servers/60694e1e-d0cb-41c8-adf5-bdda49804385 => generated 1280 bytes in 800 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 14 12:58:26.989864 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.api.openstack.wsgi [None req-f7b363c4-89f8-420c-a728-48b479f14b6f tempest-DeleteServersTestJSON-1329684180 tempest-DeleteServersTestJSON-1329684180-project] Calling method '>' {{(pid=116063) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 12:58:26.990795 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.compute.api [None req-f7b363c4-89f8-420c-a728-48b479f14b6f tempest-DeleteServersTestJSON-1329684180 tempest-DeleteServersTestJSON-1329684180-project] [instance: 0632db38-ebd1-43c1-8ab9-04fbb19edfa7] Fetching instance by UUID {{(pid=116063) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 12:58:27.010131 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-f7b363c4-89f8-420c-a728-48b479f14b6f tempest-DeleteServersTestJSON-1329684180 tempest-DeleteServersTestJSON-1329684180-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 12:58:27.010741 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-f7b363c4-89f8-420c-a728-48b479f14b6f tempest-DeleteServersTestJSON-1329684180 tempest-DeleteServersTestJSON-1329684180-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 12:58:27.011684 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-f7b363c4-89f8-420c-a728-48b479f14b6f tempest-DeleteServersTestJSON-1329684180 tempest-DeleteServersTestJSON-1329684180-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 12:58:27.012120 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-f7b363c4-89f8-420c-a728-48b479f14b6f tempest-DeleteServersTestJSON-1329684180 tempest-DeleteServersTestJSON-1329684180-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 12:58:27.187276 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.policy [None req-b6053ba1-64d4-4100-ac1d-e034c9e549cb tempest-AttachVolumeNegativeTest-1000400951 tempest-AttachVolumeNegativeTest-1000400951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57d0ec01f0784c8ea87d339980bed3cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad27b8951cae4eeeafa257f45217653a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116064) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 12:58:27.201520 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: INFO nova.api.openstack.requestlog [None req-b6053ba1-64d4-4100-ac1d-e034c9e549cb tempest-AttachVolumeNegativeTest-1000400951 tempest-AttachVolumeNegativeTest-1000400951-project] 10.222.0.49 "GET /compute/v2.1/servers/824eca5b-954f-402d-aa22-14f24ddd77ba" status: 200 len: 1318 microversion: 2.1 time: 0.715519 Dec 14 12:58:27.202577 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: [pid: 116064|app: 0|req: 26/58] 10.222.0.49 () {58 vars in 1235 bytes} [Tue Dec 14 12:58:26 2021] GET /compute/v2.1/servers/824eca5b-954f-402d-aa22-14f24ddd77ba => generated 1318 bytes in 719 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 14 12:58:27.545100 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.policy [None req-f7b363c4-89f8-420c-a728-48b479f14b6f tempest-DeleteServersTestJSON-1329684180 tempest-DeleteServersTestJSON-1329684180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f4dc5a1bdfc4430b8fa39a5eec81f33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb24e38ec8e34dd9a93459b7ff9ba97a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116063) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 12:58:27.559219 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: INFO nova.api.openstack.requestlog [None req-f7b363c4-89f8-420c-a728-48b479f14b6f tempest-DeleteServersTestJSON-1329684180 tempest-DeleteServersTestJSON-1329684180-project] 10.222.0.49 "GET /compute/v2.1/servers/0632db38-ebd1-43c1-8ab9-04fbb19edfa7" status: 200 len: 1314 microversion: 2.1 time: 0.573017 Dec 14 12:58:27.576348 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: [pid: 116063|app: 0|req: 33/59] 10.222.0.49 () {58 vars in 1235 bytes} [Tue Dec 14 12:58:26 2021] GET /compute/v2.1/servers/0632db38-ebd1-43c1-8ab9-04fbb19edfa7 => generated 1314 bytes in 577 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 14 12:58:27.705439 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.api.openstack.wsgi [None req-c8979c8c-a170-4c64-a175-c6a41bcf4fff tempest-ServerRescueNegativeTestJSON-1573931620 tempest-ServerRescueNegativeTestJSON-1573931620-project] Calling method '>' {{(pid=116064) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 12:58:27.706408 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.compute.api [None req-c8979c8c-a170-4c64-a175-c6a41bcf4fff tempest-ServerRescueNegativeTestJSON-1573931620 tempest-ServerRescueNegativeTestJSON-1573931620-project] [instance: 60694e1e-d0cb-41c8-adf5-bdda49804385] Fetching instance by UUID {{(pid=116064) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 12:58:27.722027 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-c8979c8c-a170-4c64-a175-c6a41bcf4fff tempest-ServerRescueNegativeTestJSON-1573931620 tempest-ServerRescueNegativeTestJSON-1573931620-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 12:58:27.723151 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-c8979c8c-a170-4c64-a175-c6a41bcf4fff tempest-ServerRescueNegativeTestJSON-1573931620 tempest-ServerRescueNegativeTestJSON-1573931620-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 12:58:27.727239 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-c8979c8c-a170-4c64-a175-c6a41bcf4fff tempest-ServerRescueNegativeTestJSON-1573931620 tempest-ServerRescueNegativeTestJSON-1573931620-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 12:58:27.728892 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-c8979c8c-a170-4c64-a175-c6a41bcf4fff tempest-ServerRescueNegativeTestJSON-1573931620 tempest-ServerRescueNegativeTestJSON-1573931620-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 12:58:28.113617 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.api.openstack.wsgi [req-8b42ba5f-0625-437a-bbec-59a30fad4be6 req-3de8794d-59bb-4611-b51d-d8dc8bb5f2a4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "824eca5b-954f-402d-aa22-14f24ddd77ba", "tag": "11ccc809-2261-401d-8da3-2d48bb297543"}]} {{(pid=116063) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 14 12:58:28.116086 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 14 12:58:28.116086 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: warnings.warn(msg) Dec 14 12:58:28.126999 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.policy [None req-c8979c8c-a170-4c64-a175-c6a41bcf4fff tempest-ServerRescueNegativeTestJSON-1573931620 tempest-ServerRescueNegativeTestJSON-1573931620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '731cbbfe17214ded8ac66299d66dfc45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '010919ea84eb4eb8b936c63153600eba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116064) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 12:58:28.129439 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [req-8b42ba5f-0625-437a-bbec-59a30fad4be6 req-3de8794d-59bb-4611-b51d-d8dc8bb5f2a4 service nova] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 12:58:28.129887 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [req-8b42ba5f-0625-437a-bbec-59a30fad4be6 req-3de8794d-59bb-4611-b51d-d8dc8bb5f2a4 service nova] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 12:58:28.134926 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: INFO nova.api.openstack.requestlog [None req-c8979c8c-a170-4c64-a175-c6a41bcf4fff tempest-ServerRescueNegativeTestJSON-1573931620 tempest-ServerRescueNegativeTestJSON-1573931620-project] 10.222.0.49 "GET /compute/v2.1/servers/60694e1e-d0cb-41c8-adf5-bdda49804385" status: 200 len: 1322 microversion: 2.1 time: 0.433849 Dec 14 12:58:28.141936 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: [pid: 116064|app: 0|req: 27/60] 10.222.0.49 () {58 vars in 1235 bytes} [Tue Dec 14 12:58:27 2021] GET /compute/v2.1/servers/60694e1e-d0cb-41c8-adf5-bdda49804385 => generated 1322 bytes in 442 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 14 12:58:28.170531 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: INFO nova.api.openstack.compute.server_external_events [req-8b42ba5f-0625-437a-bbec-59a30fad4be6 req-3de8794d-59bb-4611-b51d-d8dc8bb5f2a4 service nova] Creating event network-changed:11ccc809-2261-401d-8da3-2d48bb297543 for instance 824eca5b-954f-402d-aa22-14f24ddd77ba on hv-cinder-78447 Dec 14 12:58:28.186972 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: INFO nova.api.openstack.requestlog [req-8b42ba5f-0625-437a-bbec-59a30fad4be6 req-3de8794d-59bb-4611-b51d-d8dc8bb5f2a4 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.081968 Dec 14 12:58:28.193601 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: [pid: 116063|app: 0|req: 34/61] 10.222.0.49 () {64 vars in 1317 bytes} [Tue Dec 14 12:58:28 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Dec 14 12:58:28.206932 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.api.openstack.wsgi [None req-a0c74c82-b243-4d8f-94c2-98a7f081cc95 tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-1882769978", "imageRef": "1733dcd4-5ded-44e1-8b8d-392adb05c67a", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "685eb097-be44-442e-9106-664041f3bdb2"}], "security_groups": [{"name": "tempest-securitygroup--105216444"}], "key_name": "tempest-keypair-1408201028", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=116064) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 14 12:58:28.221687 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.api.openstack.wsgi [None req-aafe46cf-d05d-4c42-8402-37d375c69ded tempest-AttachVolumeNegativeTest-1000400951 tempest-AttachVolumeNegativeTest-1000400951-project] Calling method '>' {{(pid=116063) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 12:58:28.222763 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.compute.api [None req-aafe46cf-d05d-4c42-8402-37d375c69ded tempest-AttachVolumeNegativeTest-1000400951 tempest-AttachVolumeNegativeTest-1000400951-project] [instance: 824eca5b-954f-402d-aa22-14f24ddd77ba] Fetching instance by UUID {{(pid=116063) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 12:58:28.233698 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-aafe46cf-d05d-4c42-8402-37d375c69ded tempest-AttachVolumeNegativeTest-1000400951 tempest-AttachVolumeNegativeTest-1000400951-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 12:58:28.235396 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-aafe46cf-d05d-4c42-8402-37d375c69ded tempest-AttachVolumeNegativeTest-1000400951 tempest-AttachVolumeNegativeTest-1000400951-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 12:58:28.238282 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-aafe46cf-d05d-4c42-8402-37d375c69ded tempest-AttachVolumeNegativeTest-1000400951 tempest-AttachVolumeNegativeTest-1000400951-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 12:58:28.238783 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-aafe46cf-d05d-4c42-8402-37d375c69ded tempest-AttachVolumeNegativeTest-1000400951 tempest-AttachVolumeNegativeTest-1000400951-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 12:58:28.404748 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.network.neutron [None req-a0c74c82-b243-4d8f-94c2-98a7f081cc95 tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] validate_networks() for [('685eb097-be44-442e-9106-664041f3bdb2', None, None, None, None, None)] {{(pid=116064) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Dec 14 12:58:28.550320 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.policy [None req-aafe46cf-d05d-4c42-8402-37d375c69ded tempest-AttachVolumeNegativeTest-1000400951 tempest-AttachVolumeNegativeTest-1000400951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57d0ec01f0784c8ea87d339980bed3cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad27b8951cae4eeeafa257f45217653a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116063) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 12:58:28.565615 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: INFO nova.api.openstack.requestlog [None req-aafe46cf-d05d-4c42-8402-37d375c69ded tempest-AttachVolumeNegativeTest-1000400951 tempest-AttachVolumeNegativeTest-1000400951-project] 10.222.0.49 "GET /compute/v2.1/servers/824eca5b-954f-402d-aa22-14f24ddd77ba" status: 200 len: 1318 microversion: 2.1 time: 0.347577 Dec 14 12:58:28.567802 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: [pid: 116063|app: 0|req: 35/62] 10.222.0.49 () {58 vars in 1235 bytes} [Tue Dec 14 12:58:28 2021] GET /compute/v2.1/servers/824eca5b-954f-402d-aa22-14f24ddd77ba => generated 1318 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 14 12:58:28.579252 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.api.openstack.wsgi [None req-d382535a-9718-4e46-8685-9248544e0243 tempest-DeleteServersTestJSON-1329684180 tempest-DeleteServersTestJSON-1329684180-project] Calling method '>' {{(pid=116063) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 12:58:28.579884 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.compute.api [None req-d382535a-9718-4e46-8685-9248544e0243 tempest-DeleteServersTestJSON-1329684180 tempest-DeleteServersTestJSON-1329684180-project] [instance: 0632db38-ebd1-43c1-8ab9-04fbb19edfa7] Fetching instance by UUID {{(pid=116063) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 12:58:28.598731 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-d382535a-9718-4e46-8685-9248544e0243 tempest-DeleteServersTestJSON-1329684180 tempest-DeleteServersTestJSON-1329684180-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 12:58:28.599507 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-d382535a-9718-4e46-8685-9248544e0243 tempest-DeleteServersTestJSON-1329684180 tempest-DeleteServersTestJSON-1329684180-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 12:58:28.600318 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-d382535a-9718-4e46-8685-9248544e0243 tempest-DeleteServersTestJSON-1329684180 tempest-DeleteServersTestJSON-1329684180-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 12:58:28.603333 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-d382535a-9718-4e46-8685-9248544e0243 tempest-DeleteServersTestJSON-1329684180 tempest-DeleteServersTestJSON-1329684180-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 12:58:29.065951 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.policy [None req-d382535a-9718-4e46-8685-9248544e0243 tempest-DeleteServersTestJSON-1329684180 tempest-DeleteServersTestJSON-1329684180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f4dc5a1bdfc4430b8fa39a5eec81f33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb24e38ec8e34dd9a93459b7ff9ba97a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116063) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 12:58:29.076300 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: INFO nova.api.openstack.requestlog [None req-d382535a-9718-4e46-8685-9248544e0243 tempest-DeleteServersTestJSON-1329684180 tempest-DeleteServersTestJSON-1329684180-project] 10.222.0.49 "GET /compute/v2.1/servers/0632db38-ebd1-43c1-8ab9-04fbb19edfa7" status: 200 len: 1314 microversion: 2.1 time: 0.502240 Dec 14 12:58:29.077522 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: [pid: 116063|app: 0|req: 36/63] 10.222.0.49 () {58 vars in 1235 bytes} [Tue Dec 14 12:58:28 2021] GET /compute/v2.1/servers/0632db38-ebd1-43c1-8ab9-04fbb19edfa7 => generated 1314 bytes in 504 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 14 12:58:29.092921 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.virt.hardware [None req-a0c74c82-b243-4d8f-94c2-98a7f081cc95 tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] Flavor limits 0:0:0 {{(pid=116064) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Dec 14 12:58:29.093357 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.virt.hardware [None req-a0c74c82-b243-4d8f-94c2-98a7f081cc95 tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] Image limits 0:0:0 {{(pid=116064) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Dec 14 12:58:29.093830 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.virt.hardware [None req-a0c74c82-b243-4d8f-94c2-98a7f081cc95 tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] Flavor pref 0:0:0 {{(pid=116064) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Dec 14 12:58:29.094240 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.virt.hardware [None req-a0c74c82-b243-4d8f-94c2-98a7f081cc95 tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] Image pref 0:0:0 {{(pid=116064) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Dec 14 12:58:29.094656 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.virt.hardware [None req-a0c74c82-b243-4d8f-94c2-98a7f081cc95 tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=116064) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Dec 14 12:58:29.103368 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-a0c74c82-b243-4d8f-94c2-98a7f081cc95 tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 12:58:29.104156 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-a0c74c82-b243-4d8f-94c2-98a7f081cc95 tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 12:58:29.105152 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-a0c74c82-b243-4d8f-94c2-98a7f081cc95 tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 12:58:29.107675 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-a0c74c82-b243-4d8f-94c2-98a7f081cc95 tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 12:58:29.124646 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.quota [None req-a0c74c82-b243-4d8f-94c2-98a7f081cc95 tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] Getting quotas for project 68a8770b8dbe489a8119016fbee64eb5. Resources: {'cores', 'instances', 'ram'} {{(pid=116064) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 14 12:58:29.129023 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.quota [None req-a0c74c82-b243-4d8f-94c2-98a7f081cc95 tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] Getting quotas for user 79d74a2ea1e541d28d085c15cec34032 and project 68a8770b8dbe489a8119016fbee64eb5. Resources: {'cores', 'instances', 'ram'} {{(pid=116064) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 14 12:58:29.140627 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.compute.api [None req-a0c74c82-b243-4d8f-94c2-98a7f081cc95 tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] Going to run 1 instances... {{(pid=116064) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Dec 14 12:58:29.143395 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.compute.api [None req-a0c74c82-b243-4d8f-94c2-98a7f081cc95 tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] [instance: c8de7730-62f2-4a77-b1e9-cf6a74fa366d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='1733dcd4-5ded-44e1-8b8d-392adb05c67a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=116064) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Dec 14 12:58:29.158226 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.api.openstack.wsgi [None req-6a2555ff-059c-4d58-92d9-07bb0e53f377 tempest-ServerRescueNegativeTestJSON-1573931620 tempest-ServerRescueNegativeTestJSON-1573931620-project] Calling method '>' {{(pid=116063) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 12:58:29.159310 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.compute.api [None req-6a2555ff-059c-4d58-92d9-07bb0e53f377 tempest-ServerRescueNegativeTestJSON-1573931620 tempest-ServerRescueNegativeTestJSON-1573931620-project] [instance: 60694e1e-d0cb-41c8-adf5-bdda49804385] Fetching instance by UUID {{(pid=116063) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 12:58:29.180088 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-6a2555ff-059c-4d58-92d9-07bb0e53f377 tempest-ServerRescueNegativeTestJSON-1573931620 tempest-ServerRescueNegativeTestJSON-1573931620-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 12:58:29.180552 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-6a2555ff-059c-4d58-92d9-07bb0e53f377 tempest-ServerRescueNegativeTestJSON-1573931620 tempest-ServerRescueNegativeTestJSON-1573931620-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 12:58:29.184262 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-6a2555ff-059c-4d58-92d9-07bb0e53f377 tempest-ServerRescueNegativeTestJSON-1573931620 tempest-ServerRescueNegativeTestJSON-1573931620-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 12:58:29.185986 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-6a2555ff-059c-4d58-92d9-07bb0e53f377 tempest-ServerRescueNegativeTestJSON-1573931620 tempest-ServerRescueNegativeTestJSON-1573931620-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 12:58:29.198117 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: INFO nova.api.openstack.requestlog [None req-a0c74c82-b243-4d8f-94c2-98a7f081cc95 tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] 10.222.0.49 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.20 time: 0.996026 Dec 14 12:58:29.200956 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: [pid: 116064|app: 0|req: 28/64] 10.222.0.49 () {62 vars in 1187 bytes} [Tue Dec 14 12:58:28 2021] POST /compute/v2.1/servers => generated 401 bytes in 1000 msecs (HTTP/1.1 202) 10 headers in 453 bytes (2 switches on core 0) Dec 14 12:58:29.212052 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.api.openstack.wsgi [None req-c21f2a3d-5742-4faa-ab19-b19bd5a4b1eb tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] Calling method '>' {{(pid=116064) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 12:58:29.213516 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.compute.api [None req-c21f2a3d-5742-4faa-ab19-b19bd5a4b1eb tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] [instance: c8de7730-62f2-4a77-b1e9-cf6a74fa366d] Fetching instance by UUID {{(pid=116064) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 12:58:29.332658 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.policy [None req-c21f2a3d-5742-4faa-ab19-b19bd5a4b1eb tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79d74a2ea1e541d28d085c15cec34032', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68a8770b8dbe489a8119016fbee64eb5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116064) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 12:58:29.341680 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.policy [None req-c21f2a3d-5742-4faa-ab19-b19bd5a4b1eb tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '79d74a2ea1e541d28d085c15cec34032', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68a8770b8dbe489a8119016fbee64eb5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116064) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 12:58:29.343629 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.policy [None req-c21f2a3d-5742-4faa-ab19-b19bd5a4b1eb tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '79d74a2ea1e541d28d085c15cec34032', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68a8770b8dbe489a8119016fbee64eb5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116064) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 12:58:29.345048 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: INFO nova.api.openstack.requestlog [None req-c21f2a3d-5742-4faa-ab19-b19bd5a4b1eb tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] 10.222.0.49 "GET /compute/v2.1/servers/c8de7730-62f2-4a77-b1e9-cf6a74fa366d" status: 200 len: 1282 microversion: 2.20 time: 0.139769 Dec 14 12:58:29.346309 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: [pid: 116064|app: 0|req: 29/65] 10.222.0.49 () {60 vars in 1276 bytes} [Tue Dec 14 12:58:29 2021] GET /compute/v2.1/servers/c8de7730-62f2-4a77-b1e9-cf6a74fa366d => generated 1282 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 14 12:58:29.586386 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.api.openstack.wsgi [None req-d77dcbb7-a0b4-4170-999e-2d5f60a8b5a6 tempest-AttachVolumeNegativeTest-1000400951 tempest-AttachVolumeNegativeTest-1000400951-project] Calling method '>' {{(pid=116064) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 12:58:29.587454 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.compute.api [None req-d77dcbb7-a0b4-4170-999e-2d5f60a8b5a6 tempest-AttachVolumeNegativeTest-1000400951 tempest-AttachVolumeNegativeTest-1000400951-project] [instance: 824eca5b-954f-402d-aa22-14f24ddd77ba] Fetching instance by UUID {{(pid=116064) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 12:58:29.598748 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-d77dcbb7-a0b4-4170-999e-2d5f60a8b5a6 tempest-AttachVolumeNegativeTest-1000400951 tempest-AttachVolumeNegativeTest-1000400951-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 12:58:29.607301 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-d77dcbb7-a0b4-4170-999e-2d5f60a8b5a6 tempest-AttachVolumeNegativeTest-1000400951 tempest-AttachVolumeNegativeTest-1000400951-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 12:58:29.607301 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-d77dcbb7-a0b4-4170-999e-2d5f60a8b5a6 tempest-AttachVolumeNegativeTest-1000400951 tempest-AttachVolumeNegativeTest-1000400951-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 12:58:29.607301 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-d77dcbb7-a0b4-4170-999e-2d5f60a8b5a6 tempest-AttachVolumeNegativeTest-1000400951 tempest-AttachVolumeNegativeTest-1000400951-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 12:58:29.975502 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.policy [None req-6a2555ff-059c-4d58-92d9-07bb0e53f377 tempest-ServerRescueNegativeTestJSON-1573931620 tempest-ServerRescueNegativeTestJSON-1573931620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '731cbbfe17214ded8ac66299d66dfc45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '010919ea84eb4eb8b936c63153600eba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116063) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 12:58:29.985265 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: INFO nova.api.openstack.requestlog [None req-6a2555ff-059c-4d58-92d9-07bb0e53f377 tempest-ServerRescueNegativeTestJSON-1573931620 tempest-ServerRescueNegativeTestJSON-1573931620-project] 10.222.0.49 "GET /compute/v2.1/servers/60694e1e-d0cb-41c8-adf5-bdda49804385" status: 200 len: 1322 microversion: 2.1 time: 0.831048 Dec 14 12:58:29.986615 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: [pid: 116063|app: 0|req: 37/66] 10.222.0.49 () {58 vars in 1235 bytes} [Tue Dec 14 12:58:29 2021] GET /compute/v2.1/servers/60694e1e-d0cb-41c8-adf5-bdda49804385 => generated 1322 bytes in 833 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 14 12:58:30.093323 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.api.openstack.wsgi [None req-eb2752c2-b5a5-4f5c-b161-78fae6578492 tempest-DeleteServersTestJSON-1329684180 tempest-DeleteServersTestJSON-1329684180-project] Calling method '>' {{(pid=116063) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 12:58:30.094861 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.compute.api [None req-eb2752c2-b5a5-4f5c-b161-78fae6578492 tempest-DeleteServersTestJSON-1329684180 tempest-DeleteServersTestJSON-1329684180-project] [instance: 0632db38-ebd1-43c1-8ab9-04fbb19edfa7] Fetching instance by UUID {{(pid=116063) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 12:58:30.101719 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-eb2752c2-b5a5-4f5c-b161-78fae6578492 tempest-DeleteServersTestJSON-1329684180 tempest-DeleteServersTestJSON-1329684180-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 12:58:30.102178 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-eb2752c2-b5a5-4f5c-b161-78fae6578492 tempest-DeleteServersTestJSON-1329684180 tempest-DeleteServersTestJSON-1329684180-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 12:58:30.102954 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-eb2752c2-b5a5-4f5c-b161-78fae6578492 tempest-DeleteServersTestJSON-1329684180 tempest-DeleteServersTestJSON-1329684180-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 12:58:30.103418 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-eb2752c2-b5a5-4f5c-b161-78fae6578492 tempest-DeleteServersTestJSON-1329684180 tempest-DeleteServersTestJSON-1329684180-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 12:58:30.287971 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.policy [None req-d77dcbb7-a0b4-4170-999e-2d5f60a8b5a6 tempest-AttachVolumeNegativeTest-1000400951 tempest-AttachVolumeNegativeTest-1000400951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57d0ec01f0784c8ea87d339980bed3cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad27b8951cae4eeeafa257f45217653a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116064) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 12:58:30.298711 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: INFO nova.api.openstack.requestlog [None req-d77dcbb7-a0b4-4170-999e-2d5f60a8b5a6 tempest-AttachVolumeNegativeTest-1000400951 tempest-AttachVolumeNegativeTest-1000400951-project] 10.222.0.49 "GET /compute/v2.1/servers/824eca5b-954f-402d-aa22-14f24ddd77ba" status: 200 len: 1318 microversion: 2.1 time: 0.717715 Dec 14 12:58:30.300119 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: [pid: 116064|app: 0|req: 30/67] 10.222.0.49 () {58 vars in 1235 bytes} [Tue Dec 14 12:58:29 2021] GET /compute/v2.1/servers/824eca5b-954f-402d-aa22-14f24ddd77ba => generated 1318 bytes in 720 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 14 12:58:30.363805 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.api.openstack.wsgi [None req-5a222609-947f-4b27-bf16-e88cbe1ac336 tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] Calling method '>' {{(pid=116064) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 12:58:30.364516 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.compute.api [None req-5a222609-947f-4b27-bf16-e88cbe1ac336 tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] [instance: c8de7730-62f2-4a77-b1e9-cf6a74fa366d] Fetching instance by UUID {{(pid=116064) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 12:58:30.373568 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-5a222609-947f-4b27-bf16-e88cbe1ac336 tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 12:58:30.374037 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-5a222609-947f-4b27-bf16-e88cbe1ac336 tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 12:58:30.374837 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-5a222609-947f-4b27-bf16-e88cbe1ac336 tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 12:58:30.376555 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-5a222609-947f-4b27-bf16-e88cbe1ac336 tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 12:58:30.498415 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.policy [None req-5a222609-947f-4b27-bf16-e88cbe1ac336 tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79d74a2ea1e541d28d085c15cec34032', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68a8770b8dbe489a8119016fbee64eb5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116064) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 12:58:30.514508 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.policy [None req-5a222609-947f-4b27-bf16-e88cbe1ac336 tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '79d74a2ea1e541d28d085c15cec34032', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68a8770b8dbe489a8119016fbee64eb5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116064) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 12:58:30.515947 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.policy [None req-5a222609-947f-4b27-bf16-e88cbe1ac336 tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '79d74a2ea1e541d28d085c15cec34032', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68a8770b8dbe489a8119016fbee64eb5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116064) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 12:58:30.517132 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: INFO nova.api.openstack.requestlog [None req-5a222609-947f-4b27-bf16-e88cbe1ac336 tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] 10.222.0.49 "GET /compute/v2.1/servers/c8de7730-62f2-4a77-b1e9-cf6a74fa366d" status: 200 len: 1342 microversion: 2.20 time: 0.157324 Dec 14 12:58:30.517707 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: [pid: 116064|app: 0|req: 31/68] 10.222.0.49 () {60 vars in 1276 bytes} [Tue Dec 14 12:58:30 2021] GET /compute/v2.1/servers/c8de7730-62f2-4a77-b1e9-cf6a74fa366d => generated 1342 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Dec 14 12:58:30.533009 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.policy [None req-eb2752c2-b5a5-4f5c-b161-78fae6578492 tempest-DeleteServersTestJSON-1329684180 tempest-DeleteServersTestJSON-1329684180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f4dc5a1bdfc4430b8fa39a5eec81f33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb24e38ec8e34dd9a93459b7ff9ba97a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116063) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 12:58:30.558952 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: INFO nova.api.openstack.requestlog [None req-eb2752c2-b5a5-4f5c-b161-78fae6578492 tempest-DeleteServersTestJSON-1329684180 tempest-DeleteServersTestJSON-1329684180-project] 10.222.0.49 "GET /compute/v2.1/servers/0632db38-ebd1-43c1-8ab9-04fbb19edfa7" status: 200 len: 1314 microversion: 2.1 time: 0.469619 Dec 14 12:58:30.562332 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: [pid: 116063|app: 0|req: 38/69] 10.222.0.49 () {58 vars in 1235 bytes} [Tue Dec 14 12:58:30 2021] GET /compute/v2.1/servers/0632db38-ebd1-43c1-8ab9-04fbb19edfa7 => generated 1314 bytes in 474 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 14 12:58:31.002284 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.api.openstack.wsgi [None req-0d656c7d-8d27-4bef-8d82-c65e2e0284fc tempest-ServerRescueNegativeTestJSON-1573931620 tempest-ServerRescueNegativeTestJSON-1573931620-project] Calling method '>' {{(pid=116064) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 12:58:31.002903 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.compute.api [None req-0d656c7d-8d27-4bef-8d82-c65e2e0284fc tempest-ServerRescueNegativeTestJSON-1573931620 tempest-ServerRescueNegativeTestJSON-1573931620-project] [instance: 60694e1e-d0cb-41c8-adf5-bdda49804385] Fetching instance by UUID {{(pid=116064) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 12:58:31.010001 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-0d656c7d-8d27-4bef-8d82-c65e2e0284fc tempest-ServerRescueNegativeTestJSON-1573931620 tempest-ServerRescueNegativeTestJSON-1573931620-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 12:58:31.010663 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-0d656c7d-8d27-4bef-8d82-c65e2e0284fc tempest-ServerRescueNegativeTestJSON-1573931620 tempest-ServerRescueNegativeTestJSON-1573931620-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 12:58:31.011654 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-0d656c7d-8d27-4bef-8d82-c65e2e0284fc tempest-ServerRescueNegativeTestJSON-1573931620 tempest-ServerRescueNegativeTestJSON-1573931620-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 12:58:31.012602 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-0d656c7d-8d27-4bef-8d82-c65e2e0284fc tempest-ServerRescueNegativeTestJSON-1573931620 tempest-ServerRescueNegativeTestJSON-1573931620-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 12:58:31.161244 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.policy [None req-0d656c7d-8d27-4bef-8d82-c65e2e0284fc tempest-ServerRescueNegativeTestJSON-1573931620 tempest-ServerRescueNegativeTestJSON-1573931620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '731cbbfe17214ded8ac66299d66dfc45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '010919ea84eb4eb8b936c63153600eba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116064) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 12:58:31.169007 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: INFO nova.api.openstack.requestlog [None req-0d656c7d-8d27-4bef-8d82-c65e2e0284fc tempest-ServerRescueNegativeTestJSON-1573931620 tempest-ServerRescueNegativeTestJSON-1573931620-project] 10.222.0.49 "GET /compute/v2.1/servers/60694e1e-d0cb-41c8-adf5-bdda49804385" status: 200 len: 1322 microversion: 2.1 time: 0.170324 Dec 14 12:58:31.169781 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: [pid: 116064|app: 0|req: 32/70] 10.222.0.49 () {58 vars in 1235 bytes} [Tue Dec 14 12:58:30 2021] GET /compute/v2.1/servers/60694e1e-d0cb-41c8-adf5-bdda49804385 => generated 1322 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 14 12:58:31.320145 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.api.openstack.wsgi [None req-4b43677c-0157-41a5-9c20-80c6d4886a1f tempest-AttachVolumeNegativeTest-1000400951 tempest-AttachVolumeNegativeTest-1000400951-project] Calling method '>' {{(pid=116063) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 12:58:31.321296 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.compute.api [None req-4b43677c-0157-41a5-9c20-80c6d4886a1f tempest-AttachVolumeNegativeTest-1000400951 tempest-AttachVolumeNegativeTest-1000400951-project] [instance: 824eca5b-954f-402d-aa22-14f24ddd77ba] Fetching instance by UUID {{(pid=116063) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 12:58:31.333359 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-4b43677c-0157-41a5-9c20-80c6d4886a1f tempest-AttachVolumeNegativeTest-1000400951 tempest-AttachVolumeNegativeTest-1000400951-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 12:58:31.334507 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-4b43677c-0157-41a5-9c20-80c6d4886a1f tempest-AttachVolumeNegativeTest-1000400951 tempest-AttachVolumeNegativeTest-1000400951-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 12:58:31.335972 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-4b43677c-0157-41a5-9c20-80c6d4886a1f tempest-AttachVolumeNegativeTest-1000400951 tempest-AttachVolumeNegativeTest-1000400951-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 12:58:31.336937 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-4b43677c-0157-41a5-9c20-80c6d4886a1f tempest-AttachVolumeNegativeTest-1000400951 tempest-AttachVolumeNegativeTest-1000400951-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 12:58:31.538043 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.api.openstack.wsgi [None req-bc17b6fb-1994-414d-9539-ffea2c2664d0 tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] Calling method '>' {{(pid=116064) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 12:58:31.538629 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.compute.api [None req-bc17b6fb-1994-414d-9539-ffea2c2664d0 tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] [instance: c8de7730-62f2-4a77-b1e9-cf6a74fa366d] Fetching instance by UUID {{(pid=116064) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 12:58:31.570039 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-bc17b6fb-1994-414d-9539-ffea2c2664d0 tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 12:58:31.570549 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-bc17b6fb-1994-414d-9539-ffea2c2664d0 tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 12:58:31.577467 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-bc17b6fb-1994-414d-9539-ffea2c2664d0 tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 12:58:31.578449 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-bc17b6fb-1994-414d-9539-ffea2c2664d0 tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 12:58:31.610075 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.policy [None req-4b43677c-0157-41a5-9c20-80c6d4886a1f tempest-AttachVolumeNegativeTest-1000400951 tempest-AttachVolumeNegativeTest-1000400951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57d0ec01f0784c8ea87d339980bed3cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad27b8951cae4eeeafa257f45217653a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116063) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 12:58:31.622973 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: INFO nova.api.openstack.requestlog [None req-4b43677c-0157-41a5-9c20-80c6d4886a1f tempest-AttachVolumeNegativeTest-1000400951 tempest-AttachVolumeNegativeTest-1000400951-project] 10.222.0.49 "GET /compute/v2.1/servers/824eca5b-954f-402d-aa22-14f24ddd77ba" status: 200 len: 1318 microversion: 2.1 time: 0.309528 Dec 14 12:58:31.639571 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: [pid: 116063|app: 0|req: 39/71] 10.222.0.49 () {58 vars in 1235 bytes} [Tue Dec 14 12:58:31 2021] GET /compute/v2.1/servers/824eca5b-954f-402d-aa22-14f24ddd77ba => generated 1318 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 14 12:58:31.651206 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.api.openstack.wsgi [None req-3b7bb2aa-e17a-432f-974a-f62440bb29ff tempest-DeleteServersTestJSON-1329684180 tempest-DeleteServersTestJSON-1329684180-project] Calling method '>' {{(pid=116063) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 12:58:31.652951 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.compute.api [None req-3b7bb2aa-e17a-432f-974a-f62440bb29ff tempest-DeleteServersTestJSON-1329684180 tempest-DeleteServersTestJSON-1329684180-project] [instance: 0632db38-ebd1-43c1-8ab9-04fbb19edfa7] Fetching instance by UUID {{(pid=116063) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 12:58:31.662327 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-3b7bb2aa-e17a-432f-974a-f62440bb29ff tempest-DeleteServersTestJSON-1329684180 tempest-DeleteServersTestJSON-1329684180-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 12:58:31.663369 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-3b7bb2aa-e17a-432f-974a-f62440bb29ff tempest-DeleteServersTestJSON-1329684180 tempest-DeleteServersTestJSON-1329684180-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 12:58:31.665205 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-3b7bb2aa-e17a-432f-974a-f62440bb29ff tempest-DeleteServersTestJSON-1329684180 tempest-DeleteServersTestJSON-1329684180-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 12:58:31.665842 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-3b7bb2aa-e17a-432f-974a-f62440bb29ff tempest-DeleteServersTestJSON-1329684180 tempest-DeleteServersTestJSON-1329684180-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 12:58:31.741704 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.policy [None req-bc17b6fb-1994-414d-9539-ffea2c2664d0 tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79d74a2ea1e541d28d085c15cec34032', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68a8770b8dbe489a8119016fbee64eb5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116064) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 12:58:31.751530 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.policy [None req-bc17b6fb-1994-414d-9539-ffea2c2664d0 tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '79d74a2ea1e541d28d085c15cec34032', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68a8770b8dbe489a8119016fbee64eb5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116064) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 12:58:31.753169 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.policy [None req-bc17b6fb-1994-414d-9539-ffea2c2664d0 tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '79d74a2ea1e541d28d085c15cec34032', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68a8770b8dbe489a8119016fbee64eb5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116064) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 12:58:31.754390 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: INFO nova.api.openstack.requestlog [None req-bc17b6fb-1994-414d-9539-ffea2c2664d0 tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] 10.222.0.49 "GET /compute/v2.1/servers/c8de7730-62f2-4a77-b1e9-cf6a74fa366d" status: 200 len: 1340 microversion: 2.20 time: 0.222156 Dec 14 12:58:31.755279 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: [pid: 116064|app: 0|req: 33/72] 10.222.0.49 () {60 vars in 1276 bytes} [Tue Dec 14 12:58:31 2021] GET /compute/v2.1/servers/c8de7730-62f2-4a77-b1e9-cf6a74fa366d => generated 1340 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 14 12:58:32.119007 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.policy [None req-3b7bb2aa-e17a-432f-974a-f62440bb29ff tempest-DeleteServersTestJSON-1329684180 tempest-DeleteServersTestJSON-1329684180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f4dc5a1bdfc4430b8fa39a5eec81f33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb24e38ec8e34dd9a93459b7ff9ba97a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116063) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 12:58:32.127970 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: INFO nova.api.openstack.requestlog [None req-3b7bb2aa-e17a-432f-974a-f62440bb29ff tempest-DeleteServersTestJSON-1329684180 tempest-DeleteServersTestJSON-1329684180-project] 10.222.0.49 "GET /compute/v2.1/servers/0632db38-ebd1-43c1-8ab9-04fbb19edfa7" status: 200 len: 1314 microversion: 2.1 time: 0.487028 Dec 14 12:58:32.128556 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: [pid: 116063|app: 0|req: 40/73] 10.222.0.49 () {58 vars in 1235 bytes} [Tue Dec 14 12:58:31 2021] GET /compute/v2.1/servers/0632db38-ebd1-43c1-8ab9-04fbb19edfa7 => generated 1314 bytes in 488 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 14 12:58:32.187758 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.api.openstack.wsgi [None req-e5c88be5-a4e7-450f-a068-0371fc2f206b tempest-ServerRescueNegativeTestJSON-1573931620 tempest-ServerRescueNegativeTestJSON-1573931620-project] Calling method '>' {{(pid=116064) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 12:58:32.188435 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.compute.api [None req-e5c88be5-a4e7-450f-a068-0371fc2f206b tempest-ServerRescueNegativeTestJSON-1573931620 tempest-ServerRescueNegativeTestJSON-1573931620-project] [instance: 60694e1e-d0cb-41c8-adf5-bdda49804385] Fetching instance by UUID {{(pid=116064) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 12:58:32.198351 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-e5c88be5-a4e7-450f-a068-0371fc2f206b tempest-ServerRescueNegativeTestJSON-1573931620 tempest-ServerRescueNegativeTestJSON-1573931620-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 12:58:32.198867 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-e5c88be5-a4e7-450f-a068-0371fc2f206b tempest-ServerRescueNegativeTestJSON-1573931620 tempest-ServerRescueNegativeTestJSON-1573931620-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 12:58:32.199689 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-e5c88be5-a4e7-450f-a068-0371fc2f206b tempest-ServerRescueNegativeTestJSON-1573931620 tempest-ServerRescueNegativeTestJSON-1573931620-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 12:58:32.202813 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-e5c88be5-a4e7-450f-a068-0371fc2f206b tempest-ServerRescueNegativeTestJSON-1573931620 tempest-ServerRescueNegativeTestJSON-1573931620-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 12:58:32.491433 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.policy [None req-e5c88be5-a4e7-450f-a068-0371fc2f206b tempest-ServerRescueNegativeTestJSON-1573931620 tempest-ServerRescueNegativeTestJSON-1573931620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '731cbbfe17214ded8ac66299d66dfc45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '010919ea84eb4eb8b936c63153600eba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116064) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 12:58:32.503697 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: INFO nova.api.openstack.requestlog [None req-e5c88be5-a4e7-450f-a068-0371fc2f206b tempest-ServerRescueNegativeTestJSON-1573931620 tempest-ServerRescueNegativeTestJSON-1573931620-project] 10.222.0.49 "GET /compute/v2.1/servers/60694e1e-d0cb-41c8-adf5-bdda49804385" status: 200 len: 1322 microversion: 2.1 time: 0.318589 Dec 14 12:58:32.504319 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: [pid: 116064|app: 0|req: 34/74] 10.222.0.49 () {58 vars in 1235 bytes} [Tue Dec 14 12:58:32 2021] GET /compute/v2.1/servers/60694e1e-d0cb-41c8-adf5-bdda49804385 => generated 1322 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 14 12:58:32.546062 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.api.openstack.wsgi [req-add2857c-8f49-4c84-8ca7-bedd5b2e1345 req-c147d8bf-d24e-4b74-a94e-9d2565d6ab53 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "60694e1e-d0cb-41c8-adf5-bdda49804385", "tag": "dc3fb812-3df8-4cc0-9829-c46ef1394592"}]} {{(pid=116063) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 14 12:58:32.548342 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 14 12:58:32.548342 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: warnings.warn(msg) Dec 14 12:58:32.566304 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [req-add2857c-8f49-4c84-8ca7-bedd5b2e1345 req-c147d8bf-d24e-4b74-a94e-9d2565d6ab53 service nova] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 12:58:32.566842 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [req-add2857c-8f49-4c84-8ca7-bedd5b2e1345 req-c147d8bf-d24e-4b74-a94e-9d2565d6ab53 service nova] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 12:58:32.588497 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: INFO nova.api.openstack.compute.server_external_events [req-add2857c-8f49-4c84-8ca7-bedd5b2e1345 req-c147d8bf-d24e-4b74-a94e-9d2565d6ab53 service nova] Creating event network-changed:dc3fb812-3df8-4cc0-9829-c46ef1394592 for instance 60694e1e-d0cb-41c8-adf5-bdda49804385 on hv-cinder-78447 Dec 14 12:58:32.596708 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: INFO nova.api.openstack.requestlog [req-add2857c-8f49-4c84-8ca7-bedd5b2e1345 req-c147d8bf-d24e-4b74-a94e-9d2565d6ab53 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.052596 Dec 14 12:58:32.597499 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: [pid: 116063|app: 0|req: 41/75] 10.222.0.49 () {64 vars in 1317 bytes} [Tue Dec 14 12:58:32 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 14 12:58:32.642957 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.api.openstack.wsgi [None req-a8b33d72-9c5b-430b-a4b1-a815094bd587 tempest-AttachVolumeNegativeTest-1000400951 tempest-AttachVolumeNegativeTest-1000400951-project] Calling method '>' {{(pid=116064) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 12:58:32.645408 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.compute.api [None req-a8b33d72-9c5b-430b-a4b1-a815094bd587 tempest-AttachVolumeNegativeTest-1000400951 tempest-AttachVolumeNegativeTest-1000400951-project] [instance: 824eca5b-954f-402d-aa22-14f24ddd77ba] Fetching instance by UUID {{(pid=116064) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 12:58:32.653611 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-a8b33d72-9c5b-430b-a4b1-a815094bd587 tempest-AttachVolumeNegativeTest-1000400951 tempest-AttachVolumeNegativeTest-1000400951-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 12:58:32.655924 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-a8b33d72-9c5b-430b-a4b1-a815094bd587 tempest-AttachVolumeNegativeTest-1000400951 tempest-AttachVolumeNegativeTest-1000400951-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 12:58:32.658474 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-a8b33d72-9c5b-430b-a4b1-a815094bd587 tempest-AttachVolumeNegativeTest-1000400951 tempest-AttachVolumeNegativeTest-1000400951-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 12:58:32.659259 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-a8b33d72-9c5b-430b-a4b1-a815094bd587 tempest-AttachVolumeNegativeTest-1000400951 tempest-AttachVolumeNegativeTest-1000400951-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 12:58:32.773822 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.api.openstack.wsgi [None req-e877e79a-b26d-48f1-979b-5406749aed86 tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] Calling method '>' {{(pid=116063) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 12:58:32.775313 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.compute.api [None req-e877e79a-b26d-48f1-979b-5406749aed86 tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] [instance: c8de7730-62f2-4a77-b1e9-cf6a74fa366d] Fetching instance by UUID {{(pid=116063) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 12:58:32.786489 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-e877e79a-b26d-48f1-979b-5406749aed86 tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 12:58:32.789027 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-e877e79a-b26d-48f1-979b-5406749aed86 tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 12:58:32.790562 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-e877e79a-b26d-48f1-979b-5406749aed86 tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 12:58:32.791928 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-e877e79a-b26d-48f1-979b-5406749aed86 tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 12:58:33.007889 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.policy [None req-e877e79a-b26d-48f1-979b-5406749aed86 tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79d74a2ea1e541d28d085c15cec34032', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68a8770b8dbe489a8119016fbee64eb5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116063) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 12:58:33.023590 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.policy [None req-e877e79a-b26d-48f1-979b-5406749aed86 tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '79d74a2ea1e541d28d085c15cec34032', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68a8770b8dbe489a8119016fbee64eb5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116063) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 12:58:33.025849 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.policy [None req-e877e79a-b26d-48f1-979b-5406749aed86 tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '79d74a2ea1e541d28d085c15cec34032', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68a8770b8dbe489a8119016fbee64eb5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116063) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 12:58:33.031209 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: INFO nova.api.openstack.requestlog [None req-e877e79a-b26d-48f1-979b-5406749aed86 tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] 10.222.0.49 "GET /compute/v2.1/servers/c8de7730-62f2-4a77-b1e9-cf6a74fa366d" status: 200 len: 1340 microversion: 2.20 time: 0.261527 Dec 14 12:58:33.034100 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: [pid: 116063|app: 0|req: 42/76] 10.222.0.49 () {60 vars in 1276 bytes} [Tue Dec 14 12:58:32 2021] GET /compute/v2.1/servers/c8de7730-62f2-4a77-b1e9-cf6a74fa366d => generated 1340 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Dec 14 12:58:33.115750 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.policy [None req-a8b33d72-9c5b-430b-a4b1-a815094bd587 tempest-AttachVolumeNegativeTest-1000400951 tempest-AttachVolumeNegativeTest-1000400951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57d0ec01f0784c8ea87d339980bed3cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad27b8951cae4eeeafa257f45217653a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116064) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 12:58:33.128448 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: INFO nova.api.openstack.requestlog [None req-a8b33d72-9c5b-430b-a4b1-a815094bd587 tempest-AttachVolumeNegativeTest-1000400951 tempest-AttachVolumeNegativeTest-1000400951-project] 10.222.0.49 "GET /compute/v2.1/servers/824eca5b-954f-402d-aa22-14f24ddd77ba" status: 200 len: 1318 microversion: 2.1 time: 0.489516 Dec 14 12:58:33.129314 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: [pid: 116064|app: 0|req: 35/77] 10.222.0.49 () {58 vars in 1235 bytes} [Tue Dec 14 12:58:32 2021] GET /compute/v2.1/servers/824eca5b-954f-402d-aa22-14f24ddd77ba => generated 1318 bytes in 491 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 14 12:58:33.148390 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.api.openstack.wsgi [None req-3d713bd2-93d2-423b-baa2-484156f86fc8 tempest-DeleteServersTestJSON-1329684180 tempest-DeleteServersTestJSON-1329684180-project] Calling method '>' {{(pid=116063) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 12:58:33.149099 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.compute.api [None req-3d713bd2-93d2-423b-baa2-484156f86fc8 tempest-DeleteServersTestJSON-1329684180 tempest-DeleteServersTestJSON-1329684180-project] [instance: 0632db38-ebd1-43c1-8ab9-04fbb19edfa7] Fetching instance by UUID {{(pid=116063) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 12:58:33.158899 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-3d713bd2-93d2-423b-baa2-484156f86fc8 tempest-DeleteServersTestJSON-1329684180 tempest-DeleteServersTestJSON-1329684180-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 12:58:33.159604 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-3d713bd2-93d2-423b-baa2-484156f86fc8 tempest-DeleteServersTestJSON-1329684180 tempest-DeleteServersTestJSON-1329684180-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 12:58:33.160577 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-3d713bd2-93d2-423b-baa2-484156f86fc8 tempest-DeleteServersTestJSON-1329684180 tempest-DeleteServersTestJSON-1329684180-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 12:58:33.161354 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-3d713bd2-93d2-423b-baa2-484156f86fc8 tempest-DeleteServersTestJSON-1329684180 tempest-DeleteServersTestJSON-1329684180-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 12:58:33.447011 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.policy [None req-3d713bd2-93d2-423b-baa2-484156f86fc8 tempest-DeleteServersTestJSON-1329684180 tempest-DeleteServersTestJSON-1329684180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f4dc5a1bdfc4430b8fa39a5eec81f33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb24e38ec8e34dd9a93459b7ff9ba97a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116063) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 12:58:33.458168 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: INFO nova.api.openstack.requestlog [None req-3d713bd2-93d2-423b-baa2-484156f86fc8 tempest-DeleteServersTestJSON-1329684180 tempest-DeleteServersTestJSON-1329684180-project] 10.222.0.49 "GET /compute/v2.1/servers/0632db38-ebd1-43c1-8ab9-04fbb19edfa7" status: 200 len: 1314 microversion: 2.1 time: 0.314729 Dec 14 12:58:33.461408 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: [pid: 116063|app: 0|req: 43/78] 10.222.0.49 () {58 vars in 1235 bytes} [Tue Dec 14 12:58:33 2021] GET /compute/v2.1/servers/0632db38-ebd1-43c1-8ab9-04fbb19edfa7 => generated 1314 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 14 12:58:33.521672 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.api.openstack.wsgi [None req-2be7c75d-beaa-49b1-9e93-7d638f5c335a tempest-ServerRescueNegativeTestJSON-1573931620 tempest-ServerRescueNegativeTestJSON-1573931620-project] Calling method '>' {{(pid=116064) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 12:58:33.523162 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.compute.api [None req-2be7c75d-beaa-49b1-9e93-7d638f5c335a tempest-ServerRescueNegativeTestJSON-1573931620 tempest-ServerRescueNegativeTestJSON-1573931620-project] [instance: 60694e1e-d0cb-41c8-adf5-bdda49804385] Fetching instance by UUID {{(pid=116064) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 12:58:33.531285 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-2be7c75d-beaa-49b1-9e93-7d638f5c335a tempest-ServerRescueNegativeTestJSON-1573931620 tempest-ServerRescueNegativeTestJSON-1573931620-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 12:58:33.533086 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-2be7c75d-beaa-49b1-9e93-7d638f5c335a tempest-ServerRescueNegativeTestJSON-1573931620 tempest-ServerRescueNegativeTestJSON-1573931620-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 12:58:33.534189 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-2be7c75d-beaa-49b1-9e93-7d638f5c335a tempest-ServerRescueNegativeTestJSON-1573931620 tempest-ServerRescueNegativeTestJSON-1573931620-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 12:58:33.537838 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-2be7c75d-beaa-49b1-9e93-7d638f5c335a tempest-ServerRescueNegativeTestJSON-1573931620 tempest-ServerRescueNegativeTestJSON-1573931620-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 12:58:33.861105 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.policy [None req-2be7c75d-beaa-49b1-9e93-7d638f5c335a tempest-ServerRescueNegativeTestJSON-1573931620 tempest-ServerRescueNegativeTestJSON-1573931620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '731cbbfe17214ded8ac66299d66dfc45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '010919ea84eb4eb8b936c63153600eba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116064) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 12:58:33.869383 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: INFO nova.api.openstack.requestlog [None req-2be7c75d-beaa-49b1-9e93-7d638f5c335a tempest-ServerRescueNegativeTestJSON-1573931620 tempest-ServerRescueNegativeTestJSON-1573931620-project] 10.222.0.49 "GET /compute/v2.1/servers/60694e1e-d0cb-41c8-adf5-bdda49804385" status: 200 len: 1322 microversion: 2.1 time: 0.352625 Dec 14 12:58:33.874135 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: [pid: 116064|app: 0|req: 36/79] 10.222.0.49 () {58 vars in 1235 bytes} [Tue Dec 14 12:58:33 2021] GET /compute/v2.1/servers/60694e1e-d0cb-41c8-adf5-bdda49804385 => generated 1322 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 14 12:58:34.051810 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.api.openstack.wsgi [None req-4e869c3d-e392-4a2e-b1ea-46119549bcd6 tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] Calling method '>' {{(pid=116063) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 12:58:34.052467 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.compute.api [None req-4e869c3d-e392-4a2e-b1ea-46119549bcd6 tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] [instance: c8de7730-62f2-4a77-b1e9-cf6a74fa366d] Fetching instance by UUID {{(pid=116063) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 12:58:34.061965 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-4e869c3d-e392-4a2e-b1ea-46119549bcd6 tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 12:58:34.062694 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-4e869c3d-e392-4a2e-b1ea-46119549bcd6 tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 12:58:34.064286 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-4e869c3d-e392-4a2e-b1ea-46119549bcd6 tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 12:58:34.065710 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-4e869c3d-e392-4a2e-b1ea-46119549bcd6 tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 12:58:34.145312 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.api.openstack.wsgi [None req-6e1bc74f-fc37-4f13-aa73-c8ca88d0d581 tempest-AttachVolumeNegativeTest-1000400951 tempest-AttachVolumeNegativeTest-1000400951-project] Calling method '>' {{(pid=116064) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 12:58:34.146743 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.compute.api [None req-6e1bc74f-fc37-4f13-aa73-c8ca88d0d581 tempest-AttachVolumeNegativeTest-1000400951 tempest-AttachVolumeNegativeTest-1000400951-project] [instance: 824eca5b-954f-402d-aa22-14f24ddd77ba] Fetching instance by UUID {{(pid=116064) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 12:58:34.156249 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-6e1bc74f-fc37-4f13-aa73-c8ca88d0d581 tempest-AttachVolumeNegativeTest-1000400951 tempest-AttachVolumeNegativeTest-1000400951-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 12:58:34.157075 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-6e1bc74f-fc37-4f13-aa73-c8ca88d0d581 tempest-AttachVolumeNegativeTest-1000400951 tempest-AttachVolumeNegativeTest-1000400951-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 12:58:34.158975 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-6e1bc74f-fc37-4f13-aa73-c8ca88d0d581 tempest-AttachVolumeNegativeTest-1000400951 tempest-AttachVolumeNegativeTest-1000400951-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 12:58:34.160421 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-6e1bc74f-fc37-4f13-aa73-c8ca88d0d581 tempest-AttachVolumeNegativeTest-1000400951 tempest-AttachVolumeNegativeTest-1000400951-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 12:58:34.364053 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.policy [None req-4e869c3d-e392-4a2e-b1ea-46119549bcd6 tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79d74a2ea1e541d28d085c15cec34032', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68a8770b8dbe489a8119016fbee64eb5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116063) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 12:58:34.371916 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.policy [None req-4e869c3d-e392-4a2e-b1ea-46119549bcd6 tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '79d74a2ea1e541d28d085c15cec34032', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68a8770b8dbe489a8119016fbee64eb5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116063) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 12:58:34.373588 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.policy [None req-4e869c3d-e392-4a2e-b1ea-46119549bcd6 tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '79d74a2ea1e541d28d085c15cec34032', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68a8770b8dbe489a8119016fbee64eb5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116063) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 12:58:34.386301 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: INFO nova.api.openstack.requestlog [None req-4e869c3d-e392-4a2e-b1ea-46119549bcd6 tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] 10.222.0.49 "GET /compute/v2.1/servers/c8de7730-62f2-4a77-b1e9-cf6a74fa366d" status: 200 len: 1407 microversion: 2.20 time: 0.338523 Dec 14 12:58:34.397486 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: [pid: 116063|app: 0|req: 44/80] 10.222.0.49 () {60 vars in 1276 bytes} [Tue Dec 14 12:58:34 2021] GET /compute/v2.1/servers/c8de7730-62f2-4a77-b1e9-cf6a74fa366d => generated 1407 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 14 12:58:34.476607 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.api.openstack.wsgi [None req-1a0601e0-dc51-4a6b-8882-95a732a8a1b9 tempest-DeleteServersTestJSON-1329684180 tempest-DeleteServersTestJSON-1329684180-project] Calling method '>' {{(pid=116063) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 12:58:34.477353 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.compute.api [None req-1a0601e0-dc51-4a6b-8882-95a732a8a1b9 tempest-DeleteServersTestJSON-1329684180 tempest-DeleteServersTestJSON-1329684180-project] [instance: 0632db38-ebd1-43c1-8ab9-04fbb19edfa7] Fetching instance by UUID {{(pid=116063) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 12:58:34.492995 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-1a0601e0-dc51-4a6b-8882-95a732a8a1b9 tempest-DeleteServersTestJSON-1329684180 tempest-DeleteServersTestJSON-1329684180-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 12:58:34.493498 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-1a0601e0-dc51-4a6b-8882-95a732a8a1b9 tempest-DeleteServersTestJSON-1329684180 tempest-DeleteServersTestJSON-1329684180-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 12:58:34.494380 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-1a0601e0-dc51-4a6b-8882-95a732a8a1b9 tempest-DeleteServersTestJSON-1329684180 tempest-DeleteServersTestJSON-1329684180-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 12:58:34.494887 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-1a0601e0-dc51-4a6b-8882-95a732a8a1b9 tempest-DeleteServersTestJSON-1329684180 tempest-DeleteServersTestJSON-1329684180-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 12:58:34.514301 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.policy [None req-6e1bc74f-fc37-4f13-aa73-c8ca88d0d581 tempest-AttachVolumeNegativeTest-1000400951 tempest-AttachVolumeNegativeTest-1000400951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57d0ec01f0784c8ea87d339980bed3cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad27b8951cae4eeeafa257f45217653a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116064) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 12:58:34.521941 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: INFO nova.api.openstack.requestlog [None req-6e1bc74f-fc37-4f13-aa73-c8ca88d0d581 tempest-AttachVolumeNegativeTest-1000400951 tempest-AttachVolumeNegativeTest-1000400951-project] 10.222.0.49 "GET /compute/v2.1/servers/824eca5b-954f-402d-aa22-14f24ddd77ba" status: 200 len: 1318 microversion: 2.1 time: 0.380306 Dec 14 12:58:34.529377 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: [pid: 116064|app: 0|req: 37/81] 10.222.0.49 () {58 vars in 1235 bytes} [Tue Dec 14 12:58:34 2021] GET /compute/v2.1/servers/824eca5b-954f-402d-aa22-14f24ddd77ba => generated 1318 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 14 12:58:34.863958 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.policy [None req-1a0601e0-dc51-4a6b-8882-95a732a8a1b9 tempest-DeleteServersTestJSON-1329684180 tempest-DeleteServersTestJSON-1329684180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f4dc5a1bdfc4430b8fa39a5eec81f33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb24e38ec8e34dd9a93459b7ff9ba97a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116063) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 12:58:34.879732 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: INFO nova.api.openstack.requestlog [None req-1a0601e0-dc51-4a6b-8882-95a732a8a1b9 tempest-DeleteServersTestJSON-1329684180 tempest-DeleteServersTestJSON-1329684180-project] 10.222.0.49 "GET /compute/v2.1/servers/0632db38-ebd1-43c1-8ab9-04fbb19edfa7" status: 200 len: 1314 microversion: 2.1 time: 0.402938 Dec 14 12:58:34.880673 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: [pid: 116063|app: 0|req: 45/82] 10.222.0.49 () {58 vars in 1235 bytes} [Tue Dec 14 12:58:34 2021] GET /compute/v2.1/servers/0632db38-ebd1-43c1-8ab9-04fbb19edfa7 => generated 1314 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 14 12:58:34.892518 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.api.openstack.wsgi [None req-748daeb5-b66d-4b73-be2d-81283744cecf tempest-ServerRescueNegativeTestJSON-1573931620 tempest-ServerRescueNegativeTestJSON-1573931620-project] Calling method '>' {{(pid=116064) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 12:58:34.893218 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.compute.api [None req-748daeb5-b66d-4b73-be2d-81283744cecf tempest-ServerRescueNegativeTestJSON-1573931620 tempest-ServerRescueNegativeTestJSON-1573931620-project] [instance: 60694e1e-d0cb-41c8-adf5-bdda49804385] Fetching instance by UUID {{(pid=116064) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 12:58:34.906151 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-748daeb5-b66d-4b73-be2d-81283744cecf tempest-ServerRescueNegativeTestJSON-1573931620 tempest-ServerRescueNegativeTestJSON-1573931620-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 12:58:34.906839 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-748daeb5-b66d-4b73-be2d-81283744cecf tempest-ServerRescueNegativeTestJSON-1573931620 tempest-ServerRescueNegativeTestJSON-1573931620-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 12:58:34.907649 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-748daeb5-b66d-4b73-be2d-81283744cecf tempest-ServerRescueNegativeTestJSON-1573931620 tempest-ServerRescueNegativeTestJSON-1573931620-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 12:58:34.908102 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-748daeb5-b66d-4b73-be2d-81283744cecf tempest-ServerRescueNegativeTestJSON-1573931620 tempest-ServerRescueNegativeTestJSON-1573931620-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 12:58:35.160125 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.policy [None req-748daeb5-b66d-4b73-be2d-81283744cecf tempest-ServerRescueNegativeTestJSON-1573931620 tempest-ServerRescueNegativeTestJSON-1573931620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '731cbbfe17214ded8ac66299d66dfc45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '010919ea84eb4eb8b936c63153600eba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116064) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 12:58:35.168568 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: INFO nova.api.openstack.requestlog [None req-748daeb5-b66d-4b73-be2d-81283744cecf tempest-ServerRescueNegativeTestJSON-1573931620 tempest-ServerRescueNegativeTestJSON-1573931620-project] 10.222.0.49 "GET /compute/v2.1/servers/60694e1e-d0cb-41c8-adf5-bdda49804385" status: 200 len: 1322 microversion: 2.1 time: 0.281404 Dec 14 12:58:35.173854 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: [pid: 116064|app: 0|req: 38/83] 10.222.0.49 () {58 vars in 1235 bytes} [Tue Dec 14 12:58:34 2021] GET /compute/v2.1/servers/60694e1e-d0cb-41c8-adf5-bdda49804385 => generated 1322 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 14 12:58:35.404578 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.api.openstack.wsgi [None req-fe31bc01-896d-42f6-8758-752e074dc702 tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] Calling method '>' {{(pid=116063) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 12:58:35.405520 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.compute.api [None req-fe31bc01-896d-42f6-8758-752e074dc702 tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] [instance: c8de7730-62f2-4a77-b1e9-cf6a74fa366d] Fetching instance by UUID {{(pid=116063) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 12:58:35.414606 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-fe31bc01-896d-42f6-8758-752e074dc702 tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 12:58:35.415079 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-fe31bc01-896d-42f6-8758-752e074dc702 tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 12:58:35.415882 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-fe31bc01-896d-42f6-8758-752e074dc702 tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 12:58:35.416961 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-fe31bc01-896d-42f6-8758-752e074dc702 tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 12:58:35.545709 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.api.openstack.wsgi [None req-32274db5-48e4-458a-89e1-c9c8890431d4 tempest-AttachVolumeNegativeTest-1000400951 tempest-AttachVolumeNegativeTest-1000400951-project] Calling method '>' {{(pid=116064) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 12:58:35.546953 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.compute.api [None req-32274db5-48e4-458a-89e1-c9c8890431d4 tempest-AttachVolumeNegativeTest-1000400951 tempest-AttachVolumeNegativeTest-1000400951-project] [instance: 824eca5b-954f-402d-aa22-14f24ddd77ba] Fetching instance by UUID {{(pid=116064) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 12:58:35.556756 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-32274db5-48e4-458a-89e1-c9c8890431d4 tempest-AttachVolumeNegativeTest-1000400951 tempest-AttachVolumeNegativeTest-1000400951-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 12:58:35.557234 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-32274db5-48e4-458a-89e1-c9c8890431d4 tempest-AttachVolumeNegativeTest-1000400951 tempest-AttachVolumeNegativeTest-1000400951-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 12:58:35.559925 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-32274db5-48e4-458a-89e1-c9c8890431d4 tempest-AttachVolumeNegativeTest-1000400951 tempest-AttachVolumeNegativeTest-1000400951-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 12:58:35.560374 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-32274db5-48e4-458a-89e1-c9c8890431d4 tempest-AttachVolumeNegativeTest-1000400951 tempest-AttachVolumeNegativeTest-1000400951-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 12:58:35.593548 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.policy [None req-fe31bc01-896d-42f6-8758-752e074dc702 tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79d74a2ea1e541d28d085c15cec34032', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68a8770b8dbe489a8119016fbee64eb5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116063) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 12:58:35.610964 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.policy [None req-fe31bc01-896d-42f6-8758-752e074dc702 tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '79d74a2ea1e541d28d085c15cec34032', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68a8770b8dbe489a8119016fbee64eb5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116063) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 12:58:35.616360 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.policy [None req-fe31bc01-896d-42f6-8758-752e074dc702 tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '79d74a2ea1e541d28d085c15cec34032', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68a8770b8dbe489a8119016fbee64eb5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116063) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 12:58:35.618044 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: INFO nova.api.openstack.requestlog [None req-fe31bc01-896d-42f6-8758-752e074dc702 tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] 10.222.0.49 "GET /compute/v2.1/servers/c8de7730-62f2-4a77-b1e9-cf6a74fa366d" status: 200 len: 1407 microversion: 2.20 time: 0.218394 Dec 14 12:58:35.621001 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: [pid: 116063|app: 0|req: 46/84] 10.222.0.49 () {60 vars in 1276 bytes} [Tue Dec 14 12:58:35 2021] GET /compute/v2.1/servers/c8de7730-62f2-4a77-b1e9-cf6a74fa366d => generated 1407 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 14 12:58:35.831947 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.policy [None req-32274db5-48e4-458a-89e1-c9c8890431d4 tempest-AttachVolumeNegativeTest-1000400951 tempest-AttachVolumeNegativeTest-1000400951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57d0ec01f0784c8ea87d339980bed3cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad27b8951cae4eeeafa257f45217653a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116064) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 12:58:35.841132 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.api.openstack.wsgi [req-48c5e0c4-b53c-49ae-bf40-be769b9e61ab req-98a0c505-2f19-4c8a-88b8-f9b89606497e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c8de7730-62f2-4a77-b1e9-cf6a74fa366d", "tag": "45d34d58-1ff8-4ce3-a024-e2acb9451196"}]} {{(pid=116063) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 14 12:58:35.845981 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 14 12:58:35.845981 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: warnings.warn(msg) Dec 14 12:58:35.854637 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: INFO nova.api.openstack.requestlog [None req-32274db5-48e4-458a-89e1-c9c8890431d4 tempest-AttachVolumeNegativeTest-1000400951 tempest-AttachVolumeNegativeTest-1000400951-project] 10.222.0.49 "GET /compute/v2.1/servers/824eca5b-954f-402d-aa22-14f24ddd77ba" status: 200 len: 1318 microversion: 2.1 time: 0.307273 Dec 14 12:58:35.855093 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: [pid: 116064|app: 0|req: 39/85] 10.222.0.49 () {58 vars in 1235 bytes} [Tue Dec 14 12:58:35 2021] GET /compute/v2.1/servers/824eca5b-954f-402d-aa22-14f24ddd77ba => generated 1318 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 14 12:58:35.862978 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [req-48c5e0c4-b53c-49ae-bf40-be769b9e61ab req-98a0c505-2f19-4c8a-88b8-f9b89606497e service nova] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 12:58:35.863603 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [req-48c5e0c4-b53c-49ae-bf40-be769b9e61ab req-98a0c505-2f19-4c8a-88b8-f9b89606497e service nova] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 12:58:35.880619 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: INFO nova.api.openstack.compute.server_external_events [req-48c5e0c4-b53c-49ae-bf40-be769b9e61ab req-98a0c505-2f19-4c8a-88b8-f9b89606497e service nova] Creating event network-changed:45d34d58-1ff8-4ce3-a024-e2acb9451196 for instance c8de7730-62f2-4a77-b1e9-cf6a74fa366d on hv-cinder-78447 Dec 14 12:58:35.893537 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: INFO nova.api.openstack.requestlog [req-48c5e0c4-b53c-49ae-bf40-be769b9e61ab req-98a0c505-2f19-4c8a-88b8-f9b89606497e service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.061889 Dec 14 12:58:35.894620 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: [pid: 116063|app: 0|req: 47/86] 10.222.0.49 () {64 vars in 1317 bytes} [Tue Dec 14 12:58:35 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 14 12:58:35.896116 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.api.openstack.wsgi [None req-0fa578fd-6334-4f05-b9c3-a1d1f532f970 tempest-DeleteServersTestJSON-1329684180 tempest-DeleteServersTestJSON-1329684180-project] Calling method '>' {{(pid=116064) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 12:58:35.896731 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.compute.api [None req-0fa578fd-6334-4f05-b9c3-a1d1f532f970 tempest-DeleteServersTestJSON-1329684180 tempest-DeleteServersTestJSON-1329684180-project] [instance: 0632db38-ebd1-43c1-8ab9-04fbb19edfa7] Fetching instance by UUID {{(pid=116064) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 12:58:35.911814 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-0fa578fd-6334-4f05-b9c3-a1d1f532f970 tempest-DeleteServersTestJSON-1329684180 tempest-DeleteServersTestJSON-1329684180-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 12:58:35.912965 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-0fa578fd-6334-4f05-b9c3-a1d1f532f970 tempest-DeleteServersTestJSON-1329684180 tempest-DeleteServersTestJSON-1329684180-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 12:58:35.913783 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-0fa578fd-6334-4f05-b9c3-a1d1f532f970 tempest-DeleteServersTestJSON-1329684180 tempest-DeleteServersTestJSON-1329684180-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 12:58:35.914223 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-0fa578fd-6334-4f05-b9c3-a1d1f532f970 tempest-DeleteServersTestJSON-1329684180 tempest-DeleteServersTestJSON-1329684180-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 12:58:36.133345 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.policy [None req-0fa578fd-6334-4f05-b9c3-a1d1f532f970 tempest-DeleteServersTestJSON-1329684180 tempest-DeleteServersTestJSON-1329684180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f4dc5a1bdfc4430b8fa39a5eec81f33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb24e38ec8e34dd9a93459b7ff9ba97a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116064) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 12:58:36.142385 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: INFO nova.api.openstack.requestlog [None req-0fa578fd-6334-4f05-b9c3-a1d1f532f970 tempest-DeleteServersTestJSON-1329684180 tempest-DeleteServersTestJSON-1329684180-project] 10.222.0.49 "GET /compute/v2.1/servers/0632db38-ebd1-43c1-8ab9-04fbb19edfa7" status: 200 len: 1314 microversion: 2.1 time: 0.249839 Dec 14 12:58:36.143906 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: [pid: 116064|app: 0|req: 40/87] 10.222.0.49 () {58 vars in 1235 bytes} [Tue Dec 14 12:58:35 2021] GET /compute/v2.1/servers/0632db38-ebd1-43c1-8ab9-04fbb19edfa7 => generated 1314 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 14 12:58:36.187953 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.api.openstack.wsgi [None req-b692ab19-708e-46bf-a310-e74dc85d7c10 tempest-ServerRescueNegativeTestJSON-1573931620 tempest-ServerRescueNegativeTestJSON-1573931620-project] Calling method '>' {{(pid=116063) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 12:58:36.188939 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.compute.api [None req-b692ab19-708e-46bf-a310-e74dc85d7c10 tempest-ServerRescueNegativeTestJSON-1573931620 tempest-ServerRescueNegativeTestJSON-1573931620-project] [instance: 60694e1e-d0cb-41c8-adf5-bdda49804385] Fetching instance by UUID {{(pid=116063) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 12:58:36.199491 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-b692ab19-708e-46bf-a310-e74dc85d7c10 tempest-ServerRescueNegativeTestJSON-1573931620 tempest-ServerRescueNegativeTestJSON-1573931620-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 12:58:36.199987 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-b692ab19-708e-46bf-a310-e74dc85d7c10 tempest-ServerRescueNegativeTestJSON-1573931620 tempest-ServerRescueNegativeTestJSON-1573931620-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 12:58:36.200835 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-b692ab19-708e-46bf-a310-e74dc85d7c10 tempest-ServerRescueNegativeTestJSON-1573931620 tempest-ServerRescueNegativeTestJSON-1573931620-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 12:58:36.201324 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-b692ab19-708e-46bf-a310-e74dc85d7c10 tempest-ServerRescueNegativeTestJSON-1573931620 tempest-ServerRescueNegativeTestJSON-1573931620-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 12:58:36.458453 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.policy [None req-b692ab19-708e-46bf-a310-e74dc85d7c10 tempest-ServerRescueNegativeTestJSON-1573931620 tempest-ServerRescueNegativeTestJSON-1573931620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '731cbbfe17214ded8ac66299d66dfc45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '010919ea84eb4eb8b936c63153600eba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116063) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 12:58:36.467815 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: INFO nova.api.openstack.requestlog [None req-b692ab19-708e-46bf-a310-e74dc85d7c10 tempest-ServerRescueNegativeTestJSON-1573931620 tempest-ServerRescueNegativeTestJSON-1573931620-project] 10.222.0.49 "GET /compute/v2.1/servers/60694e1e-d0cb-41c8-adf5-bdda49804385" status: 200 len: 1322 microversion: 2.1 time: 0.285081 Dec 14 12:58:36.469506 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: [pid: 116063|app: 0|req: 48/88] 10.222.0.49 () {58 vars in 1235 bytes} [Tue Dec 14 12:58:36 2021] GET /compute/v2.1/servers/60694e1e-d0cb-41c8-adf5-bdda49804385 => generated 1322 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 14 12:58:36.637869 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.api.openstack.wsgi [None req-6395d3e9-7e1b-45ad-89a4-086471f80569 tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] Calling method '>' {{(pid=116064) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 12:58:36.638758 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.compute.api [None req-6395d3e9-7e1b-45ad-89a4-086471f80569 tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] [instance: c8de7730-62f2-4a77-b1e9-cf6a74fa366d] Fetching instance by UUID {{(pid=116064) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 12:58:36.651958 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-6395d3e9-7e1b-45ad-89a4-086471f80569 tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 12:58:36.654549 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-6395d3e9-7e1b-45ad-89a4-086471f80569 tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 12:58:36.659949 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-6395d3e9-7e1b-45ad-89a4-086471f80569 tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 12:58:36.673816 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-6395d3e9-7e1b-45ad-89a4-086471f80569 tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 12:58:36.876133 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.api.openstack.wsgi [None req-38693205-2311-439a-a690-55ecfc98b400 tempest-AttachVolumeNegativeTest-1000400951 tempest-AttachVolumeNegativeTest-1000400951-project] Calling method '>' {{(pid=116063) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 12:58:36.877279 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.compute.api [None req-38693205-2311-439a-a690-55ecfc98b400 tempest-AttachVolumeNegativeTest-1000400951 tempest-AttachVolumeNegativeTest-1000400951-project] [instance: 824eca5b-954f-402d-aa22-14f24ddd77ba] Fetching instance by UUID {{(pid=116063) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 12:58:36.891539 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-38693205-2311-439a-a690-55ecfc98b400 tempest-AttachVolumeNegativeTest-1000400951 tempest-AttachVolumeNegativeTest-1000400951-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 12:58:36.892647 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-38693205-2311-439a-a690-55ecfc98b400 tempest-AttachVolumeNegativeTest-1000400951 tempest-AttachVolumeNegativeTest-1000400951-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 12:58:36.897114 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-38693205-2311-439a-a690-55ecfc98b400 tempest-AttachVolumeNegativeTest-1000400951 tempest-AttachVolumeNegativeTest-1000400951-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 12:58:36.897708 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-38693205-2311-439a-a690-55ecfc98b400 tempest-AttachVolumeNegativeTest-1000400951 tempest-AttachVolumeNegativeTest-1000400951-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 12:58:37.007747 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.policy [None req-6395d3e9-7e1b-45ad-89a4-086471f80569 tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79d74a2ea1e541d28d085c15cec34032', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68a8770b8dbe489a8119016fbee64eb5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116064) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 12:58:37.026055 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.policy [None req-6395d3e9-7e1b-45ad-89a4-086471f80569 tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '79d74a2ea1e541d28d085c15cec34032', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68a8770b8dbe489a8119016fbee64eb5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116064) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 12:58:37.032937 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.policy [None req-6395d3e9-7e1b-45ad-89a4-086471f80569 tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '79d74a2ea1e541d28d085c15cec34032', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68a8770b8dbe489a8119016fbee64eb5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116064) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 12:58:37.038337 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: INFO nova.api.openstack.requestlog [None req-6395d3e9-7e1b-45ad-89a4-086471f80569 tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] 10.222.0.49 "GET /compute/v2.1/servers/c8de7730-62f2-4a77-b1e9-cf6a74fa366d" status: 200 len: 1407 microversion: 2.20 time: 0.404175 Dec 14 12:58:37.040000 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: [pid: 116064|app: 0|req: 41/89] 10.222.0.49 () {60 vars in 1276 bytes} [Tue Dec 14 12:58:36 2021] GET /compute/v2.1/servers/c8de7730-62f2-4a77-b1e9-cf6a74fa366d => generated 1407 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 14 12:58:37.204466 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.policy [None req-38693205-2311-439a-a690-55ecfc98b400 tempest-AttachVolumeNegativeTest-1000400951 tempest-AttachVolumeNegativeTest-1000400951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57d0ec01f0784c8ea87d339980bed3cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad27b8951cae4eeeafa257f45217653a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116063) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 12:58:37.211868 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: INFO nova.api.openstack.requestlog [None req-38693205-2311-439a-a690-55ecfc98b400 tempest-AttachVolumeNegativeTest-1000400951 tempest-AttachVolumeNegativeTest-1000400951-project] 10.222.0.49 "GET /compute/v2.1/servers/824eca5b-954f-402d-aa22-14f24ddd77ba" status: 200 len: 1318 microversion: 2.1 time: 0.341548 Dec 14 12:58:37.224688 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: [pid: 116063|app: 0|req: 49/90] 10.222.0.49 () {58 vars in 1235 bytes} [Tue Dec 14 12:58:36 2021] GET /compute/v2.1/servers/824eca5b-954f-402d-aa22-14f24ddd77ba => generated 1318 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 14 12:58:37.226637 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.api.openstack.wsgi [None req-ecdc7807-6d94-4f19-b3b1-8438114705a1 tempest-DeleteServersTestJSON-1329684180 tempest-DeleteServersTestJSON-1329684180-project] Calling method '>' {{(pid=116063) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 12:58:37.227104 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.compute.api [None req-ecdc7807-6d94-4f19-b3b1-8438114705a1 tempest-DeleteServersTestJSON-1329684180 tempest-DeleteServersTestJSON-1329684180-project] [instance: 0632db38-ebd1-43c1-8ab9-04fbb19edfa7] Fetching instance by UUID {{(pid=116063) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 12:58:37.233170 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-ecdc7807-6d94-4f19-b3b1-8438114705a1 tempest-DeleteServersTestJSON-1329684180 tempest-DeleteServersTestJSON-1329684180-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 12:58:37.233623 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-ecdc7807-6d94-4f19-b3b1-8438114705a1 tempest-DeleteServersTestJSON-1329684180 tempest-DeleteServersTestJSON-1329684180-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 12:58:37.234413 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-ecdc7807-6d94-4f19-b3b1-8438114705a1 tempest-DeleteServersTestJSON-1329684180 tempest-DeleteServersTestJSON-1329684180-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 12:58:37.234848 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-ecdc7807-6d94-4f19-b3b1-8438114705a1 tempest-DeleteServersTestJSON-1329684180 tempest-DeleteServersTestJSON-1329684180-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 12:58:37.487277 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.policy [None req-ecdc7807-6d94-4f19-b3b1-8438114705a1 tempest-DeleteServersTestJSON-1329684180 tempest-DeleteServersTestJSON-1329684180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f4dc5a1bdfc4430b8fa39a5eec81f33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb24e38ec8e34dd9a93459b7ff9ba97a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116063) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 12:58:37.498041 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: INFO nova.api.openstack.requestlog [None req-ecdc7807-6d94-4f19-b3b1-8438114705a1 tempest-DeleteServersTestJSON-1329684180 tempest-DeleteServersTestJSON-1329684180-project] 10.222.0.49 "GET /compute/v2.1/servers/0632db38-ebd1-43c1-8ab9-04fbb19edfa7" status: 200 len: 1314 microversion: 2.1 time: 0.272356 Dec 14 12:58:37.503247 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.api.openstack.wsgi [req-08ac0962-9e3f-4ebd-a3f0-333682c0de3e req-ae362f8e-6501-4207-9603-3d5b0442b4a2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0632db38-ebd1-43c1-8ab9-04fbb19edfa7", "name": "network-vif-plugged", "status": "completed", "tag": "1fe1c28a-b855-4e98-8e95-d0334e66858c"}]} {{(pid=116064) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 14 12:58:37.505299 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 14 12:58:37.505299 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: warnings.warn(msg) Dec 14 12:58:37.510942 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: [pid: 116063|app: 0|req: 50/91] 10.222.0.49 () {58 vars in 1235 bytes} [Tue Dec 14 12:58:37 2021] GET /compute/v2.1/servers/0632db38-ebd1-43c1-8ab9-04fbb19edfa7 => generated 1314 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 14 12:58:37.519470 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [req-08ac0962-9e3f-4ebd-a3f0-333682c0de3e req-ae362f8e-6501-4207-9603-3d5b0442b4a2 service nova] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 12:58:37.520182 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [req-08ac0962-9e3f-4ebd-a3f0-333682c0de3e req-ae362f8e-6501-4207-9603-3d5b0442b4a2 service nova] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 12:58:37.535821 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.api.openstack.wsgi [None req-0f4dbf45-d158-4d2f-88f5-eeff4c6f80c1 tempest-ServerRescueNegativeTestJSON-1573931620 tempest-ServerRescueNegativeTestJSON-1573931620-project] Calling method '>' {{(pid=116063) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 12:58:37.536629 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.compute.api [None req-0f4dbf45-d158-4d2f-88f5-eeff4c6f80c1 tempest-ServerRescueNegativeTestJSON-1573931620 tempest-ServerRescueNegativeTestJSON-1573931620-project] [instance: 60694e1e-d0cb-41c8-adf5-bdda49804385] Fetching instance by UUID {{(pid=116063) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 12:58:37.547562 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: INFO nova.api.openstack.compute.server_external_events [req-08ac0962-9e3f-4ebd-a3f0-333682c0de3e req-ae362f8e-6501-4207-9603-3d5b0442b4a2 service nova] Creating event network-vif-plugged:1fe1c28a-b855-4e98-8e95-d0334e66858c for instance 0632db38-ebd1-43c1-8ab9-04fbb19edfa7 on hv-cinder-78447 Dec 14 12:58:37.552032 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-0f4dbf45-d158-4d2f-88f5-eeff4c6f80c1 tempest-ServerRescueNegativeTestJSON-1573931620 tempest-ServerRescueNegativeTestJSON-1573931620-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 12:58:37.552512 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-0f4dbf45-d158-4d2f-88f5-eeff4c6f80c1 tempest-ServerRescueNegativeTestJSON-1573931620 tempest-ServerRescueNegativeTestJSON-1573931620-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 12:58:37.557767 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: INFO nova.api.openstack.requestlog [req-08ac0962-9e3f-4ebd-a3f0-333682c0de3e req-ae362f8e-6501-4207-9603-3d5b0442b4a2 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.485898 Dec 14 12:58:37.557885 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-0f4dbf45-d158-4d2f-88f5-eeff4c6f80c1 tempest-ServerRescueNegativeTestJSON-1573931620 tempest-ServerRescueNegativeTestJSON-1573931620-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 12:58:37.559254 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: [pid: 116064|app: 0|req: 42/92] 10.222.0.49 () {64 vars in 1317 bytes} [Tue Dec 14 12:58:37 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 489 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 14 12:58:37.561594 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-0f4dbf45-d158-4d2f-88f5-eeff4c6f80c1 tempest-ServerRescueNegativeTestJSON-1573931620 tempest-ServerRescueNegativeTestJSON-1573931620-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 12:58:37.913494 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.policy [None req-0f4dbf45-d158-4d2f-88f5-eeff4c6f80c1 tempest-ServerRescueNegativeTestJSON-1573931620 tempest-ServerRescueNegativeTestJSON-1573931620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '731cbbfe17214ded8ac66299d66dfc45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '010919ea84eb4eb8b936c63153600eba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116063) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 12:58:37.926203 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: INFO nova.api.openstack.requestlog [None req-0f4dbf45-d158-4d2f-88f5-eeff4c6f80c1 tempest-ServerRescueNegativeTestJSON-1573931620 tempest-ServerRescueNegativeTestJSON-1573931620-project] 10.222.0.49 "GET /compute/v2.1/servers/60694e1e-d0cb-41c8-adf5-bdda49804385" status: 200 len: 1322 microversion: 2.1 time: 0.393914 Dec 14 12:58:37.928116 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: [pid: 116063|app: 0|req: 51/93] 10.222.0.49 () {58 vars in 1235 bytes} [Tue Dec 14 12:58:37 2021] GET /compute/v2.1/servers/60694e1e-d0cb-41c8-adf5-bdda49804385 => generated 1322 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 14 12:58:38.062832 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.api.openstack.wsgi [None req-31f5fac5-d69c-4b5d-978e-147473dcd02c tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] Calling method '>' {{(pid=116064) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 12:58:38.064280 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.compute.api [None req-31f5fac5-d69c-4b5d-978e-147473dcd02c tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] [instance: c8de7730-62f2-4a77-b1e9-cf6a74fa366d] Fetching instance by UUID {{(pid=116064) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 12:58:38.071768 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-31f5fac5-d69c-4b5d-978e-147473dcd02c tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 12:58:38.072462 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-31f5fac5-d69c-4b5d-978e-147473dcd02c tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 12:58:38.073629 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-31f5fac5-d69c-4b5d-978e-147473dcd02c tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 12:58:38.074433 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-31f5fac5-d69c-4b5d-978e-147473dcd02c tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 12:58:38.227250 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.policy [None req-31f5fac5-d69c-4b5d-978e-147473dcd02c tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79d74a2ea1e541d28d085c15cec34032', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68a8770b8dbe489a8119016fbee64eb5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116064) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 12:58:38.236104 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.api.openstack.wsgi [None req-5909e63f-c921-424a-84c2-53135a5b6a7f tempest-AttachVolumeNegativeTest-1000400951 tempest-AttachVolumeNegativeTest-1000400951-project] Calling method '>' {{(pid=116063) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 12:58:38.236754 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.compute.api [None req-5909e63f-c921-424a-84c2-53135a5b6a7f tempest-AttachVolumeNegativeTest-1000400951 tempest-AttachVolumeNegativeTest-1000400951-project] [instance: 824eca5b-954f-402d-aa22-14f24ddd77ba] Fetching instance by UUID {{(pid=116063) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 12:58:38.244408 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.policy [None req-31f5fac5-d69c-4b5d-978e-147473dcd02c tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '79d74a2ea1e541d28d085c15cec34032', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68a8770b8dbe489a8119016fbee64eb5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116064) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 12:58:38.247980 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-5909e63f-c921-424a-84c2-53135a5b6a7f tempest-AttachVolumeNegativeTest-1000400951 tempest-AttachVolumeNegativeTest-1000400951-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 12:58:38.249819 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.policy [None req-31f5fac5-d69c-4b5d-978e-147473dcd02c tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '79d74a2ea1e541d28d085c15cec34032', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68a8770b8dbe489a8119016fbee64eb5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116064) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 12:58:38.250401 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-5909e63f-c921-424a-84c2-53135a5b6a7f tempest-AttachVolumeNegativeTest-1000400951 tempest-AttachVolumeNegativeTest-1000400951-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 12:58:38.251179 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-5909e63f-c921-424a-84c2-53135a5b6a7f tempest-AttachVolumeNegativeTest-1000400951 tempest-AttachVolumeNegativeTest-1000400951-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 12:58:38.251602 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-5909e63f-c921-424a-84c2-53135a5b6a7f tempest-AttachVolumeNegativeTest-1000400951 tempest-AttachVolumeNegativeTest-1000400951-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 12:58:38.252876 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: INFO nova.api.openstack.requestlog [None req-31f5fac5-d69c-4b5d-978e-147473dcd02c tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] 10.222.0.49 "GET /compute/v2.1/servers/c8de7730-62f2-4a77-b1e9-cf6a74fa366d" status: 200 len: 1407 microversion: 2.20 time: 0.198001 Dec 14 12:58:38.258312 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: [pid: 116064|app: 0|req: 43/94] 10.222.0.49 () {60 vars in 1276 bytes} [Tue Dec 14 12:58:38 2021] GET /compute/v2.1/servers/c8de7730-62f2-4a77-b1e9-cf6a74fa366d => generated 1407 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 14 12:58:38.437249 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.policy [None req-5909e63f-c921-424a-84c2-53135a5b6a7f tempest-AttachVolumeNegativeTest-1000400951 tempest-AttachVolumeNegativeTest-1000400951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57d0ec01f0784c8ea87d339980bed3cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad27b8951cae4eeeafa257f45217653a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116063) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 12:58:38.447743 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: INFO nova.api.openstack.requestlog [None req-5909e63f-c921-424a-84c2-53135a5b6a7f tempest-AttachVolumeNegativeTest-1000400951 tempest-AttachVolumeNegativeTest-1000400951-project] 10.222.0.49 "GET /compute/v2.1/servers/824eca5b-954f-402d-aa22-14f24ddd77ba" status: 200 len: 1318 microversion: 2.1 time: 0.218713 Dec 14 12:58:38.449330 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: [pid: 116063|app: 0|req: 52/95] 10.222.0.49 () {58 vars in 1235 bytes} [Tue Dec 14 12:58:38 2021] GET /compute/v2.1/servers/824eca5b-954f-402d-aa22-14f24ddd77ba => generated 1318 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 14 12:58:38.516892 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.api.openstack.wsgi [None req-e07ddfbb-0f53-4254-a855-e7c5690fb47d tempest-DeleteServersTestJSON-1329684180 tempest-DeleteServersTestJSON-1329684180-project] Calling method '>' {{(pid=116064) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 12:58:38.517724 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.compute.api [None req-e07ddfbb-0f53-4254-a855-e7c5690fb47d tempest-DeleteServersTestJSON-1329684180 tempest-DeleteServersTestJSON-1329684180-project] [instance: 0632db38-ebd1-43c1-8ab9-04fbb19edfa7] Fetching instance by UUID {{(pid=116064) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 12:58:38.527278 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-e07ddfbb-0f53-4254-a855-e7c5690fb47d tempest-DeleteServersTestJSON-1329684180 tempest-DeleteServersTestJSON-1329684180-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 12:58:38.529864 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-e07ddfbb-0f53-4254-a855-e7c5690fb47d tempest-DeleteServersTestJSON-1329684180 tempest-DeleteServersTestJSON-1329684180-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 12:58:38.531918 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-e07ddfbb-0f53-4254-a855-e7c5690fb47d tempest-DeleteServersTestJSON-1329684180 tempest-DeleteServersTestJSON-1329684180-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 12:58:38.533322 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-e07ddfbb-0f53-4254-a855-e7c5690fb47d tempest-DeleteServersTestJSON-1329684180 tempest-DeleteServersTestJSON-1329684180-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 12:58:38.751265 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.policy [None req-e07ddfbb-0f53-4254-a855-e7c5690fb47d tempest-DeleteServersTestJSON-1329684180 tempest-DeleteServersTestJSON-1329684180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f4dc5a1bdfc4430b8fa39a5eec81f33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb24e38ec8e34dd9a93459b7ff9ba97a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116064) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 12:58:38.761109 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: INFO nova.api.openstack.requestlog [None req-e07ddfbb-0f53-4254-a855-e7c5690fb47d tempest-DeleteServersTestJSON-1329684180 tempest-DeleteServersTestJSON-1329684180-project] 10.222.0.49 "GET /compute/v2.1/servers/0632db38-ebd1-43c1-8ab9-04fbb19edfa7" status: 200 len: 1314 microversion: 2.1 time: 0.249187 Dec 14 12:58:38.762082 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: [pid: 116064|app: 0|req: 44/96] 10.222.0.49 () {58 vars in 1235 bytes} [Tue Dec 14 12:58:38 2021] GET /compute/v2.1/servers/0632db38-ebd1-43c1-8ab9-04fbb19edfa7 => generated 1314 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 14 12:58:38.944076 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.api.openstack.wsgi [None req-c608375c-0783-438e-9eaa-d70b5fea6baf tempest-ServerRescueNegativeTestJSON-1573931620 tempest-ServerRescueNegativeTestJSON-1573931620-project] Calling method '>' {{(pid=116063) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 12:58:38.945405 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.compute.api [None req-c608375c-0783-438e-9eaa-d70b5fea6baf tempest-ServerRescueNegativeTestJSON-1573931620 tempest-ServerRescueNegativeTestJSON-1573931620-project] [instance: 60694e1e-d0cb-41c8-adf5-bdda49804385] Fetching instance by UUID {{(pid=116063) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 12:58:38.952588 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-c608375c-0783-438e-9eaa-d70b5fea6baf tempest-ServerRescueNegativeTestJSON-1573931620 tempest-ServerRescueNegativeTestJSON-1573931620-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 12:58:38.953066 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-c608375c-0783-438e-9eaa-d70b5fea6baf tempest-ServerRescueNegativeTestJSON-1573931620 tempest-ServerRescueNegativeTestJSON-1573931620-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 12:58:38.953844 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-c608375c-0783-438e-9eaa-d70b5fea6baf tempest-ServerRescueNegativeTestJSON-1573931620 tempest-ServerRescueNegativeTestJSON-1573931620-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 12:58:38.954279 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-c608375c-0783-438e-9eaa-d70b5fea6baf tempest-ServerRescueNegativeTestJSON-1573931620 tempest-ServerRescueNegativeTestJSON-1573931620-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 12:58:39.277022 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.api.openstack.wsgi [None req-a7f1ad55-9aba-49bf-bd3d-faa0d48c171b tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] Calling method '>' {{(pid=116064) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 12:58:39.278357 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.compute.api [None req-a7f1ad55-9aba-49bf-bd3d-faa0d48c171b tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] [instance: c8de7730-62f2-4a77-b1e9-cf6a74fa366d] Fetching instance by UUID {{(pid=116064) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 12:58:39.285253 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-a7f1ad55-9aba-49bf-bd3d-faa0d48c171b tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 12:58:39.286584 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-a7f1ad55-9aba-49bf-bd3d-faa0d48c171b tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 12:58:39.288010 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-a7f1ad55-9aba-49bf-bd3d-faa0d48c171b tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 12:58:39.288877 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-a7f1ad55-9aba-49bf-bd3d-faa0d48c171b tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 12:58:39.502199 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.policy [None req-c608375c-0783-438e-9eaa-d70b5fea6baf tempest-ServerRescueNegativeTestJSON-1573931620 tempest-ServerRescueNegativeTestJSON-1573931620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '731cbbfe17214ded8ac66299d66dfc45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '010919ea84eb4eb8b936c63153600eba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116063) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 12:58:39.514478 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: INFO nova.api.openstack.requestlog [None req-c608375c-0783-438e-9eaa-d70b5fea6baf tempest-ServerRescueNegativeTestJSON-1573931620 tempest-ServerRescueNegativeTestJSON-1573931620-project] 10.222.0.49 "GET /compute/v2.1/servers/60694e1e-d0cb-41c8-adf5-bdda49804385" status: 200 len: 1322 microversion: 2.1 time: 0.574008 Dec 14 12:58:39.515566 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: [pid: 116063|app: 0|req: 53/97] 10.222.0.49 () {58 vars in 1235 bytes} [Tue Dec 14 12:58:38 2021] GET /compute/v2.1/servers/60694e1e-d0cb-41c8-adf5-bdda49804385 => generated 1322 bytes in 576 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 14 12:58:39.520574 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.api.openstack.wsgi [None req-dd277f75-01ae-4e28-a869-909c6c91ba06 tempest-AttachVolumeNegativeTest-1000400951 tempest-AttachVolumeNegativeTest-1000400951-project] Calling method '>' {{(pid=116063) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 12:58:39.521902 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.compute.api [None req-dd277f75-01ae-4e28-a869-909c6c91ba06 tempest-AttachVolumeNegativeTest-1000400951 tempest-AttachVolumeNegativeTest-1000400951-project] [instance: 824eca5b-954f-402d-aa22-14f24ddd77ba] Fetching instance by UUID {{(pid=116063) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 12:58:39.529854 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-dd277f75-01ae-4e28-a869-909c6c91ba06 tempest-AttachVolumeNegativeTest-1000400951 tempest-AttachVolumeNegativeTest-1000400951-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 12:58:39.530446 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-dd277f75-01ae-4e28-a869-909c6c91ba06 tempest-AttachVolumeNegativeTest-1000400951 tempest-AttachVolumeNegativeTest-1000400951-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 12:58:39.531757 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-dd277f75-01ae-4e28-a869-909c6c91ba06 tempest-AttachVolumeNegativeTest-1000400951 tempest-AttachVolumeNegativeTest-1000400951-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 12:58:39.532543 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-dd277f75-01ae-4e28-a869-909c6c91ba06 tempest-AttachVolumeNegativeTest-1000400951 tempest-AttachVolumeNegativeTest-1000400951-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 12:58:39.724387 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.policy [None req-a7f1ad55-9aba-49bf-bd3d-faa0d48c171b tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79d74a2ea1e541d28d085c15cec34032', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68a8770b8dbe489a8119016fbee64eb5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116064) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 12:58:39.761684 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.policy [None req-a7f1ad55-9aba-49bf-bd3d-faa0d48c171b tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '79d74a2ea1e541d28d085c15cec34032', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68a8770b8dbe489a8119016fbee64eb5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116064) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 12:58:39.771111 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.policy [None req-a7f1ad55-9aba-49bf-bd3d-faa0d48c171b tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '79d74a2ea1e541d28d085c15cec34032', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68a8770b8dbe489a8119016fbee64eb5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116064) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 12:58:39.778422 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: INFO nova.api.openstack.requestlog [None req-a7f1ad55-9aba-49bf-bd3d-faa0d48c171b tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] 10.222.0.49 "GET /compute/v2.1/servers/c8de7730-62f2-4a77-b1e9-cf6a74fa366d" status: 200 len: 1407 microversion: 2.20 time: 0.507022 Dec 14 12:58:39.779045 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: [pid: 116064|app: 0|req: 45/98] 10.222.0.49 () {60 vars in 1276 bytes} [Tue Dec 14 12:58:39 2021] GET /compute/v2.1/servers/c8de7730-62f2-4a77-b1e9-cf6a74fa366d => generated 1407 bytes in 508 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Dec 14 12:58:39.794471 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.api.openstack.wsgi [req-3be5387e-231c-4c3a-bd69-da104ad8d81a req-0b70ec32-fa1a-483d-af27-4d838e6ed668 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "eb6e04a4-8901-47df-9b51-7c1664bd3f6c", "name": "network-vif-plugged", "status": "completed", "tag": "97df3dc5-b4a4-4c81-9f39-f292ced202fb"}, {"server_uuid": "824eca5b-954f-402d-aa22-14f24ddd77ba", "name": "network-vif-plugged", "status": "completed", "tag": "11ccc809-2261-401d-8da3-2d48bb297543"}, {"server_uuid": "60694e1e-d0cb-41c8-adf5-bdda49804385", "name": "network-vif-plugged", "status": "completed", "tag": "dc3fb812-3df8-4cc0-9829-c46ef1394592"}]} {{(pid=116064) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 14 12:58:39.802684 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 14 12:58:39.802684 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: warnings.warn(msg) Dec 14 12:58:39.829906 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.policy [None req-dd277f75-01ae-4e28-a869-909c6c91ba06 tempest-AttachVolumeNegativeTest-1000400951 tempest-AttachVolumeNegativeTest-1000400951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57d0ec01f0784c8ea87d339980bed3cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad27b8951cae4eeeafa257f45217653a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116063) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 12:58:39.836546 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [req-3be5387e-231c-4c3a-bd69-da104ad8d81a req-0b70ec32-fa1a-483d-af27-4d838e6ed668 service nova] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 12:58:39.837033 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [req-3be5387e-231c-4c3a-bd69-da104ad8d81a req-0b70ec32-fa1a-483d-af27-4d838e6ed668 service nova] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 12:58:39.837500 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: INFO nova.api.openstack.requestlog [None req-dd277f75-01ae-4e28-a869-909c6c91ba06 tempest-AttachVolumeNegativeTest-1000400951 tempest-AttachVolumeNegativeTest-1000400951-project] 10.222.0.49 "GET /compute/v2.1/servers/824eca5b-954f-402d-aa22-14f24ddd77ba" status: 200 len: 1318 microversion: 2.1 time: 0.320711 Dec 14 12:58:39.838069 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: [pid: 116063|app: 0|req: 54/99] 10.222.0.49 () {58 vars in 1235 bytes} [Tue Dec 14 12:58:39 2021] GET /compute/v2.1/servers/824eca5b-954f-402d-aa22-14f24ddd77ba => generated 1318 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 14 12:58:39.845064 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.api.openstack.wsgi [None req-b0e3b196-c5e3-45de-a2b0-d8370d438a5d tempest-DeleteServersTestJSON-1329684180 tempest-DeleteServersTestJSON-1329684180-project] Calling method '>' {{(pid=116063) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 12:58:39.845872 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.compute.api [None req-b0e3b196-c5e3-45de-a2b0-d8370d438a5d tempest-DeleteServersTestJSON-1329684180 tempest-DeleteServersTestJSON-1329684180-project] [instance: 0632db38-ebd1-43c1-8ab9-04fbb19edfa7] Fetching instance by UUID {{(pid=116063) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 12:58:39.867021 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-b0e3b196-c5e3-45de-a2b0-d8370d438a5d tempest-DeleteServersTestJSON-1329684180 tempest-DeleteServersTestJSON-1329684180-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 12:58:39.867499 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-b0e3b196-c5e3-45de-a2b0-d8370d438a5d tempest-DeleteServersTestJSON-1329684180 tempest-DeleteServersTestJSON-1329684180-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 12:58:39.868272 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-b0e3b196-c5e3-45de-a2b0-d8370d438a5d tempest-DeleteServersTestJSON-1329684180 tempest-DeleteServersTestJSON-1329684180-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 12:58:39.868754 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-b0e3b196-c5e3-45de-a2b0-d8370d438a5d tempest-DeleteServersTestJSON-1329684180 tempest-DeleteServersTestJSON-1329684180-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 12:58:39.951487 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: INFO nova.api.openstack.compute.server_external_events [req-3be5387e-231c-4c3a-bd69-da104ad8d81a req-0b70ec32-fa1a-483d-af27-4d838e6ed668 service nova] Creating event network-vif-plugged:97df3dc5-b4a4-4c81-9f39-f292ced202fb for instance eb6e04a4-8901-47df-9b51-7c1664bd3f6c on hv-cinder-78447 Dec 14 12:58:39.952016 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: INFO nova.api.openstack.compute.server_external_events [req-3be5387e-231c-4c3a-bd69-da104ad8d81a req-0b70ec32-fa1a-483d-af27-4d838e6ed668 service nova] Creating event network-vif-plugged:11ccc809-2261-401d-8da3-2d48bb297543 for instance 824eca5b-954f-402d-aa22-14f24ddd77ba on hv-cinder-78447 Dec 14 12:58:39.956429 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: INFO nova.api.openstack.compute.server_external_events [req-3be5387e-231c-4c3a-bd69-da104ad8d81a req-0b70ec32-fa1a-483d-af27-4d838e6ed668 service nova] Creating event network-vif-plugged:dc3fb812-3df8-4cc0-9829-c46ef1394592 for instance 60694e1e-d0cb-41c8-adf5-bdda49804385 on hv-cinder-78447 Dec 14 12:58:39.978872 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: INFO nova.api.openstack.requestlog [req-3be5387e-231c-4c3a-bd69-da104ad8d81a req-0b70ec32-fa1a-483d-af27-4d838e6ed668 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 525 microversion: 2.1 time: 0.196124 Dec 14 12:58:39.980293 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: [pid: 116064|app: 0|req: 46/100] 10.222.0.49 () {64 vars in 1317 bytes} [Tue Dec 14 12:58:39 2021] POST /compute/v2.1/os-server-external-events => generated 525 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 14 12:58:40.079182 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.policy [None req-b0e3b196-c5e3-45de-a2b0-d8370d438a5d tempest-DeleteServersTestJSON-1329684180 tempest-DeleteServersTestJSON-1329684180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f4dc5a1bdfc4430b8fa39a5eec81f33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb24e38ec8e34dd9a93459b7ff9ba97a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116063) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 12:58:40.088056 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: INFO nova.api.openstack.requestlog [None req-b0e3b196-c5e3-45de-a2b0-d8370d438a5d tempest-DeleteServersTestJSON-1329684180 tempest-DeleteServersTestJSON-1329684180-project] 10.222.0.49 "GET /compute/v2.1/servers/0632db38-ebd1-43c1-8ab9-04fbb19edfa7" status: 200 len: 1314 microversion: 2.1 time: 0.246483 Dec 14 12:58:40.093346 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: [pid: 116063|app: 0|req: 55/101] 10.222.0.49 () {58 vars in 1235 bytes} [Tue Dec 14 12:58:39 2021] GET /compute/v2.1/servers/0632db38-ebd1-43c1-8ab9-04fbb19edfa7 => generated 1314 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 14 12:58:40.534511 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.api.openstack.wsgi [None req-357dc3a7-b47d-4adc-8071-f7c3bda29d36 tempest-ServerRescueNegativeTestJSON-1573931620 tempest-ServerRescueNegativeTestJSON-1573931620-project] Calling method '>' {{(pid=116064) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 12:58:40.535276 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.compute.api [None req-357dc3a7-b47d-4adc-8071-f7c3bda29d36 tempest-ServerRescueNegativeTestJSON-1573931620 tempest-ServerRescueNegativeTestJSON-1573931620-project] [instance: 60694e1e-d0cb-41c8-adf5-bdda49804385] Fetching instance by UUID {{(pid=116064) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 12:58:40.542677 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-357dc3a7-b47d-4adc-8071-f7c3bda29d36 tempest-ServerRescueNegativeTestJSON-1573931620 tempest-ServerRescueNegativeTestJSON-1573931620-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 12:58:40.543680 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-357dc3a7-b47d-4adc-8071-f7c3bda29d36 tempest-ServerRescueNegativeTestJSON-1573931620 tempest-ServerRescueNegativeTestJSON-1573931620-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 12:58:40.544671 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-357dc3a7-b47d-4adc-8071-f7c3bda29d36 tempest-ServerRescueNegativeTestJSON-1573931620 tempest-ServerRescueNegativeTestJSON-1573931620-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 12:58:40.545110 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-357dc3a7-b47d-4adc-8071-f7c3bda29d36 tempest-ServerRescueNegativeTestJSON-1573931620 tempest-ServerRescueNegativeTestJSON-1573931620-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 12:58:40.776981 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.policy [None req-357dc3a7-b47d-4adc-8071-f7c3bda29d36 tempest-ServerRescueNegativeTestJSON-1573931620 tempest-ServerRescueNegativeTestJSON-1573931620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '731cbbfe17214ded8ac66299d66dfc45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '010919ea84eb4eb8b936c63153600eba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116064) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 12:58:40.787185 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: INFO nova.api.openstack.requestlog [None req-357dc3a7-b47d-4adc-8071-f7c3bda29d36 tempest-ServerRescueNegativeTestJSON-1573931620 tempest-ServerRescueNegativeTestJSON-1573931620-project] 10.222.0.49 "GET /compute/v2.1/servers/60694e1e-d0cb-41c8-adf5-bdda49804385" status: 200 len: 1322 microversion: 2.1 time: 0.259587 Dec 14 12:58:40.788091 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: [pid: 116064|app: 0|req: 47/102] 10.222.0.49 () {58 vars in 1235 bytes} [Tue Dec 14 12:58:40 2021] GET /compute/v2.1/servers/60694e1e-d0cb-41c8-adf5-bdda49804385 => generated 1322 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 14 12:58:40.803297 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.api.openstack.wsgi [None req-490c4bf1-3785-4c0f-b028-7501ca2e1eb6 tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] Calling method '>' {{(pid=116063) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 12:58:40.804442 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.compute.api [None req-490c4bf1-3785-4c0f-b028-7501ca2e1eb6 tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] [instance: c8de7730-62f2-4a77-b1e9-cf6a74fa366d] Fetching instance by UUID {{(pid=116063) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 12:58:40.821170 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-490c4bf1-3785-4c0f-b028-7501ca2e1eb6 tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 12:58:40.821968 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-490c4bf1-3785-4c0f-b028-7501ca2e1eb6 tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 12:58:40.824240 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-490c4bf1-3785-4c0f-b028-7501ca2e1eb6 tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 12:58:40.824770 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-490c4bf1-3785-4c0f-b028-7501ca2e1eb6 tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 12:58:40.855014 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.api.openstack.wsgi [None req-94790415-0ab5-42a2-83b9-143d25152255 tempest-AttachVolumeNegativeTest-1000400951 tempest-AttachVolumeNegativeTest-1000400951-project] Calling method '>' {{(pid=116064) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 12:58:40.856372 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.compute.api [None req-94790415-0ab5-42a2-83b9-143d25152255 tempest-AttachVolumeNegativeTest-1000400951 tempest-AttachVolumeNegativeTest-1000400951-project] [instance: 824eca5b-954f-402d-aa22-14f24ddd77ba] Fetching instance by UUID {{(pid=116064) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 12:58:40.869541 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-94790415-0ab5-42a2-83b9-143d25152255 tempest-AttachVolumeNegativeTest-1000400951 tempest-AttachVolumeNegativeTest-1000400951-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 12:58:40.871253 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-94790415-0ab5-42a2-83b9-143d25152255 tempest-AttachVolumeNegativeTest-1000400951 tempest-AttachVolumeNegativeTest-1000400951-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 12:58:40.875586 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-94790415-0ab5-42a2-83b9-143d25152255 tempest-AttachVolumeNegativeTest-1000400951 tempest-AttachVolumeNegativeTest-1000400951-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 12:58:40.876303 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-94790415-0ab5-42a2-83b9-143d25152255 tempest-AttachVolumeNegativeTest-1000400951 tempest-AttachVolumeNegativeTest-1000400951-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 12:58:41.227005 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.policy [None req-490c4bf1-3785-4c0f-b028-7501ca2e1eb6 tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79d74a2ea1e541d28d085c15cec34032', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68a8770b8dbe489a8119016fbee64eb5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116063) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 12:58:41.233618 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.policy [None req-94790415-0ab5-42a2-83b9-143d25152255 tempest-AttachVolumeNegativeTest-1000400951 tempest-AttachVolumeNegativeTest-1000400951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57d0ec01f0784c8ea87d339980bed3cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad27b8951cae4eeeafa257f45217653a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116064) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 12:58:41.242474 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: INFO nova.api.openstack.requestlog [None req-94790415-0ab5-42a2-83b9-143d25152255 tempest-AttachVolumeNegativeTest-1000400951 tempest-AttachVolumeNegativeTest-1000400951-project] 10.222.0.49 "GET /compute/v2.1/servers/824eca5b-954f-402d-aa22-14f24ddd77ba" status: 200 len: 1318 microversion: 2.1 time: 0.391669 Dec 14 12:58:41.243998 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: [pid: 116064|app: 0|req: 48/103] 10.222.0.49 () {58 vars in 1235 bytes} [Tue Dec 14 12:58:40 2021] GET /compute/v2.1/servers/824eca5b-954f-402d-aa22-14f24ddd77ba => generated 1318 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 14 12:58:41.247437 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.policy [None req-490c4bf1-3785-4c0f-b028-7501ca2e1eb6 tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '79d74a2ea1e541d28d085c15cec34032', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68a8770b8dbe489a8119016fbee64eb5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116063) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 12:58:41.249209 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.policy [None req-490c4bf1-3785-4c0f-b028-7501ca2e1eb6 tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '79d74a2ea1e541d28d085c15cec34032', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68a8770b8dbe489a8119016fbee64eb5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116063) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 12:58:41.250655 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: INFO nova.api.openstack.requestlog [None req-490c4bf1-3785-4c0f-b028-7501ca2e1eb6 tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] 10.222.0.49 "GET /compute/v2.1/servers/c8de7730-62f2-4a77-b1e9-cf6a74fa366d" status: 200 len: 1407 microversion: 2.20 time: 0.453522 Dec 14 12:58:41.251618 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: [pid: 116063|app: 0|req: 56/104] 10.222.0.49 () {60 vars in 1276 bytes} [Tue Dec 14 12:58:40 2021] GET /compute/v2.1/servers/c8de7730-62f2-4a77-b1e9-cf6a74fa366d => generated 1407 bytes in 459 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 14 12:58:41.261443 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.api.openstack.wsgi [None req-cbca3d2d-1b79-4797-ab2f-1fa5d80e4343 tempest-DeleteServersTestJSON-1329684180 tempest-DeleteServersTestJSON-1329684180-project] Calling method '>' {{(pid=116064) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 12:58:41.262171 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.compute.api [None req-cbca3d2d-1b79-4797-ab2f-1fa5d80e4343 tempest-DeleteServersTestJSON-1329684180 tempest-DeleteServersTestJSON-1329684180-project] [instance: 0632db38-ebd1-43c1-8ab9-04fbb19edfa7] Fetching instance by UUID {{(pid=116064) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 12:58:41.282408 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-cbca3d2d-1b79-4797-ab2f-1fa5d80e4343 tempest-DeleteServersTestJSON-1329684180 tempest-DeleteServersTestJSON-1329684180-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 12:58:41.282859 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-cbca3d2d-1b79-4797-ab2f-1fa5d80e4343 tempest-DeleteServersTestJSON-1329684180 tempest-DeleteServersTestJSON-1329684180-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 12:58:41.283652 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-cbca3d2d-1b79-4797-ab2f-1fa5d80e4343 tempest-DeleteServersTestJSON-1329684180 tempest-DeleteServersTestJSON-1329684180-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 12:58:41.284086 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-cbca3d2d-1b79-4797-ab2f-1fa5d80e4343 tempest-DeleteServersTestJSON-1329684180 tempest-DeleteServersTestJSON-1329684180-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 12:58:41.441820 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.policy [None req-cbca3d2d-1b79-4797-ab2f-1fa5d80e4343 tempest-DeleteServersTestJSON-1329684180 tempest-DeleteServersTestJSON-1329684180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f4dc5a1bdfc4430b8fa39a5eec81f33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb24e38ec8e34dd9a93459b7ff9ba97a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116064) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 12:58:41.449342 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: INFO nova.api.openstack.requestlog [None req-cbca3d2d-1b79-4797-ab2f-1fa5d80e4343 tempest-DeleteServersTestJSON-1329684180 tempest-DeleteServersTestJSON-1329684180-project] 10.222.0.49 "GET /compute/v2.1/servers/0632db38-ebd1-43c1-8ab9-04fbb19edfa7" status: 200 len: 1501 microversion: 2.1 time: 0.203167 Dec 14 12:58:41.461699 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: [pid: 116064|app: 0|req: 49/105] 10.222.0.49 () {58 vars in 1235 bytes} [Tue Dec 14 12:58:41 2021] GET /compute/v2.1/servers/0632db38-ebd1-43c1-8ab9-04fbb19edfa7 => generated 1501 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 14 12:58:41.807046 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.api.openstack.wsgi [None req-b96d0f36-f94f-4a5c-a430-6afac7651aa5 tempest-ServerRescueNegativeTestJSON-1573931620 tempest-ServerRescueNegativeTestJSON-1573931620-project] Calling method '>' {{(pid=116063) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 12:58:41.808136 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.compute.api [None req-b96d0f36-f94f-4a5c-a430-6afac7651aa5 tempest-ServerRescueNegativeTestJSON-1573931620 tempest-ServerRescueNegativeTestJSON-1573931620-project] [instance: 60694e1e-d0cb-41c8-adf5-bdda49804385] Fetching instance by UUID {{(pid=116063) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 12:58:41.819926 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-b96d0f36-f94f-4a5c-a430-6afac7651aa5 tempest-ServerRescueNegativeTestJSON-1573931620 tempest-ServerRescueNegativeTestJSON-1573931620-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 12:58:41.820805 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-b96d0f36-f94f-4a5c-a430-6afac7651aa5 tempest-ServerRescueNegativeTestJSON-1573931620 tempest-ServerRescueNegativeTestJSON-1573931620-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 12:58:41.823139 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-b96d0f36-f94f-4a5c-a430-6afac7651aa5 tempest-ServerRescueNegativeTestJSON-1573931620 tempest-ServerRescueNegativeTestJSON-1573931620-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 12:58:41.824526 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-b96d0f36-f94f-4a5c-a430-6afac7651aa5 tempest-ServerRescueNegativeTestJSON-1573931620 tempest-ServerRescueNegativeTestJSON-1573931620-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 12:58:42.088196 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.policy [None req-b96d0f36-f94f-4a5c-a430-6afac7651aa5 tempest-ServerRescueNegativeTestJSON-1573931620 tempest-ServerRescueNegativeTestJSON-1573931620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '731cbbfe17214ded8ac66299d66dfc45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '010919ea84eb4eb8b936c63153600eba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116063) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 12:58:42.096924 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: INFO nova.api.openstack.requestlog [None req-b96d0f36-f94f-4a5c-a430-6afac7651aa5 tempest-ServerRescueNegativeTestJSON-1573931620 tempest-ServerRescueNegativeTestJSON-1573931620-project] 10.222.0.49 "GET /compute/v2.1/servers/60694e1e-d0cb-41c8-adf5-bdda49804385" status: 200 len: 1322 microversion: 2.1 time: 0.294897 Dec 14 12:58:42.112064 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: [pid: 116063|app: 0|req: 57/106] 10.222.0.49 () {58 vars in 1235 bytes} [Tue Dec 14 12:58:41 2021] GET /compute/v2.1/servers/60694e1e-d0cb-41c8-adf5-bdda49804385 => generated 1322 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 14 12:58:42.267044 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.api.openstack.wsgi [None req-f280e463-3b7f-451d-957b-7257b9608f8b tempest-AttachVolumeNegativeTest-1000400951 tempest-AttachVolumeNegativeTest-1000400951-project] Calling method '>' {{(pid=116064) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 12:58:42.268628 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.compute.api [None req-f280e463-3b7f-451d-957b-7257b9608f8b tempest-AttachVolumeNegativeTest-1000400951 tempest-AttachVolumeNegativeTest-1000400951-project] [instance: 824eca5b-954f-402d-aa22-14f24ddd77ba] Fetching instance by UUID {{(pid=116064) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 12:58:42.270974 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.api.openstack.wsgi [None req-fea274e5-a035-4992-aebd-4d0039c8fa9e tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] Calling method '>' {{(pid=116063) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 12:58:42.273145 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.compute.api [None req-fea274e5-a035-4992-aebd-4d0039c8fa9e tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] [instance: c8de7730-62f2-4a77-b1e9-cf6a74fa366d] Fetching instance by UUID {{(pid=116063) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 12:58:42.279033 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-f280e463-3b7f-451d-957b-7257b9608f8b tempest-AttachVolumeNegativeTest-1000400951 tempest-AttachVolumeNegativeTest-1000400951-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 12:58:42.279472 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-f280e463-3b7f-451d-957b-7257b9608f8b tempest-AttachVolumeNegativeTest-1000400951 tempest-AttachVolumeNegativeTest-1000400951-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 12:58:42.284703 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-f280e463-3b7f-451d-957b-7257b9608f8b tempest-AttachVolumeNegativeTest-1000400951 tempest-AttachVolumeNegativeTest-1000400951-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 12:58:42.285342 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-f280e463-3b7f-451d-957b-7257b9608f8b tempest-AttachVolumeNegativeTest-1000400951 tempest-AttachVolumeNegativeTest-1000400951-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 12:58:42.286567 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-fea274e5-a035-4992-aebd-4d0039c8fa9e tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 12:58:42.288602 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-fea274e5-a035-4992-aebd-4d0039c8fa9e tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 12:58:42.291291 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-fea274e5-a035-4992-aebd-4d0039c8fa9e tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 12:58:42.292899 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-fea274e5-a035-4992-aebd-4d0039c8fa9e tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 12:58:42.746320 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.policy [None req-fea274e5-a035-4992-aebd-4d0039c8fa9e tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79d74a2ea1e541d28d085c15cec34032', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68a8770b8dbe489a8119016fbee64eb5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116063) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 12:58:42.763811 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.policy [None req-fea274e5-a035-4992-aebd-4d0039c8fa9e tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '79d74a2ea1e541d28d085c15cec34032', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68a8770b8dbe489a8119016fbee64eb5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116063) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 12:58:42.765693 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.policy [None req-fea274e5-a035-4992-aebd-4d0039c8fa9e tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '79d74a2ea1e541d28d085c15cec34032', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68a8770b8dbe489a8119016fbee64eb5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116063) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 12:58:42.766992 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: INFO nova.api.openstack.requestlog [None req-fea274e5-a035-4992-aebd-4d0039c8fa9e tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] 10.222.0.49 "GET /compute/v2.1/servers/c8de7730-62f2-4a77-b1e9-cf6a74fa366d" status: 200 len: 1407 microversion: 2.20 time: 0.500842 Dec 14 12:58:42.767700 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: [pid: 116063|app: 0|req: 58/107] 10.222.0.49 () {60 vars in 1276 bytes} [Tue Dec 14 12:58:42 2021] GET /compute/v2.1/servers/c8de7730-62f2-4a77-b1e9-cf6a74fa366d => generated 1407 bytes in 502 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Dec 14 12:58:42.777877 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.api.openstack.wsgi [req-fbba3381-6e9a-47d4-8701-1ee79762ea02 req-07ad68e4-15d8-4344-9685-5a0b219f2b15 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c8de7730-62f2-4a77-b1e9-cf6a74fa366d", "name": "network-vif-plugged", "status": "completed", "tag": "45d34d58-1ff8-4ce3-a024-e2acb9451196"}]} {{(pid=116063) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 14 12:58:42.779918 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 14 12:58:42.779918 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: warnings.warn(msg) Dec 14 12:58:42.786164 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.policy [None req-f280e463-3b7f-451d-957b-7257b9608f8b tempest-AttachVolumeNegativeTest-1000400951 tempest-AttachVolumeNegativeTest-1000400951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57d0ec01f0784c8ea87d339980bed3cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad27b8951cae4eeeafa257f45217653a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116064) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 12:58:42.793022 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [req-fbba3381-6e9a-47d4-8701-1ee79762ea02 req-07ad68e4-15d8-4344-9685-5a0b219f2b15 service nova] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 12:58:42.793574 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [req-fbba3381-6e9a-47d4-8701-1ee79762ea02 req-07ad68e4-15d8-4344-9685-5a0b219f2b15 service nova] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 12:58:42.799521 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: INFO nova.api.openstack.requestlog [None req-f280e463-3b7f-451d-957b-7257b9608f8b tempest-AttachVolumeNegativeTest-1000400951 tempest-AttachVolumeNegativeTest-1000400951-project] 10.222.0.49 "GET /compute/v2.1/servers/824eca5b-954f-402d-aa22-14f24ddd77ba" status: 200 len: 1508 microversion: 2.1 time: 0.539574 Dec 14 12:58:42.801840 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: [pid: 116064|app: 0|req: 50/108] 10.222.0.49 () {58 vars in 1235 bytes} [Tue Dec 14 12:58:42 2021] GET /compute/v2.1/servers/824eca5b-954f-402d-aa22-14f24ddd77ba => generated 1508 bytes in 542 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 14 12:58:42.812627 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: INFO nova.api.openstack.compute.server_external_events [req-fbba3381-6e9a-47d4-8701-1ee79762ea02 req-07ad68e4-15d8-4344-9685-5a0b219f2b15 service nova] Creating event network-vif-plugged:45d34d58-1ff8-4ce3-a024-e2acb9451196 for instance c8de7730-62f2-4a77-b1e9-cf6a74fa366d on hv-cinder-78447 Dec 14 12:58:42.818202 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: INFO nova.api.openstack.requestlog [req-fbba3381-6e9a-47d4-8701-1ee79762ea02 req-07ad68e4-15d8-4344-9685-5a0b219f2b15 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.049088 Dec 14 12:58:42.819292 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: [pid: 116063|app: 0|req: 59/109] 10.222.0.49 () {64 vars in 1317 bytes} [Tue Dec 14 12:58:42 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 14 12:58:42.946076 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.api.openstack.wsgi [None req-0a98b860-7e44-4fed-aef7-168c3a012459 tempest-DeleteServersTestJSON-1329684180 tempest-DeleteServersTestJSON-1329684180-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "4c5dbeaf-f637-470c-8bbf-8043830e39fc"}} {{(pid=116064) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 14 12:58:42.947475 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.compute.api [None req-0a98b860-7e44-4fed-aef7-168c3a012459 tempest-DeleteServersTestJSON-1329684180 tempest-DeleteServersTestJSON-1329684180-project] [instance: 0632db38-ebd1-43c1-8ab9-04fbb19edfa7] Fetching instance by UUID {{(pid=116064) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 12:58:42.954652 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-0a98b860-7e44-4fed-aef7-168c3a012459 tempest-DeleteServersTestJSON-1329684180 tempest-DeleteServersTestJSON-1329684180-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 12:58:42.955248 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-0a98b860-7e44-4fed-aef7-168c3a012459 tempest-DeleteServersTestJSON-1329684180 tempest-DeleteServersTestJSON-1329684180-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 12:58:42.956206 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-0a98b860-7e44-4fed-aef7-168c3a012459 tempest-DeleteServersTestJSON-1329684180 tempest-DeleteServersTestJSON-1329684180-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 12:58:42.956876 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-0a98b860-7e44-4fed-aef7-168c3a012459 tempest-DeleteServersTestJSON-1329684180 tempest-DeleteServersTestJSON-1329684180-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 12:58:43.120264 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.api.openstack.wsgi [None req-72e703ee-4802-477a-a249-5e18bfad7006 tempest-ServerRescueNegativeTestJSON-1573931620 tempest-ServerRescueNegativeTestJSON-1573931620-project] Calling method '>' {{(pid=116063) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 12:58:43.121001 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.compute.api [None req-72e703ee-4802-477a-a249-5e18bfad7006 tempest-ServerRescueNegativeTestJSON-1573931620 tempest-ServerRescueNegativeTestJSON-1573931620-project] [instance: 60694e1e-d0cb-41c8-adf5-bdda49804385] Fetching instance by UUID {{(pid=116063) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 12:58:43.140035 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-72e703ee-4802-477a-a249-5e18bfad7006 tempest-ServerRescueNegativeTestJSON-1573931620 tempest-ServerRescueNegativeTestJSON-1573931620-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 12:58:43.142062 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-72e703ee-4802-477a-a249-5e18bfad7006 tempest-ServerRescueNegativeTestJSON-1573931620 tempest-ServerRescueNegativeTestJSON-1573931620-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 12:58:43.143822 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-72e703ee-4802-477a-a249-5e18bfad7006 tempest-ServerRescueNegativeTestJSON-1573931620 tempest-ServerRescueNegativeTestJSON-1573931620-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 12:58:43.145415 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-72e703ee-4802-477a-a249-5e18bfad7006 tempest-ServerRescueNegativeTestJSON-1573931620 tempest-ServerRescueNegativeTestJSON-1573931620-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 12:58:43.394431 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.policy [None req-72e703ee-4802-477a-a249-5e18bfad7006 tempest-ServerRescueNegativeTestJSON-1573931620 tempest-ServerRescueNegativeTestJSON-1573931620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '731cbbfe17214ded8ac66299d66dfc45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '010919ea84eb4eb8b936c63153600eba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116063) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 12:58:43.402484 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: INFO nova.api.openstack.requestlog [None req-72e703ee-4802-477a-a249-5e18bfad7006 tempest-ServerRescueNegativeTestJSON-1573931620 tempest-ServerRescueNegativeTestJSON-1573931620-project] 10.222.0.49 "GET /compute/v2.1/servers/60694e1e-d0cb-41c8-adf5-bdda49804385" status: 200 len: 1517 microversion: 2.1 time: 0.292166 Dec 14 12:58:43.403341 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: [pid: 116063|app: 0|req: 60/110] 10.222.0.49 () {58 vars in 1235 bytes} [Tue Dec 14 12:58:43 2021] GET /compute/v2.1/servers/60694e1e-d0cb-41c8-adf5-bdda49804385 => generated 1517 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 14 12:58:43.420751 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.api.openstack.wsgi [None req-46eaa6e5-f614-4ff5-b38c-1ee6dda5f196 tempest-ServerRescueNegativeTestJSON-1573931620 tempest-ServerRescueNegativeTestJSON-1573931620-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=116063) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 14 12:58:43.422047 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.compute.api [None req-46eaa6e5-f614-4ff5-b38c-1ee6dda5f196 tempest-ServerRescueNegativeTestJSON-1573931620 tempest-ServerRescueNegativeTestJSON-1573931620-project] [instance: 60694e1e-d0cb-41c8-adf5-bdda49804385] Fetching instance by UUID {{(pid=116063) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 12:58:43.428164 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-46eaa6e5-f614-4ff5-b38c-1ee6dda5f196 tempest-ServerRescueNegativeTestJSON-1573931620 tempest-ServerRescueNegativeTestJSON-1573931620-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 12:58:43.428664 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-46eaa6e5-f614-4ff5-b38c-1ee6dda5f196 tempest-ServerRescueNegativeTestJSON-1573931620 tempest-ServerRescueNegativeTestJSON-1573931620-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 12:58:43.429758 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-46eaa6e5-f614-4ff5-b38c-1ee6dda5f196 tempest-ServerRescueNegativeTestJSON-1573931620 tempest-ServerRescueNegativeTestJSON-1573931620-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 12:58:43.430199 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-46eaa6e5-f614-4ff5-b38c-1ee6dda5f196 tempest-ServerRescueNegativeTestJSON-1573931620 tempest-ServerRescueNegativeTestJSON-1573931620-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 12:58:43.491906 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.objects.instance [None req-46eaa6e5-f614-4ff5-b38c-1ee6dda5f196 tempest-ServerRescueNegativeTestJSON-1573931620 tempest-ServerRescueNegativeTestJSON-1573931620-project] Lazy-loading 'flavor' on Instance uuid 60694e1e-d0cb-41c8-adf5-bdda49804385 {{(pid=116063) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Dec 14 12:58:43.631516 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: INFO nova.api.openstack.requestlog [None req-46eaa6e5-f614-4ff5-b38c-1ee6dda5f196 tempest-ServerRescueNegativeTestJSON-1573931620 tempest-ServerRescueNegativeTestJSON-1573931620-project] 10.222.0.49 "POST /compute/v2.1/servers/60694e1e-d0cb-41c8-adf5-bdda49804385/action" status: 200 len: 32 microversion: 2.1 time: 0.215223 Dec 14 12:58:43.633529 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: [pid: 116063|app: 0|req: 61/111] 10.222.0.49 () {60 vars in 1277 bytes} [Tue Dec 14 12:58:43 2021] POST /compute/v2.1/servers/60694e1e-d0cb-41c8-adf5-bdda49804385/action => generated 32 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Dec 14 12:58:43.643384 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.api.openstack.wsgi [None req-83325c97-5514-43ca-8dda-3563ca8db563 tempest-ServerRescueNegativeTestJSON-1573931620 tempest-ServerRescueNegativeTestJSON-1573931620-project] Calling method '>' {{(pid=116063) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 12:58:43.644052 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.compute.api [None req-83325c97-5514-43ca-8dda-3563ca8db563 tempest-ServerRescueNegativeTestJSON-1573931620 tempest-ServerRescueNegativeTestJSON-1573931620-project] [instance: 60694e1e-d0cb-41c8-adf5-bdda49804385] Fetching instance by UUID {{(pid=116063) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 12:58:43.653757 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-83325c97-5514-43ca-8dda-3563ca8db563 tempest-ServerRescueNegativeTestJSON-1573931620 tempest-ServerRescueNegativeTestJSON-1573931620-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 12:58:43.654462 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-83325c97-5514-43ca-8dda-3563ca8db563 tempest-ServerRescueNegativeTestJSON-1573931620 tempest-ServerRescueNegativeTestJSON-1573931620-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 12:58:43.659168 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-83325c97-5514-43ca-8dda-3563ca8db563 tempest-ServerRescueNegativeTestJSON-1573931620 tempest-ServerRescueNegativeTestJSON-1573931620-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 12:58:43.659989 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-83325c97-5514-43ca-8dda-3563ca8db563 tempest-ServerRescueNegativeTestJSON-1573931620 tempest-ServerRescueNegativeTestJSON-1573931620-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 12:58:43.747123 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: INFO nova.api.openstack.requestlog [None req-0a98b860-7e44-4fed-aef7-168c3a012459 tempest-DeleteServersTestJSON-1329684180 tempest-DeleteServersTestJSON-1329684180-project] 10.222.0.49 "POST /compute/v2.1/servers/0632db38-ebd1-43c1-8ab9-04fbb19edfa7/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.804249 Dec 14 12:58:43.755279 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: [pid: 116064|app: 0|req: 51/112] 10.222.0.49 () {60 vars in 1322 bytes} [Tue Dec 14 12:58:42 2021] POST /compute/v2.1/servers/0632db38-ebd1-43c1-8ab9-04fbb19edfa7/os-volume_attachments => generated 194 bytes in 814 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 14 12:58:43.793340 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.api.openstack.wsgi [None req-5c1b40a3-dfc7-4158-b0b6-91b93e62fab5 tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] Calling method '>' {{(pid=116064) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 12:58:43.794781 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.compute.api [None req-5c1b40a3-dfc7-4158-b0b6-91b93e62fab5 tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] [instance: c8de7730-62f2-4a77-b1e9-cf6a74fa366d] Fetching instance by UUID {{(pid=116064) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 12:58:43.820308 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-5c1b40a3-dfc7-4158-b0b6-91b93e62fab5 tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 12:58:43.821094 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-5c1b40a3-dfc7-4158-b0b6-91b93e62fab5 tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 12:58:43.825385 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-5c1b40a3-dfc7-4158-b0b6-91b93e62fab5 tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 12:58:43.826439 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-5c1b40a3-dfc7-4158-b0b6-91b93e62fab5 tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 12:58:43.884141 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.policy [None req-83325c97-5514-43ca-8dda-3563ca8db563 tempest-ServerRescueNegativeTestJSON-1573931620 tempest-ServerRescueNegativeTestJSON-1573931620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '731cbbfe17214ded8ac66299d66dfc45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '010919ea84eb4eb8b936c63153600eba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116063) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 12:58:43.892918 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: INFO nova.api.openstack.requestlog [None req-83325c97-5514-43ca-8dda-3563ca8db563 tempest-ServerRescueNegativeTestJSON-1573931620 tempest-ServerRescueNegativeTestJSON-1573931620-project] 10.222.0.49 "GET /compute/v2.1/servers/60694e1e-d0cb-41c8-adf5-bdda49804385" status: 200 len: 1523 microversion: 2.1 time: 0.253746 Dec 14 12:58:43.893849 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: [pid: 116063|app: 0|req: 62/113] 10.222.0.49 () {58 vars in 1235 bytes} [Tue Dec 14 12:58:43 2021] GET /compute/v2.1/servers/60694e1e-d0cb-41c8-adf5-bdda49804385 => generated 1523 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 14 12:58:44.091704 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.policy [None req-5c1b40a3-dfc7-4158-b0b6-91b93e62fab5 tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79d74a2ea1e541d28d085c15cec34032', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68a8770b8dbe489a8119016fbee64eb5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116064) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 12:58:44.100675 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.policy [None req-5c1b40a3-dfc7-4158-b0b6-91b93e62fab5 tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '79d74a2ea1e541d28d085c15cec34032', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68a8770b8dbe489a8119016fbee64eb5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116064) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 12:58:44.107728 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.policy [None req-5c1b40a3-dfc7-4158-b0b6-91b93e62fab5 tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '79d74a2ea1e541d28d085c15cec34032', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68a8770b8dbe489a8119016fbee64eb5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116064) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 12:58:44.109854 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: INFO nova.api.openstack.requestlog [None req-5c1b40a3-dfc7-4158-b0b6-91b93e62fab5 tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] 10.222.0.49 "GET /compute/v2.1/servers/c8de7730-62f2-4a77-b1e9-cf6a74fa366d" status: 200 len: 1407 microversion: 2.20 time: 0.327009 Dec 14 12:58:44.113515 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: [pid: 116064|app: 0|req: 52/114] 10.222.0.49 () {60 vars in 1276 bytes} [Tue Dec 14 12:58:43 2021] GET /compute/v2.1/servers/c8de7730-62f2-4a77-b1e9-cf6a74fa366d => generated 1407 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 14 12:58:44.329741 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.api.openstack.wsgi [None req-7e3a19ec-ebe1-411d-ba78-a9325858c8a9 tempest-AttachVolumeNegativeTest-1000400951 tempest-AttachVolumeNegativeTest-1000400951-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "b622e425-4dd6-4dbb-9952-362e113ef923"}} {{(pid=116063) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 14 12:58:44.331576 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.compute.api [None req-7e3a19ec-ebe1-411d-ba78-a9325858c8a9 tempest-AttachVolumeNegativeTest-1000400951 tempest-AttachVolumeNegativeTest-1000400951-project] [instance: 824eca5b-954f-402d-aa22-14f24ddd77ba] Fetching instance by UUID {{(pid=116063) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 12:58:44.349169 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-7e3a19ec-ebe1-411d-ba78-a9325858c8a9 tempest-AttachVolumeNegativeTest-1000400951 tempest-AttachVolumeNegativeTest-1000400951-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 12:58:44.349630 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-7e3a19ec-ebe1-411d-ba78-a9325858c8a9 tempest-AttachVolumeNegativeTest-1000400951 tempest-AttachVolumeNegativeTest-1000400951-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 12:58:44.351335 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-7e3a19ec-ebe1-411d-ba78-a9325858c8a9 tempest-AttachVolumeNegativeTest-1000400951 tempest-AttachVolumeNegativeTest-1000400951-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 12:58:44.351785 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-7e3a19ec-ebe1-411d-ba78-a9325858c8a9 tempest-AttachVolumeNegativeTest-1000400951 tempest-AttachVolumeNegativeTest-1000400951-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 12:58:44.724342 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: INFO nova.api.openstack.requestlog [None req-7e3a19ec-ebe1-411d-ba78-a9325858c8a9 tempest-AttachVolumeNegativeTest-1000400951 tempest-AttachVolumeNegativeTest-1000400951-project] 10.222.0.49 "POST /compute/v2.1/servers/824eca5b-954f-402d-aa22-14f24ddd77ba/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.402503 Dec 14 12:58:44.725035 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: [pid: 116063|app: 0|req: 63/115] 10.222.0.49 () {60 vars in 1322 bytes} [Tue Dec 14 12:58:44 2021] POST /compute/v2.1/servers/824eca5b-954f-402d-aa22-14f24ddd77ba/os-volume_attachments => generated 194 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 14 12:58:44.909411 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.api.openstack.wsgi [None req-87d246b2-48b9-4e7d-a8cf-10e2d01c9b03 tempest-ServerRescueNegativeTestJSON-1573931620 tempest-ServerRescueNegativeTestJSON-1573931620-project] Calling method '>' {{(pid=116064) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 12:58:44.910538 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.compute.api [None req-87d246b2-48b9-4e7d-a8cf-10e2d01c9b03 tempest-ServerRescueNegativeTestJSON-1573931620 tempest-ServerRescueNegativeTestJSON-1573931620-project] [instance: 60694e1e-d0cb-41c8-adf5-bdda49804385] Fetching instance by UUID {{(pid=116064) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 12:58:44.916951 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-87d246b2-48b9-4e7d-a8cf-10e2d01c9b03 tempest-ServerRescueNegativeTestJSON-1573931620 tempest-ServerRescueNegativeTestJSON-1573931620-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 12:58:44.917554 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-87d246b2-48b9-4e7d-a8cf-10e2d01c9b03 tempest-ServerRescueNegativeTestJSON-1573931620 tempest-ServerRescueNegativeTestJSON-1573931620-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 12:58:44.918524 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-87d246b2-48b9-4e7d-a8cf-10e2d01c9b03 tempest-ServerRescueNegativeTestJSON-1573931620 tempest-ServerRescueNegativeTestJSON-1573931620-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 12:58:44.919102 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-87d246b2-48b9-4e7d-a8cf-10e2d01c9b03 tempest-ServerRescueNegativeTestJSON-1573931620 tempest-ServerRescueNegativeTestJSON-1573931620-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 12:58:45.062792 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.policy [None req-87d246b2-48b9-4e7d-a8cf-10e2d01c9b03 tempest-ServerRescueNegativeTestJSON-1573931620 tempest-ServerRescueNegativeTestJSON-1573931620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '731cbbfe17214ded8ac66299d66dfc45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '010919ea84eb4eb8b936c63153600eba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116064) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 12:58:45.071211 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: INFO nova.api.openstack.requestlog [None req-87d246b2-48b9-4e7d-a8cf-10e2d01c9b03 tempest-ServerRescueNegativeTestJSON-1573931620 tempest-ServerRescueNegativeTestJSON-1573931620-project] 10.222.0.49 "GET /compute/v2.1/servers/60694e1e-d0cb-41c8-adf5-bdda49804385" status: 200 len: 1523 microversion: 2.1 time: 0.165332 Dec 14 12:58:45.071817 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: [pid: 116064|app: 0|req: 53/116] 10.222.0.49 () {58 vars in 1235 bytes} [Tue Dec 14 12:58:44 2021] GET /compute/v2.1/servers/60694e1e-d0cb-41c8-adf5-bdda49804385 => generated 1523 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 14 12:58:45.133359 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.api.openstack.wsgi [None req-a7bb6085-2aec-40bd-9512-2f5e2e5bbf4a tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] Calling method '>' {{(pid=116063) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 12:58:45.134046 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.compute.api [None req-a7bb6085-2aec-40bd-9512-2f5e2e5bbf4a tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] [instance: c8de7730-62f2-4a77-b1e9-cf6a74fa366d] Fetching instance by UUID {{(pid=116063) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 12:58:45.141947 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-a7bb6085-2aec-40bd-9512-2f5e2e5bbf4a tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 12:58:45.142660 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-a7bb6085-2aec-40bd-9512-2f5e2e5bbf4a tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 12:58:45.143451 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-a7bb6085-2aec-40bd-9512-2f5e2e5bbf4a tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 12:58:45.143880 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-a7bb6085-2aec-40bd-9512-2f5e2e5bbf4a tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 12:58:45.311500 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.policy [None req-a7bb6085-2aec-40bd-9512-2f5e2e5bbf4a tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79d74a2ea1e541d28d085c15cec34032', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68a8770b8dbe489a8119016fbee64eb5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116063) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 12:58:45.319963 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.policy [None req-a7bb6085-2aec-40bd-9512-2f5e2e5bbf4a tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '79d74a2ea1e541d28d085c15cec34032', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68a8770b8dbe489a8119016fbee64eb5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116063) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 12:58:45.321586 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.policy [None req-a7bb6085-2aec-40bd-9512-2f5e2e5bbf4a tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '79d74a2ea1e541d28d085c15cec34032', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68a8770b8dbe489a8119016fbee64eb5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116063) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 12:58:45.322675 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: INFO nova.api.openstack.requestlog [None req-a7bb6085-2aec-40bd-9512-2f5e2e5bbf4a tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] 10.222.0.49 "GET /compute/v2.1/servers/c8de7730-62f2-4a77-b1e9-cf6a74fa366d" status: 200 len: 1599 microversion: 2.20 time: 0.194860 Dec 14 12:58:45.323231 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: [pid: 116063|app: 0|req: 64/117] 10.222.0.49 () {60 vars in 1276 bytes} [Tue Dec 14 12:58:45 2021] GET /compute/v2.1/servers/c8de7730-62f2-4a77-b1e9-cf6a74fa366d => generated 1599 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 14 12:58:45.340552 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.api.openstack.wsgi [None req-58348fb9-be77-48f6-93be-fabb2cb9bfbc tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] Calling method '>' {{(pid=116064) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 12:58:45.341074 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.compute.api [None req-58348fb9-be77-48f6-93be-fabb2cb9bfbc tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] [instance: c8de7730-62f2-4a77-b1e9-cf6a74fa366d] Fetching instance by UUID {{(pid=116064) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 12:58:45.347845 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-58348fb9-be77-48f6-93be-fabb2cb9bfbc tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 12:58:45.348292 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-58348fb9-be77-48f6-93be-fabb2cb9bfbc tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 12:58:45.349118 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-58348fb9-be77-48f6-93be-fabb2cb9bfbc tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 12:58:45.349585 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-58348fb9-be77-48f6-93be-fabb2cb9bfbc tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 12:58:45.436121 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: INFO nova.api.openstack.requestlog [None req-58348fb9-be77-48f6-93be-fabb2cb9bfbc tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] 10.222.0.49 "GET /compute/v2.1/servers/c8de7730-62f2-4a77-b1e9-cf6a74fa366d/os-interface" status: 200 len: 284 microversion: 2.20 time: 0.099229 Dec 14 12:58:45.436805 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: [pid: 116064|app: 0|req: 54/118] 10.222.0.49 () {60 vars in 1315 bytes} [Tue Dec 14 12:58:45 2021] GET /compute/v2.1/servers/c8de7730-62f2-4a77-b1e9-cf6a74fa366d/os-interface => generated 284 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 14 12:58:46.088137 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.api.openstack.wsgi [None req-8b836d9a-04a0-49ba-963a-9c1c0c5f42a7 tempest-ServerRescueNegativeTestJSON-1573931620 tempest-ServerRescueNegativeTestJSON-1573931620-project] Calling method '>' {{(pid=116063) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 12:58:46.088660 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.compute.api [None req-8b836d9a-04a0-49ba-963a-9c1c0c5f42a7 tempest-ServerRescueNegativeTestJSON-1573931620 tempest-ServerRescueNegativeTestJSON-1573931620-project] [instance: 60694e1e-d0cb-41c8-adf5-bdda49804385] Fetching instance by UUID {{(pid=116063) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 12:58:46.095090 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-8b836d9a-04a0-49ba-963a-9c1c0c5f42a7 tempest-ServerRescueNegativeTestJSON-1573931620 tempest-ServerRescueNegativeTestJSON-1573931620-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 12:58:46.095538 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-8b836d9a-04a0-49ba-963a-9c1c0c5f42a7 tempest-ServerRescueNegativeTestJSON-1573931620 tempest-ServerRescueNegativeTestJSON-1573931620-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 12:58:46.096319 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-8b836d9a-04a0-49ba-963a-9c1c0c5f42a7 tempest-ServerRescueNegativeTestJSON-1573931620 tempest-ServerRescueNegativeTestJSON-1573931620-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 12:58:46.096752 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-8b836d9a-04a0-49ba-963a-9c1c0c5f42a7 tempest-ServerRescueNegativeTestJSON-1573931620 tempest-ServerRescueNegativeTestJSON-1573931620-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 12:58:46.546866 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.policy [None req-8b836d9a-04a0-49ba-963a-9c1c0c5f42a7 tempest-ServerRescueNegativeTestJSON-1573931620 tempest-ServerRescueNegativeTestJSON-1573931620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '731cbbfe17214ded8ac66299d66dfc45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '010919ea84eb4eb8b936c63153600eba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116063) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 12:58:46.555535 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: INFO nova.api.openstack.requestlog [None req-8b836d9a-04a0-49ba-963a-9c1c0c5f42a7 tempest-ServerRescueNegativeTestJSON-1573931620 tempest-ServerRescueNegativeTestJSON-1573931620-project] 10.222.0.49 "GET /compute/v2.1/servers/60694e1e-d0cb-41c8-adf5-bdda49804385" status: 200 len: 1523 microversion: 2.1 time: 0.471038 Dec 14 12:58:46.565480 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: [pid: 116063|app: 0|req: 65/119] 10.222.0.49 () {58 vars in 1235 bytes} [Tue Dec 14 12:58:46 2021] GET /compute/v2.1/servers/60694e1e-d0cb-41c8-adf5-bdda49804385 => generated 1523 bytes in 472 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 14 12:58:47.080485 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.api.openstack.wsgi [req-87f9f010-c4e7-485d-b7a0-5b96f5249963 req-cbbaf291-ce2c-42d8-9e62-1d5e55613f33 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c8de7730-62f2-4a77-b1e9-cf6a74fa366d", "tag": "45d34d58-1ff8-4ce3-a024-e2acb9451196"}]} {{(pid=116063) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 14 12:58:47.081803 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.api.openstack.wsgi [None req-1a52236c-f8ce-47c4-9e60-5eb69e0af6d2 tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116064) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 14 12:58:47.084696 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 14 12:58:47.084696 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: warnings.warn(msg) Dec 14 12:58:47.085569 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.compute.api [None req-1a52236c-f8ce-47c4-9e60-5eb69e0af6d2 tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] [instance: c8de7730-62f2-4a77-b1e9-cf6a74fa366d] Fetching instance by UUID {{(pid=116064) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 12:58:47.099476 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-1a52236c-f8ce-47c4-9e60-5eb69e0af6d2 tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 12:58:47.100556 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-1a52236c-f8ce-47c4-9e60-5eb69e0af6d2 tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 12:58:47.102706 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-1a52236c-f8ce-47c4-9e60-5eb69e0af6d2 tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 12:58:47.103247 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [req-87f9f010-c4e7-485d-b7a0-5b96f5249963 req-cbbaf291-ce2c-42d8-9e62-1d5e55613f33 service nova] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 12:58:47.104407 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-1a52236c-f8ce-47c4-9e60-5eb69e0af6d2 tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 12:58:47.105003 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [req-87f9f010-c4e7-485d-b7a0-5b96f5249963 req-cbbaf291-ce2c-42d8-9e62-1d5e55613f33 service nova] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 12:58:47.130740 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: INFO nova.api.openstack.compute.server_external_events [req-87f9f010-c4e7-485d-b7a0-5b96f5249963 req-cbbaf291-ce2c-42d8-9e62-1d5e55613f33 service nova] Creating event network-changed:45d34d58-1ff8-4ce3-a024-e2acb9451196 for instance c8de7730-62f2-4a77-b1e9-cf6a74fa366d on hv-cinder-78447 Dec 14 12:58:47.137685 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: INFO nova.api.openstack.requestlog [req-87f9f010-c4e7-485d-b7a0-5b96f5249963 req-cbbaf291-ce2c-42d8-9e62-1d5e55613f33 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.065544 Dec 14 12:58:47.138889 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: [pid: 116063|app: 0|req: 66/120] 10.222.0.49 () {64 vars in 1317 bytes} [Tue Dec 14 12:58:47 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 14 12:58:47.225861 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: INFO nova.api.openstack.requestlog [None req-1a52236c-f8ce-47c4-9e60-5eb69e0af6d2 tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] 10.222.0.49 "POST /compute/v2.1/servers/c8de7730-62f2-4a77-b1e9-cf6a74fa366d/action" status: 200 len: 14 microversion: 2.20 time: 0.158540 Dec 14 12:58:47.227569 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: [pid: 116064|app: 0|req: 55/121] 10.222.0.49 () {62 vars in 1318 bytes} [Tue Dec 14 12:58:47 2021] POST /compute/v2.1/servers/c8de7730-62f2-4a77-b1e9-cf6a74fa366d/action => generated 14 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 14 12:58:47.574207 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.api.openstack.wsgi [None req-be0d15ed-07a7-43d3-b582-edde08d19faa tempest-ServerRescueNegativeTestJSON-1573931620 tempest-ServerRescueNegativeTestJSON-1573931620-project] Calling method '>' {{(pid=116063) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 12:58:47.574969 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.compute.api [None req-be0d15ed-07a7-43d3-b582-edde08d19faa tempest-ServerRescueNegativeTestJSON-1573931620 tempest-ServerRescueNegativeTestJSON-1573931620-project] [instance: 60694e1e-d0cb-41c8-adf5-bdda49804385] Fetching instance by UUID {{(pid=116063) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 12:58:47.584151 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-be0d15ed-07a7-43d3-b582-edde08d19faa tempest-ServerRescueNegativeTestJSON-1573931620 tempest-ServerRescueNegativeTestJSON-1573931620-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 12:58:47.584594 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-be0d15ed-07a7-43d3-b582-edde08d19faa tempest-ServerRescueNegativeTestJSON-1573931620 tempest-ServerRescueNegativeTestJSON-1573931620-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 12:58:47.586622 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-be0d15ed-07a7-43d3-b582-edde08d19faa tempest-ServerRescueNegativeTestJSON-1573931620 tempest-ServerRescueNegativeTestJSON-1573931620-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 12:58:47.589102 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-be0d15ed-07a7-43d3-b582-edde08d19faa tempest-ServerRescueNegativeTestJSON-1573931620 tempest-ServerRescueNegativeTestJSON-1573931620-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 12:58:47.810104 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.policy [None req-be0d15ed-07a7-43d3-b582-edde08d19faa tempest-ServerRescueNegativeTestJSON-1573931620 tempest-ServerRescueNegativeTestJSON-1573931620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '731cbbfe17214ded8ac66299d66dfc45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '010919ea84eb4eb8b936c63153600eba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116063) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 12:58:47.818279 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: INFO nova.api.openstack.requestlog [None req-be0d15ed-07a7-43d3-b582-edde08d19faa tempest-ServerRescueNegativeTestJSON-1573931620 tempest-ServerRescueNegativeTestJSON-1573931620-project] 10.222.0.49 "GET /compute/v2.1/servers/60694e1e-d0cb-41c8-adf5-bdda49804385" status: 200 len: 1523 microversion: 2.1 time: 0.249235 Dec 14 12:58:47.818884 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: [pid: 116063|app: 0|req: 67/122] 10.222.0.49 () {58 vars in 1235 bytes} [Tue Dec 14 12:58:47 2021] GET /compute/v2.1/servers/60694e1e-d0cb-41c8-adf5-bdda49804385 => generated 1523 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 14 12:58:48.240448 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.api.openstack.wsgi [None req-454907fb-1e33-4104-8315-25ac62007fd6 tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116064) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 14 12:58:48.241492 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.compute.api [None req-454907fb-1e33-4104-8315-25ac62007fd6 tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] [instance: c8de7730-62f2-4a77-b1e9-cf6a74fa366d] Fetching instance by UUID {{(pid=116064) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 12:58:48.248954 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-454907fb-1e33-4104-8315-25ac62007fd6 tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 12:58:48.249405 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-454907fb-1e33-4104-8315-25ac62007fd6 tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 12:58:48.250346 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-454907fb-1e33-4104-8315-25ac62007fd6 tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 12:58:48.250918 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-454907fb-1e33-4104-8315-25ac62007fd6 tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 12:58:48.837759 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.api.openstack.wsgi [None req-0eca8177-4437-4539-aa6c-e92d3f2b6bcb tempest-ServerRescueNegativeTestJSON-1573931620 tempest-ServerRescueNegativeTestJSON-1573931620-project] Calling method '>' {{(pid=116063) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 12:58:48.838394 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.compute.api [None req-0eca8177-4437-4539-aa6c-e92d3f2b6bcb tempest-ServerRescueNegativeTestJSON-1573931620 tempest-ServerRescueNegativeTestJSON-1573931620-project] [instance: 60694e1e-d0cb-41c8-adf5-bdda49804385] Fetching instance by UUID {{(pid=116063) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 12:58:48.845867 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-0eca8177-4437-4539-aa6c-e92d3f2b6bcb tempest-ServerRescueNegativeTestJSON-1573931620 tempest-ServerRescueNegativeTestJSON-1573931620-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 12:58:48.846579 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-0eca8177-4437-4539-aa6c-e92d3f2b6bcb tempest-ServerRescueNegativeTestJSON-1573931620 tempest-ServerRescueNegativeTestJSON-1573931620-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 12:58:48.848123 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-0eca8177-4437-4539-aa6c-e92d3f2b6bcb tempest-ServerRescueNegativeTestJSON-1573931620 tempest-ServerRescueNegativeTestJSON-1573931620-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 12:58:48.849449 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-0eca8177-4437-4539-aa6c-e92d3f2b6bcb tempest-ServerRescueNegativeTestJSON-1573931620 tempest-ServerRescueNegativeTestJSON-1573931620-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 12:58:49.007952 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.policy [None req-0eca8177-4437-4539-aa6c-e92d3f2b6bcb tempest-ServerRescueNegativeTestJSON-1573931620 tempest-ServerRescueNegativeTestJSON-1573931620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '731cbbfe17214ded8ac66299d66dfc45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '010919ea84eb4eb8b936c63153600eba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116063) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 12:58:49.015777 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: INFO nova.api.openstack.requestlog [None req-0eca8177-4437-4539-aa6c-e92d3f2b6bcb tempest-ServerRescueNegativeTestJSON-1573931620 tempest-ServerRescueNegativeTestJSON-1573931620-project] 10.222.0.49 "GET /compute/v2.1/servers/60694e1e-d0cb-41c8-adf5-bdda49804385" status: 200 len: 1523 microversion: 2.1 time: 0.181612 Dec 14 12:58:49.016722 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: [pid: 116063|app: 0|req: 68/123] 10.222.0.49 () {58 vars in 1235 bytes} [Tue Dec 14 12:58:48 2021] GET /compute/v2.1/servers/60694e1e-d0cb-41c8-adf5-bdda49804385 => generated 1523 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 14 12:58:50.032983 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.api.openstack.wsgi [None req-b89b16d1-000b-49e4-aa6b-c61905857eed tempest-ServerRescueNegativeTestJSON-1573931620 tempest-ServerRescueNegativeTestJSON-1573931620-project] Calling method '>' {{(pid=116063) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 12:58:50.033631 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.compute.api [None req-b89b16d1-000b-49e4-aa6b-c61905857eed tempest-ServerRescueNegativeTestJSON-1573931620 tempest-ServerRescueNegativeTestJSON-1573931620-project] [instance: 60694e1e-d0cb-41c8-adf5-bdda49804385] Fetching instance by UUID {{(pid=116063) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 12:58:50.039992 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-b89b16d1-000b-49e4-aa6b-c61905857eed tempest-ServerRescueNegativeTestJSON-1573931620 tempest-ServerRescueNegativeTestJSON-1573931620-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 12:58:50.040518 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-b89b16d1-000b-49e4-aa6b-c61905857eed tempest-ServerRescueNegativeTestJSON-1573931620 tempest-ServerRescueNegativeTestJSON-1573931620-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 12:58:50.041512 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-b89b16d1-000b-49e4-aa6b-c61905857eed tempest-ServerRescueNegativeTestJSON-1573931620 tempest-ServerRescueNegativeTestJSON-1573931620-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 12:58:50.042027 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-b89b16d1-000b-49e4-aa6b-c61905857eed tempest-ServerRescueNegativeTestJSON-1573931620 tempest-ServerRescueNegativeTestJSON-1573931620-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 12:58:50.178234 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.policy [None req-b89b16d1-000b-49e4-aa6b-c61905857eed tempest-ServerRescueNegativeTestJSON-1573931620 tempest-ServerRescueNegativeTestJSON-1573931620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '731cbbfe17214ded8ac66299d66dfc45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '010919ea84eb4eb8b936c63153600eba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116063) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 12:58:50.186786 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: INFO nova.api.openstack.requestlog [None req-b89b16d1-000b-49e4-aa6b-c61905857eed tempest-ServerRescueNegativeTestJSON-1573931620 tempest-ServerRescueNegativeTestJSON-1573931620-project] 10.222.0.49 "GET /compute/v2.1/servers/60694e1e-d0cb-41c8-adf5-bdda49804385" status: 200 len: 1523 microversion: 2.1 time: 0.157477 Dec 14 12:58:50.187638 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: [pid: 116063|app: 0|req: 69/124] 10.222.0.49 () {58 vars in 1235 bytes} [Tue Dec 14 12:58:50 2021] GET /compute/v2.1/servers/60694e1e-d0cb-41c8-adf5-bdda49804385 => generated 1523 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 14 12:58:51.032753 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: INFO nova.api.openstack.requestlog [None req-454907fb-1e33-4104-8315-25ac62007fd6 tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] 10.222.0.49 "POST /compute/v2.1/servers/c8de7730-62f2-4a77-b1e9-cf6a74fa366d/action" status: 200 len: 14 microversion: 2.20 time: 2.796488 Dec 14 12:58:51.036926 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: [pid: 116064|app: 0|req: 56/125] 10.222.0.49 () {62 vars in 1318 bytes} [Tue Dec 14 12:58:48 2021] POST /compute/v2.1/servers/c8de7730-62f2-4a77-b1e9-cf6a74fa366d/action => generated 14 bytes in 2800 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 14 12:58:51.204706 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.api.openstack.wsgi [None req-b73bb4f4-57c5-4e7f-90f6-fea94d538aa9 tempest-ServerRescueNegativeTestJSON-1573931620 tempest-ServerRescueNegativeTestJSON-1573931620-project] Calling method '>' {{(pid=116063) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 12:58:51.205468 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.compute.api [None req-b73bb4f4-57c5-4e7f-90f6-fea94d538aa9 tempest-ServerRescueNegativeTestJSON-1573931620 tempest-ServerRescueNegativeTestJSON-1573931620-project] [instance: 60694e1e-d0cb-41c8-adf5-bdda49804385] Fetching instance by UUID {{(pid=116063) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 12:58:51.213629 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-b73bb4f4-57c5-4e7f-90f6-fea94d538aa9 tempest-ServerRescueNegativeTestJSON-1573931620 tempest-ServerRescueNegativeTestJSON-1573931620-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 12:58:51.214175 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-b73bb4f4-57c5-4e7f-90f6-fea94d538aa9 tempest-ServerRescueNegativeTestJSON-1573931620 tempest-ServerRescueNegativeTestJSON-1573931620-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 12:58:51.215129 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-b73bb4f4-57c5-4e7f-90f6-fea94d538aa9 tempest-ServerRescueNegativeTestJSON-1573931620 tempest-ServerRescueNegativeTestJSON-1573931620-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 12:58:51.215654 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-b73bb4f4-57c5-4e7f-90f6-fea94d538aa9 tempest-ServerRescueNegativeTestJSON-1573931620 tempest-ServerRescueNegativeTestJSON-1573931620-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 12:58:51.349553 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.policy [None req-b73bb4f4-57c5-4e7f-90f6-fea94d538aa9 tempest-ServerRescueNegativeTestJSON-1573931620 tempest-ServerRescueNegativeTestJSON-1573931620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '731cbbfe17214ded8ac66299d66dfc45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '010919ea84eb4eb8b936c63153600eba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116063) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 12:58:51.357053 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: INFO nova.api.openstack.requestlog [None req-b73bb4f4-57c5-4e7f-90f6-fea94d538aa9 tempest-ServerRescueNegativeTestJSON-1573931620 tempest-ServerRescueNegativeTestJSON-1573931620-project] 10.222.0.49 "GET /compute/v2.1/servers/60694e1e-d0cb-41c8-adf5-bdda49804385" status: 200 len: 1523 microversion: 2.1 time: 0.156827 Dec 14 12:58:51.357624 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: [pid: 116063|app: 0|req: 70/126] 10.222.0.49 () {58 vars in 1235 bytes} [Tue Dec 14 12:58:51 2021] GET /compute/v2.1/servers/60694e1e-d0cb-41c8-adf5-bdda49804385 => generated 1523 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 14 12:58:52.044592 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.api.openstack.wsgi [None req-973db61c-33e0-4838-b5e8-1ebce05437f7 tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116064) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 14 12:58:52.045735 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.compute.api [None req-973db61c-33e0-4838-b5e8-1ebce05437f7 tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] [instance: c8de7730-62f2-4a77-b1e9-cf6a74fa366d] Fetching instance by UUID {{(pid=116064) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 12:58:52.053926 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-973db61c-33e0-4838-b5e8-1ebce05437f7 tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 12:58:52.054374 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-973db61c-33e0-4838-b5e8-1ebce05437f7 tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 12:58:52.055203 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-973db61c-33e0-4838-b5e8-1ebce05437f7 tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 12:58:52.055697 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-973db61c-33e0-4838-b5e8-1ebce05437f7 tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 12:58:52.138467 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: INFO nova.api.openstack.requestlog [None req-973db61c-33e0-4838-b5e8-1ebce05437f7 tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] 10.222.0.49 "POST /compute/v2.1/servers/c8de7730-62f2-4a77-b1e9-cf6a74fa366d/action" status: 200 len: 14 microversion: 2.20 time: 0.097739 Dec 14 12:58:52.142778 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: [pid: 116064|app: 0|req: 57/127] 10.222.0.49 () {62 vars in 1318 bytes} [Tue Dec 14 12:58:52 2021] POST /compute/v2.1/servers/c8de7730-62f2-4a77-b1e9-cf6a74fa366d/action => generated 14 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 14 12:58:52.163006 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.api.openstack.wsgi [None req-8b200f71-ea8e-423a-b8ed-944c4c28a25b tempest-VolumesActionsTest-648269150 tempest-VolumesActionsTest-648269150-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-1158614388", "imageRef": "1733dcd4-5ded-44e1-8b8d-392adb05c67a", "flavorRef": "452", "networks": [{"uuid": "f9b2329a-0b17-4b80-8a98-25a960af76f5"}]}} {{(pid=116063) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 14 12:58:52.215095 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.network.neutron [None req-8b200f71-ea8e-423a-b8ed-944c4c28a25b tempest-VolumesActionsTest-648269150 tempest-VolumesActionsTest-648269150-project] validate_networks() for [('f9b2329a-0b17-4b80-8a98-25a960af76f5', None, None, None, None, None)] {{(pid=116063) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Dec 14 12:58:52.376671 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.api.openstack.wsgi [None req-063fad4e-b2ba-40b5-8b8b-7625c0839d68 tempest-ServerRescueNegativeTestJSON-1573931620 tempest-ServerRescueNegativeTestJSON-1573931620-project] Calling method '>' {{(pid=116064) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 12:58:52.376671 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.compute.api [None req-063fad4e-b2ba-40b5-8b8b-7625c0839d68 tempest-ServerRescueNegativeTestJSON-1573931620 tempest-ServerRescueNegativeTestJSON-1573931620-project] [instance: 60694e1e-d0cb-41c8-adf5-bdda49804385] Fetching instance by UUID {{(pid=116064) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 12:58:52.381911 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-063fad4e-b2ba-40b5-8b8b-7625c0839d68 tempest-ServerRescueNegativeTestJSON-1573931620 tempest-ServerRescueNegativeTestJSON-1573931620-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 12:58:52.382352 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-063fad4e-b2ba-40b5-8b8b-7625c0839d68 tempest-ServerRescueNegativeTestJSON-1573931620 tempest-ServerRescueNegativeTestJSON-1573931620-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 12:58:52.383117 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-063fad4e-b2ba-40b5-8b8b-7625c0839d68 tempest-ServerRescueNegativeTestJSON-1573931620 tempest-ServerRescueNegativeTestJSON-1573931620-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 12:58:52.383546 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-063fad4e-b2ba-40b5-8b8b-7625c0839d68 tempest-ServerRescueNegativeTestJSON-1573931620 tempest-ServerRescueNegativeTestJSON-1573931620-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 12:58:52.614454 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.policy [None req-063fad4e-b2ba-40b5-8b8b-7625c0839d68 tempest-ServerRescueNegativeTestJSON-1573931620 tempest-ServerRescueNegativeTestJSON-1573931620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '731cbbfe17214ded8ac66299d66dfc45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '010919ea84eb4eb8b936c63153600eba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116064) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 12:58:52.623574 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: INFO nova.api.openstack.requestlog [None req-063fad4e-b2ba-40b5-8b8b-7625c0839d68 tempest-ServerRescueNegativeTestJSON-1573931620 tempest-ServerRescueNegativeTestJSON-1573931620-project] 10.222.0.49 "GET /compute/v2.1/servers/60694e1e-d0cb-41c8-adf5-bdda49804385" status: 200 len: 1523 microversion: 2.1 time: 0.253270 Dec 14 12:58:52.624576 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: [pid: 116064|app: 0|req: 58/128] 10.222.0.49 () {58 vars in 1235 bytes} [Tue Dec 14 12:58:52 2021] GET /compute/v2.1/servers/60694e1e-d0cb-41c8-adf5-bdda49804385 => generated 1523 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 14 12:58:52.658827 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.virt.hardware [None req-8b200f71-ea8e-423a-b8ed-944c4c28a25b tempest-VolumesActionsTest-648269150 tempest-VolumesActionsTest-648269150-project] Flavor limits 0:0:0 {{(pid=116063) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Dec 14 12:58:52.659246 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.virt.hardware [None req-8b200f71-ea8e-423a-b8ed-944c4c28a25b tempest-VolumesActionsTest-648269150 tempest-VolumesActionsTest-648269150-project] Image limits 0:0:0 {{(pid=116063) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Dec 14 12:58:52.659719 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.virt.hardware [None req-8b200f71-ea8e-423a-b8ed-944c4c28a25b tempest-VolumesActionsTest-648269150 tempest-VolumesActionsTest-648269150-project] Flavor pref 0:0:0 {{(pid=116063) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Dec 14 12:58:52.660195 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.virt.hardware [None req-8b200f71-ea8e-423a-b8ed-944c4c28a25b tempest-VolumesActionsTest-648269150 tempest-VolumesActionsTest-648269150-project] Image pref 0:0:0 {{(pid=116063) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Dec 14 12:58:52.660773 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.virt.hardware [None req-8b200f71-ea8e-423a-b8ed-944c4c28a25b tempest-VolumesActionsTest-648269150 tempest-VolumesActionsTest-648269150-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=116063) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Dec 14 12:58:52.669351 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-8b200f71-ea8e-423a-b8ed-944c4c28a25b tempest-VolumesActionsTest-648269150 tempest-VolumesActionsTest-648269150-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 12:58:52.669790 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-8b200f71-ea8e-423a-b8ed-944c4c28a25b tempest-VolumesActionsTest-648269150 tempest-VolumesActionsTest-648269150-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 12:58:52.670617 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-8b200f71-ea8e-423a-b8ed-944c4c28a25b tempest-VolumesActionsTest-648269150 tempest-VolumesActionsTest-648269150-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 12:58:52.671229 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-8b200f71-ea8e-423a-b8ed-944c4c28a25b tempest-VolumesActionsTest-648269150 tempest-VolumesActionsTest-648269150-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 12:58:52.687433 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.quota [None req-8b200f71-ea8e-423a-b8ed-944c4c28a25b tempest-VolumesActionsTest-648269150 tempest-VolumesActionsTest-648269150-project] Getting quotas for project 9fa190426a6c4b9c9d6d259455a647ca. Resources: {'cores', 'instances', 'ram'} {{(pid=116063) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 14 12:58:52.691430 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.quota [None req-8b200f71-ea8e-423a-b8ed-944c4c28a25b tempest-VolumesActionsTest-648269150 tempest-VolumesActionsTest-648269150-project] Getting quotas for user 3cc7290157ff4075b95ead815c2b332a and project 9fa190426a6c4b9c9d6d259455a647ca. Resources: {'cores', 'instances', 'ram'} {{(pid=116063) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 14 12:58:52.701843 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.compute.api [None req-8b200f71-ea8e-423a-b8ed-944c4c28a25b tempest-VolumesActionsTest-648269150 tempest-VolumesActionsTest-648269150-project] Going to run 1 instances... {{(pid=116063) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Dec 14 12:58:52.704154 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.compute.api [None req-8b200f71-ea8e-423a-b8ed-944c4c28a25b tempest-VolumesActionsTest-648269150 tempest-VolumesActionsTest-648269150-project] [instance: ce203e83-7410-4aa5-ade6-6595fc8a6393] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='1733dcd4-5ded-44e1-8b8d-392adb05c67a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=116063) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Dec 14 12:58:52.756196 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: INFO nova.api.openstack.requestlog [None req-8b200f71-ea8e-423a-b8ed-944c4c28a25b tempest-VolumesActionsTest-648269150 tempest-VolumesActionsTest-648269150-project] 10.222.0.49 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.598937 Dec 14 12:58:52.757596 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: [pid: 116063|app: 0|req: 71/129] 10.222.0.49 () {60 vars in 1146 bytes} [Tue Dec 14 12:58:52 2021] POST /compute/v2.1/servers => generated 380 bytes in 601 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Dec 14 12:58:52.768096 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.api.openstack.wsgi [None req-465dc19f-5958-495f-b6e5-868b533d2672 tempest-VolumesActionsTest-648269150 tempest-VolumesActionsTest-648269150-project] Calling method '>' {{(pid=116064) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 12:58:52.768936 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.compute.api [None req-465dc19f-5958-495f-b6e5-868b533d2672 tempest-VolumesActionsTest-648269150 tempest-VolumesActionsTest-648269150-project] [instance: ce203e83-7410-4aa5-ade6-6595fc8a6393] Fetching instance by UUID {{(pid=116064) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 12:58:52.869354 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.policy [None req-465dc19f-5958-495f-b6e5-868b533d2672 tempest-VolumesActionsTest-648269150 tempest-VolumesActionsTest-648269150-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cc7290157ff4075b95ead815c2b332a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fa190426a6c4b9c9d6d259455a647ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116064) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 12:58:52.879613 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: INFO nova.api.openstack.requestlog [None req-465dc19f-5958-495f-b6e5-868b533d2672 tempest-VolumesActionsTest-648269150 tempest-VolumesActionsTest-648269150-project] 10.222.0.49 "GET /compute/v2.1/servers/ce203e83-7410-4aa5-ade6-6595fc8a6393" status: 200 len: 1214 microversion: 2.1 time: 0.115907 Dec 14 12:58:52.880211 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: [pid: 116064|app: 0|req: 59/130] 10.222.0.49 () {58 vars in 1235 bytes} [Tue Dec 14 12:58:52 2021] GET /compute/v2.1/servers/ce203e83-7410-4aa5-ade6-6595fc8a6393 => generated 1214 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 14 12:58:53.149457 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.api.openstack.wsgi [None req-dfe33226-578f-4764-a5f0-397bb5c8d9cb tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116063) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 14 12:58:53.150720 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.compute.api [None req-dfe33226-578f-4764-a5f0-397bb5c8d9cb tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] [instance: c8de7730-62f2-4a77-b1e9-cf6a74fa366d] Fetching instance by UUID {{(pid=116063) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 12:58:53.161430 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-dfe33226-578f-4764-a5f0-397bb5c8d9cb tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 12:58:53.162078 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-dfe33226-578f-4764-a5f0-397bb5c8d9cb tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 12:58:53.163411 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-dfe33226-578f-4764-a5f0-397bb5c8d9cb tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 12:58:53.164050 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-dfe33226-578f-4764-a5f0-397bb5c8d9cb tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 12:58:53.274739 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: INFO nova.api.openstack.requestlog [None req-dfe33226-578f-4764-a5f0-397bb5c8d9cb tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] 10.222.0.49 "POST /compute/v2.1/servers/c8de7730-62f2-4a77-b1e9-cf6a74fa366d/action" status: 200 len: 14 microversion: 2.20 time: 0.129290 Dec 14 12:58:53.275500 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: [pid: 116063|app: 0|req: 72/131] 10.222.0.49 () {62 vars in 1318 bytes} [Tue Dec 14 12:58:53 2021] POST /compute/v2.1/servers/c8de7730-62f2-4a77-b1e9-cf6a74fa366d/action => generated 14 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 14 12:58:53.652372 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.api.openstack.wsgi [None req-8feaeae7-6f83-4b4e-972d-ff8695ed4a4f tempest-ServerRescueNegativeTestJSON-1573931620 tempest-ServerRescueNegativeTestJSON-1573931620-project] Calling method '>' {{(pid=116064) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 12:58:53.653696 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.compute.api [None req-8feaeae7-6f83-4b4e-972d-ff8695ed4a4f tempest-ServerRescueNegativeTestJSON-1573931620 tempest-ServerRescueNegativeTestJSON-1573931620-project] [instance: 60694e1e-d0cb-41c8-adf5-bdda49804385] Fetching instance by UUID {{(pid=116064) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 12:58:53.661279 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-8feaeae7-6f83-4b4e-972d-ff8695ed4a4f tempest-ServerRescueNegativeTestJSON-1573931620 tempest-ServerRescueNegativeTestJSON-1573931620-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 12:58:53.661725 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-8feaeae7-6f83-4b4e-972d-ff8695ed4a4f tempest-ServerRescueNegativeTestJSON-1573931620 tempest-ServerRescueNegativeTestJSON-1573931620-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 12:58:53.662525 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-8feaeae7-6f83-4b4e-972d-ff8695ed4a4f tempest-ServerRescueNegativeTestJSON-1573931620 tempest-ServerRescueNegativeTestJSON-1573931620-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 12:58:53.662955 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-8feaeae7-6f83-4b4e-972d-ff8695ed4a4f tempest-ServerRescueNegativeTestJSON-1573931620 tempest-ServerRescueNegativeTestJSON-1573931620-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 12:58:53.806996 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.policy [None req-8feaeae7-6f83-4b4e-972d-ff8695ed4a4f tempest-ServerRescueNegativeTestJSON-1573931620 tempest-ServerRescueNegativeTestJSON-1573931620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '731cbbfe17214ded8ac66299d66dfc45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '010919ea84eb4eb8b936c63153600eba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116064) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 12:58:53.815812 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: INFO nova.api.openstack.requestlog [None req-8feaeae7-6f83-4b4e-972d-ff8695ed4a4f tempest-ServerRescueNegativeTestJSON-1573931620 tempest-ServerRescueNegativeTestJSON-1573931620-project] 10.222.0.49 "GET /compute/v2.1/servers/60694e1e-d0cb-41c8-adf5-bdda49804385" status: 200 len: 1523 microversion: 2.1 time: 0.168654 Dec 14 12:58:53.816420 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: [pid: 116064|app: 0|req: 60/132] 10.222.0.49 () {58 vars in 1235 bytes} [Tue Dec 14 12:58:53 2021] GET /compute/v2.1/servers/60694e1e-d0cb-41c8-adf5-bdda49804385 => generated 1523 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 14 12:58:53.897642 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.api.openstack.wsgi [None req-6b84d9f7-cb81-4e36-a728-2507b0d10f29 tempest-VolumesActionsTest-648269150 tempest-VolumesActionsTest-648269150-project] Calling method '>' {{(pid=116063) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 12:58:53.898261 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.compute.api [None req-6b84d9f7-cb81-4e36-a728-2507b0d10f29 tempest-VolumesActionsTest-648269150 tempest-VolumesActionsTest-648269150-project] [instance: ce203e83-7410-4aa5-ade6-6595fc8a6393] Fetching instance by UUID {{(pid=116063) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 12:58:53.905426 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-6b84d9f7-cb81-4e36-a728-2507b0d10f29 tempest-VolumesActionsTest-648269150 tempest-VolumesActionsTest-648269150-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 12:58:53.905872 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-6b84d9f7-cb81-4e36-a728-2507b0d10f29 tempest-VolumesActionsTest-648269150 tempest-VolumesActionsTest-648269150-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 12:58:53.906681 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-6b84d9f7-cb81-4e36-a728-2507b0d10f29 tempest-VolumesActionsTest-648269150 tempest-VolumesActionsTest-648269150-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 12:58:53.907107 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-6b84d9f7-cb81-4e36-a728-2507b0d10f29 tempest-VolumesActionsTest-648269150 tempest-VolumesActionsTest-648269150-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 12:58:53.977711 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.policy [None req-6b84d9f7-cb81-4e36-a728-2507b0d10f29 tempest-VolumesActionsTest-648269150 tempest-VolumesActionsTest-648269150-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cc7290157ff4075b95ead815c2b332a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fa190426a6c4b9c9d6d259455a647ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116063) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 12:58:53.985523 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: INFO nova.api.openstack.requestlog [None req-6b84d9f7-cb81-4e36-a728-2507b0d10f29 tempest-VolumesActionsTest-648269150 tempest-VolumesActionsTest-648269150-project] 10.222.0.49 "GET /compute/v2.1/servers/ce203e83-7410-4aa5-ade6-6595fc8a6393" status: 200 len: 1266 microversion: 2.1 time: 0.091918 Dec 14 12:58:53.996189 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: [pid: 116063|app: 0|req: 73/133] 10.222.0.49 () {58 vars in 1235 bytes} [Tue Dec 14 12:58:53 2021] GET /compute/v2.1/servers/ce203e83-7410-4aa5-ade6-6595fc8a6393 => generated 1266 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 14 12:58:54.285786 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.api.openstack.wsgi [None req-3067e84e-ee06-4fd5-a8e9-aea3f0595ad8 tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116064) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 14 12:58:54.286710 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.compute.api [None req-3067e84e-ee06-4fd5-a8e9-aea3f0595ad8 tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] [instance: c8de7730-62f2-4a77-b1e9-cf6a74fa366d] Fetching instance by UUID {{(pid=116064) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 12:58:54.293809 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-3067e84e-ee06-4fd5-a8e9-aea3f0595ad8 tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 12:58:54.294262 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-3067e84e-ee06-4fd5-a8e9-aea3f0595ad8 tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 12:58:54.295062 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-3067e84e-ee06-4fd5-a8e9-aea3f0595ad8 tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 12:58:54.295503 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-3067e84e-ee06-4fd5-a8e9-aea3f0595ad8 tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 12:58:54.374113 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: INFO nova.api.openstack.requestlog [None req-3067e84e-ee06-4fd5-a8e9-aea3f0595ad8 tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] 10.222.0.49 "POST /compute/v2.1/servers/c8de7730-62f2-4a77-b1e9-cf6a74fa366d/action" status: 200 len: 14 microversion: 2.20 time: 0.091934 Dec 14 12:58:54.377460 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: [pid: 116064|app: 0|req: 61/134] 10.222.0.49 () {62 vars in 1318 bytes} [Tue Dec 14 12:58:54 2021] POST /compute/v2.1/servers/c8de7730-62f2-4a77-b1e9-cf6a74fa366d/action => generated 14 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 14 12:58:54.794362 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.api.openstack.wsgi [None req-97688af1-2770-47ec-99c5-f657e48ec77c tempest-DeleteServersTestJSON-1329684180 tempest-DeleteServersTestJSON-1329684180-project] Calling method '>' {{(pid=116063) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 12:58:54.795053 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.compute.api [None req-97688af1-2770-47ec-99c5-f657e48ec77c tempest-DeleteServersTestJSON-1329684180 tempest-DeleteServersTestJSON-1329684180-project] [instance: 0632db38-ebd1-43c1-8ab9-04fbb19edfa7] Fetching instance by UUID {{(pid=116063) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 12:58:54.815495 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-97688af1-2770-47ec-99c5-f657e48ec77c tempest-DeleteServersTestJSON-1329684180 tempest-DeleteServersTestJSON-1329684180-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 12:58:54.816178 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-97688af1-2770-47ec-99c5-f657e48ec77c tempest-DeleteServersTestJSON-1329684180 tempest-DeleteServersTestJSON-1329684180-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 12:58:54.817050 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-97688af1-2770-47ec-99c5-f657e48ec77c tempest-DeleteServersTestJSON-1329684180 tempest-DeleteServersTestJSON-1329684180-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 12:58:54.817726 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-97688af1-2770-47ec-99c5-f657e48ec77c tempest-DeleteServersTestJSON-1329684180 tempest-DeleteServersTestJSON-1329684180-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 12:58:54.833767 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.api.openstack.wsgi [None req-4f8ae9cc-b94d-431b-8b60-38f45c4cdac0 tempest-ServerRescueNegativeTestJSON-1573931620 tempest-ServerRescueNegativeTestJSON-1573931620-project] Calling method '>' {{(pid=116064) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 12:58:54.835133 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.compute.api [None req-4f8ae9cc-b94d-431b-8b60-38f45c4cdac0 tempest-ServerRescueNegativeTestJSON-1573931620 tempest-ServerRescueNegativeTestJSON-1573931620-project] [instance: 60694e1e-d0cb-41c8-adf5-bdda49804385] Fetching instance by UUID {{(pid=116064) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 12:58:54.847112 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-4f8ae9cc-b94d-431b-8b60-38f45c4cdac0 tempest-ServerRescueNegativeTestJSON-1573931620 tempest-ServerRescueNegativeTestJSON-1573931620-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 12:58:54.847751 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-4f8ae9cc-b94d-431b-8b60-38f45c4cdac0 tempest-ServerRescueNegativeTestJSON-1573931620 tempest-ServerRescueNegativeTestJSON-1573931620-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 12:58:54.848725 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-4f8ae9cc-b94d-431b-8b60-38f45c4cdac0 tempest-ServerRescueNegativeTestJSON-1573931620 tempest-ServerRescueNegativeTestJSON-1573931620-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 12:58:54.849361 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-4f8ae9cc-b94d-431b-8b60-38f45c4cdac0 tempest-ServerRescueNegativeTestJSON-1573931620 tempest-ServerRescueNegativeTestJSON-1573931620-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 12:58:54.866754 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.compute.api [None req-97688af1-2770-47ec-99c5-f657e48ec77c tempest-DeleteServersTestJSON-1329684180 tempest-DeleteServersTestJSON-1329684180-project] [instance: 0632db38-ebd1-43c1-8ab9-04fbb19edfa7] Going to try to terminate instance {{(pid=116063) delete /opt/stack/nova/nova/compute/api.py:2614}} Dec 14 12:58:54.977364 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: INFO nova.api.openstack.requestlog [None req-97688af1-2770-47ec-99c5-f657e48ec77c tempest-DeleteServersTestJSON-1329684180 tempest-DeleteServersTestJSON-1329684180-project] 10.222.0.49 "DELETE /compute/v2.1/servers/0632db38-ebd1-43c1-8ab9-04fbb19edfa7" status: 204 len: 0 microversion: 2.1 time: 0.185990 Dec 14 12:58:54.978431 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: [pid: 116063|app: 0|req: 74/135] 10.222.0.49 () {58 vars in 1238 bytes} [Tue Dec 14 12:58:54 2021] DELETE /compute/v2.1/servers/0632db38-ebd1-43c1-8ab9-04fbb19edfa7 => generated 0 bytes in 189 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Dec 14 12:58:54.988367 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.api.openstack.wsgi [None req-22113ce5-fe40-4e65-8bf2-94ef3bd0eb8e tempest-DeleteServersTestJSON-1329684180 tempest-DeleteServersTestJSON-1329684180-project] Calling method '>' {{(pid=116063) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 12:58:54.989351 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.compute.api [None req-22113ce5-fe40-4e65-8bf2-94ef3bd0eb8e tempest-DeleteServersTestJSON-1329684180 tempest-DeleteServersTestJSON-1329684180-project] [instance: 0632db38-ebd1-43c1-8ab9-04fbb19edfa7] Fetching instance by UUID {{(pid=116063) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 12:58:54.995737 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-22113ce5-fe40-4e65-8bf2-94ef3bd0eb8e tempest-DeleteServersTestJSON-1329684180 tempest-DeleteServersTestJSON-1329684180-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 12:58:54.996209 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-22113ce5-fe40-4e65-8bf2-94ef3bd0eb8e tempest-DeleteServersTestJSON-1329684180 tempest-DeleteServersTestJSON-1329684180-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 12:58:54.998862 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-22113ce5-fe40-4e65-8bf2-94ef3bd0eb8e tempest-DeleteServersTestJSON-1329684180 tempest-DeleteServersTestJSON-1329684180-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 12:58:54.999565 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-22113ce5-fe40-4e65-8bf2-94ef3bd0eb8e tempest-DeleteServersTestJSON-1329684180 tempest-DeleteServersTestJSON-1329684180-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 12:58:55.026620 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.policy [None req-4f8ae9cc-b94d-431b-8b60-38f45c4cdac0 tempest-ServerRescueNegativeTestJSON-1573931620 tempest-ServerRescueNegativeTestJSON-1573931620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '731cbbfe17214ded8ac66299d66dfc45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '010919ea84eb4eb8b936c63153600eba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116064) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 12:58:55.034465 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: INFO nova.api.openstack.requestlog [None req-4f8ae9cc-b94d-431b-8b60-38f45c4cdac0 tempest-ServerRescueNegativeTestJSON-1573931620 tempest-ServerRescueNegativeTestJSON-1573931620-project] 10.222.0.49 "GET /compute/v2.1/servers/60694e1e-d0cb-41c8-adf5-bdda49804385" status: 200 len: 1523 microversion: 2.1 time: 0.205305 Dec 14 12:58:55.035625 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: [pid: 116064|app: 0|req: 62/136] 10.222.0.49 () {58 vars in 1235 bytes} [Tue Dec 14 12:58:54 2021] GET /compute/v2.1/servers/60694e1e-d0cb-41c8-adf5-bdda49804385 => generated 1523 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 14 12:58:55.040495 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.api.openstack.wsgi [None req-b9ff543e-a281-4874-abaf-91e29bd890e4 tempest-VolumesActionsTest-648269150 tempest-VolumesActionsTest-648269150-project] Calling method '>' {{(pid=116064) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 12:58:55.041725 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.compute.api [None req-b9ff543e-a281-4874-abaf-91e29bd890e4 tempest-VolumesActionsTest-648269150 tempest-VolumesActionsTest-648269150-project] [instance: ce203e83-7410-4aa5-ade6-6595fc8a6393] Fetching instance by UUID {{(pid=116064) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 12:58:55.049327 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-b9ff543e-a281-4874-abaf-91e29bd890e4 tempest-VolumesActionsTest-648269150 tempest-VolumesActionsTest-648269150-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 12:58:55.050181 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-b9ff543e-a281-4874-abaf-91e29bd890e4 tempest-VolumesActionsTest-648269150 tempest-VolumesActionsTest-648269150-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 12:58:55.053576 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-b9ff543e-a281-4874-abaf-91e29bd890e4 tempest-VolumesActionsTest-648269150 tempest-VolumesActionsTest-648269150-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 12:58:55.054233 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-b9ff543e-a281-4874-abaf-91e29bd890e4 tempest-VolumesActionsTest-648269150 tempest-VolumesActionsTest-648269150-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 12:58:55.216502 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.policy [None req-22113ce5-fe40-4e65-8bf2-94ef3bd0eb8e tempest-DeleteServersTestJSON-1329684180 tempest-DeleteServersTestJSON-1329684180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f4dc5a1bdfc4430b8fa39a5eec81f33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb24e38ec8e34dd9a93459b7ff9ba97a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116063) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 12:58:55.228031 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: INFO nova.api.openstack.requestlog [None req-22113ce5-fe40-4e65-8bf2-94ef3bd0eb8e tempest-DeleteServersTestJSON-1329684180 tempest-DeleteServersTestJSON-1329684180-project] 10.222.0.49 "GET /compute/v2.1/servers/0632db38-ebd1-43c1-8ab9-04fbb19edfa7" status: 200 len: 1553 microversion: 2.1 time: 0.244675 Dec 14 12:58:55.228636 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: [pid: 116063|app: 0|req: 75/137] 10.222.0.49 () {58 vars in 1235 bytes} [Tue Dec 14 12:58:54 2021] GET /compute/v2.1/servers/0632db38-ebd1-43c1-8ab9-04fbb19edfa7 => generated 1553 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 14 12:58:55.269441 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.policy [None req-b9ff543e-a281-4874-abaf-91e29bd890e4 tempest-VolumesActionsTest-648269150 tempest-VolumesActionsTest-648269150-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cc7290157ff4075b95ead815c2b332a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fa190426a6c4b9c9d6d259455a647ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116064) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 12:58:55.278398 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: INFO nova.api.openstack.requestlog [None req-b9ff543e-a281-4874-abaf-91e29bd890e4 tempest-VolumesActionsTest-648269150 tempest-VolumesActionsTest-648269150-project] 10.222.0.49 "GET /compute/v2.1/servers/ce203e83-7410-4aa5-ade6-6595fc8a6393" status: 200 len: 1314 microversion: 2.1 time: 0.240967 Dec 14 12:58:55.279028 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: [pid: 116064|app: 0|req: 63/138] 10.222.0.49 () {58 vars in 1235 bytes} [Tue Dec 14 12:58:55 2021] GET /compute/v2.1/servers/ce203e83-7410-4aa5-ade6-6595fc8a6393 => generated 1314 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 14 12:58:55.384494 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.api.openstack.wsgi [None req-b463c350-57c8-4fdf-8b97-d1494aeebac6 tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116063) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 14 12:58:55.385526 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.compute.api [None req-b463c350-57c8-4fdf-8b97-d1494aeebac6 tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] [instance: c8de7730-62f2-4a77-b1e9-cf6a74fa366d] Fetching instance by UUID {{(pid=116063) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 12:58:55.394973 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-b463c350-57c8-4fdf-8b97-d1494aeebac6 tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 12:58:55.395503 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-b463c350-57c8-4fdf-8b97-d1494aeebac6 tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 12:58:55.396177 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-b463c350-57c8-4fdf-8b97-d1494aeebac6 tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 12:58:55.396599 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-b463c350-57c8-4fdf-8b97-d1494aeebac6 tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 12:58:55.444422 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.api.openstack.wsgi [req-d85afd2c-3fab-4126-95d9-0489e9a2485e req-4108f002-3471-4116-a1a4-0c27c3077ddb service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ce203e83-7410-4aa5-ade6-6595fc8a6393", "tag": "2f7ee134-4a53-4bf3-b113-860ae25ab31f"}]} {{(pid=116064) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 14 12:58:55.447979 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 14 12:58:55.447979 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: warnings.warn(msg) Dec 14 12:58:55.469903 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [req-d85afd2c-3fab-4126-95d9-0489e9a2485e req-4108f002-3471-4116-a1a4-0c27c3077ddb service nova] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 12:58:55.470635 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [req-d85afd2c-3fab-4126-95d9-0489e9a2485e req-4108f002-3471-4116-a1a4-0c27c3077ddb service nova] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 12:58:55.505656 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: INFO nova.api.openstack.compute.server_external_events [req-d85afd2c-3fab-4126-95d9-0489e9a2485e req-4108f002-3471-4116-a1a4-0c27c3077ddb service nova] Creating event network-changed:2f7ee134-4a53-4bf3-b113-860ae25ab31f for instance ce203e83-7410-4aa5-ade6-6595fc8a6393 on hv-cinder-78447 Dec 14 12:58:55.511839 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: INFO nova.api.openstack.requestlog [None req-b463c350-57c8-4fdf-8b97-d1494aeebac6 tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] 10.222.0.49 "POST /compute/v2.1/servers/c8de7730-62f2-4a77-b1e9-cf6a74fa366d/action" status: 200 len: 14 microversion: 2.20 time: 0.130975 Dec 14 12:58:55.515029 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: [pid: 116063|app: 0|req: 76/139] 10.222.0.49 () {62 vars in 1318 bytes} [Tue Dec 14 12:58:55 2021] POST /compute/v2.1/servers/c8de7730-62f2-4a77-b1e9-cf6a74fa366d/action => generated 14 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 14 12:58:55.515160 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: INFO nova.api.openstack.requestlog [req-d85afd2c-3fab-4126-95d9-0489e9a2485e req-4108f002-3471-4116-a1a4-0c27c3077ddb service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.080502 Dec 14 12:58:55.517171 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: [pid: 116064|app: 0|req: 64/140] 10.222.0.49 () {64 vars in 1317 bytes} [Tue Dec 14 12:58:55 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 14 12:58:56.053094 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.api.openstack.wsgi [None req-753c4486-c392-48bf-bc66-9b897606e891 tempest-ServerRescueNegativeTestJSON-1573931620 tempest-ServerRescueNegativeTestJSON-1573931620-project] Calling method '>' {{(pid=116063) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 12:58:56.053957 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.compute.api [None req-753c4486-c392-48bf-bc66-9b897606e891 tempest-ServerRescueNegativeTestJSON-1573931620 tempest-ServerRescueNegativeTestJSON-1573931620-project] [instance: 60694e1e-d0cb-41c8-adf5-bdda49804385] Fetching instance by UUID {{(pid=116063) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 12:58:56.061145 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-753c4486-c392-48bf-bc66-9b897606e891 tempest-ServerRescueNegativeTestJSON-1573931620 tempest-ServerRescueNegativeTestJSON-1573931620-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 12:58:56.061576 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-753c4486-c392-48bf-bc66-9b897606e891 tempest-ServerRescueNegativeTestJSON-1573931620 tempest-ServerRescueNegativeTestJSON-1573931620-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 12:58:56.062360 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-753c4486-c392-48bf-bc66-9b897606e891 tempest-ServerRescueNegativeTestJSON-1573931620 tempest-ServerRescueNegativeTestJSON-1573931620-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 12:58:56.063011 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-753c4486-c392-48bf-bc66-9b897606e891 tempest-ServerRescueNegativeTestJSON-1573931620 tempest-ServerRescueNegativeTestJSON-1573931620-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 12:58:56.203088 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.policy [None req-753c4486-c392-48bf-bc66-9b897606e891 tempest-ServerRescueNegativeTestJSON-1573931620 tempest-ServerRescueNegativeTestJSON-1573931620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '731cbbfe17214ded8ac66299d66dfc45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '010919ea84eb4eb8b936c63153600eba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116063) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 12:58:56.210779 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: INFO nova.api.openstack.requestlog [None req-753c4486-c392-48bf-bc66-9b897606e891 tempest-ServerRescueNegativeTestJSON-1573931620 tempest-ServerRescueNegativeTestJSON-1573931620-project] 10.222.0.49 "GET /compute/v2.1/servers/60694e1e-d0cb-41c8-adf5-bdda49804385" status: 200 len: 1523 microversion: 2.1 time: 0.162261 Dec 14 12:58:56.211385 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: [pid: 116063|app: 0|req: 77/141] 10.222.0.49 () {58 vars in 1235 bytes} [Tue Dec 14 12:58:56 2021] GET /compute/v2.1/servers/60694e1e-d0cb-41c8-adf5-bdda49804385 => generated 1523 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 14 12:58:56.246781 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.api.openstack.wsgi [None req-0b541316-894a-496c-bd21-0c53de0173c9 tempest-DeleteServersTestJSON-1329684180 tempest-DeleteServersTestJSON-1329684180-project] Calling method '>' {{(pid=116064) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 12:58:56.247507 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.compute.api [None req-0b541316-894a-496c-bd21-0c53de0173c9 tempest-DeleteServersTestJSON-1329684180 tempest-DeleteServersTestJSON-1329684180-project] [instance: 0632db38-ebd1-43c1-8ab9-04fbb19edfa7] Fetching instance by UUID {{(pid=116064) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 12:58:56.253951 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-0b541316-894a-496c-bd21-0c53de0173c9 tempest-DeleteServersTestJSON-1329684180 tempest-DeleteServersTestJSON-1329684180-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 12:58:56.254395 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-0b541316-894a-496c-bd21-0c53de0173c9 tempest-DeleteServersTestJSON-1329684180 tempest-DeleteServersTestJSON-1329684180-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 12:58:56.255181 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-0b541316-894a-496c-bd21-0c53de0173c9 tempest-DeleteServersTestJSON-1329684180 tempest-DeleteServersTestJSON-1329684180-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 12:58:56.255608 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-0b541316-894a-496c-bd21-0c53de0173c9 tempest-DeleteServersTestJSON-1329684180 tempest-DeleteServersTestJSON-1329684180-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 12:58:56.295759 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.api.openstack.wsgi [None req-bd3c133a-e94e-477b-8d58-97ff6626ebfe tempest-VolumesActionsTest-648269150 tempest-VolumesActionsTest-648269150-project] Calling method '>' {{(pid=116063) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 12:58:56.296366 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.compute.api [None req-bd3c133a-e94e-477b-8d58-97ff6626ebfe tempest-VolumesActionsTest-648269150 tempest-VolumesActionsTest-648269150-project] [instance: ce203e83-7410-4aa5-ade6-6595fc8a6393] Fetching instance by UUID {{(pid=116063) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 12:58:56.304838 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-bd3c133a-e94e-477b-8d58-97ff6626ebfe tempest-VolumesActionsTest-648269150 tempest-VolumesActionsTest-648269150-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 12:58:56.305322 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-bd3c133a-e94e-477b-8d58-97ff6626ebfe tempest-VolumesActionsTest-648269150 tempest-VolumesActionsTest-648269150-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 12:58:56.306289 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-bd3c133a-e94e-477b-8d58-97ff6626ebfe tempest-VolumesActionsTest-648269150 tempest-VolumesActionsTest-648269150-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 12:58:56.306762 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-bd3c133a-e94e-477b-8d58-97ff6626ebfe tempest-VolumesActionsTest-648269150 tempest-VolumesActionsTest-648269150-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 12:58:56.427131 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.policy [None req-0b541316-894a-496c-bd21-0c53de0173c9 tempest-DeleteServersTestJSON-1329684180 tempest-DeleteServersTestJSON-1329684180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f4dc5a1bdfc4430b8fa39a5eec81f33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb24e38ec8e34dd9a93459b7ff9ba97a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116064) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 12:58:56.435503 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: INFO nova.api.openstack.requestlog [None req-0b541316-894a-496c-bd21-0c53de0173c9 tempest-DeleteServersTestJSON-1329684180 tempest-DeleteServersTestJSON-1329684180-project] 10.222.0.49 "GET /compute/v2.1/servers/0632db38-ebd1-43c1-8ab9-04fbb19edfa7" status: 200 len: 1553 microversion: 2.1 time: 0.193341 Dec 14 12:58:56.436198 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: [pid: 116064|app: 0|req: 65/142] 10.222.0.49 () {58 vars in 1235 bytes} [Tue Dec 14 12:58:56 2021] GET /compute/v2.1/servers/0632db38-ebd1-43c1-8ab9-04fbb19edfa7 => generated 1553 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 14 12:58:56.492658 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.policy [None req-bd3c133a-e94e-477b-8d58-97ff6626ebfe tempest-VolumesActionsTest-648269150 tempest-VolumesActionsTest-648269150-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cc7290157ff4075b95ead815c2b332a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fa190426a6c4b9c9d6d259455a647ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116063) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 12:58:56.500817 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: INFO nova.api.openstack.requestlog [None req-bd3c133a-e94e-477b-8d58-97ff6626ebfe tempest-VolumesActionsTest-648269150 tempest-VolumesActionsTest-648269150-project] 10.222.0.49 "GET /compute/v2.1/servers/ce203e83-7410-4aa5-ade6-6595fc8a6393" status: 200 len: 1314 microversion: 2.1 time: 0.208667 Dec 14 12:58:56.501464 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: [pid: 116063|app: 0|req: 78/143] 10.222.0.49 () {58 vars in 1235 bytes} [Tue Dec 14 12:58:56 2021] GET /compute/v2.1/servers/ce203e83-7410-4aa5-ade6-6595fc8a6393 => generated 1314 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 14 12:58:56.523084 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.api.openstack.wsgi [None req-86dc7439-6535-4c5a-8ad3-5b8beef985fd tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116064) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 14 12:58:56.524075 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.compute.api [None req-86dc7439-6535-4c5a-8ad3-5b8beef985fd tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] [instance: c8de7730-62f2-4a77-b1e9-cf6a74fa366d] Fetching instance by UUID {{(pid=116064) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 12:58:56.530729 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-86dc7439-6535-4c5a-8ad3-5b8beef985fd tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 12:58:56.531169 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-86dc7439-6535-4c5a-8ad3-5b8beef985fd tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 12:58:56.531964 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-86dc7439-6535-4c5a-8ad3-5b8beef985fd tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 12:58:56.532398 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-86dc7439-6535-4c5a-8ad3-5b8beef985fd tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 12:58:56.620043 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: INFO nova.api.openstack.requestlog [None req-86dc7439-6535-4c5a-8ad3-5b8beef985fd tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] 10.222.0.49 "POST /compute/v2.1/servers/c8de7730-62f2-4a77-b1e9-cf6a74fa366d/action" status: 200 len: 14 microversion: 2.20 time: 0.100724 Dec 14 12:58:56.621125 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: [pid: 116064|app: 0|req: 66/144] 10.222.0.49 () {62 vars in 1318 bytes} [Tue Dec 14 12:58:56 2021] POST /compute/v2.1/servers/c8de7730-62f2-4a77-b1e9-cf6a74fa366d/action => generated 14 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 14 12:58:57.227563 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.api.openstack.wsgi [None req-ed429a68-1a7e-43a8-a975-ef66c0ddcc08 tempest-ServerRescueNegativeTestJSON-1573931620 tempest-ServerRescueNegativeTestJSON-1573931620-project] Calling method '>' {{(pid=116063) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 12:58:57.228167 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.compute.api [None req-ed429a68-1a7e-43a8-a975-ef66c0ddcc08 tempest-ServerRescueNegativeTestJSON-1573931620 tempest-ServerRescueNegativeTestJSON-1573931620-project] [instance: 60694e1e-d0cb-41c8-adf5-bdda49804385] Fetching instance by UUID {{(pid=116063) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 12:58:57.234899 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-ed429a68-1a7e-43a8-a975-ef66c0ddcc08 tempest-ServerRescueNegativeTestJSON-1573931620 tempest-ServerRescueNegativeTestJSON-1573931620-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 12:58:57.235346 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-ed429a68-1a7e-43a8-a975-ef66c0ddcc08 tempest-ServerRescueNegativeTestJSON-1573931620 tempest-ServerRescueNegativeTestJSON-1573931620-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 12:58:57.236144 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-ed429a68-1a7e-43a8-a975-ef66c0ddcc08 tempest-ServerRescueNegativeTestJSON-1573931620 tempest-ServerRescueNegativeTestJSON-1573931620-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 12:58:57.236571 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-ed429a68-1a7e-43a8-a975-ef66c0ddcc08 tempest-ServerRescueNegativeTestJSON-1573931620 tempest-ServerRescueNegativeTestJSON-1573931620-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 12:58:57.376451 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.policy [None req-ed429a68-1a7e-43a8-a975-ef66c0ddcc08 tempest-ServerRescueNegativeTestJSON-1573931620 tempest-ServerRescueNegativeTestJSON-1573931620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '731cbbfe17214ded8ac66299d66dfc45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '010919ea84eb4eb8b936c63153600eba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116063) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 12:58:57.383740 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: INFO nova.api.openstack.requestlog [None req-ed429a68-1a7e-43a8-a975-ef66c0ddcc08 tempest-ServerRescueNegativeTestJSON-1573931620 tempest-ServerRescueNegativeTestJSON-1573931620-project] 10.222.0.49 "GET /compute/v2.1/servers/60694e1e-d0cb-41c8-adf5-bdda49804385" status: 200 len: 1523 microversion: 2.1 time: 0.160115 Dec 14 12:58:57.384319 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: [pid: 116063|app: 0|req: 79/145] 10.222.0.49 () {58 vars in 1235 bytes} [Tue Dec 14 12:58:57 2021] GET /compute/v2.1/servers/60694e1e-d0cb-41c8-adf5-bdda49804385 => generated 1523 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 14 12:58:57.453075 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.api.openstack.wsgi [None req-ed715fac-aa36-4b45-b838-baabb0254a05 tempest-DeleteServersTestJSON-1329684180 tempest-DeleteServersTestJSON-1329684180-project] Calling method '>' {{(pid=116064) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 12:58:57.453765 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.compute.api [None req-ed715fac-aa36-4b45-b838-baabb0254a05 tempest-DeleteServersTestJSON-1329684180 tempest-DeleteServersTestJSON-1329684180-project] [instance: 0632db38-ebd1-43c1-8ab9-04fbb19edfa7] Fetching instance by UUID {{(pid=116064) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 12:58:57.460540 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-ed715fac-aa36-4b45-b838-baabb0254a05 tempest-DeleteServersTestJSON-1329684180 tempest-DeleteServersTestJSON-1329684180-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 12:58:57.461017 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-ed715fac-aa36-4b45-b838-baabb0254a05 tempest-DeleteServersTestJSON-1329684180 tempest-DeleteServersTestJSON-1329684180-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 12:58:57.461793 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-ed715fac-aa36-4b45-b838-baabb0254a05 tempest-DeleteServersTestJSON-1329684180 tempest-DeleteServersTestJSON-1329684180-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 12:58:57.462219 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-ed715fac-aa36-4b45-b838-baabb0254a05 tempest-DeleteServersTestJSON-1329684180 tempest-DeleteServersTestJSON-1329684180-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 12:58:57.518598 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.api.openstack.wsgi [None req-822a37f7-990d-46c5-b2cd-db198906aa40 tempest-VolumesActionsTest-648269150 tempest-VolumesActionsTest-648269150-project] Calling method '>' {{(pid=116063) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 12:58:57.519137 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.compute.api [None req-822a37f7-990d-46c5-b2cd-db198906aa40 tempest-VolumesActionsTest-648269150 tempest-VolumesActionsTest-648269150-project] [instance: ce203e83-7410-4aa5-ade6-6595fc8a6393] Fetching instance by UUID {{(pid=116063) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 12:58:57.532987 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-822a37f7-990d-46c5-b2cd-db198906aa40 tempest-VolumesActionsTest-648269150 tempest-VolumesActionsTest-648269150-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 12:58:57.533465 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-822a37f7-990d-46c5-b2cd-db198906aa40 tempest-VolumesActionsTest-648269150 tempest-VolumesActionsTest-648269150-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 12:58:57.535638 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-822a37f7-990d-46c5-b2cd-db198906aa40 tempest-VolumesActionsTest-648269150 tempest-VolumesActionsTest-648269150-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 12:58:57.536070 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-822a37f7-990d-46c5-b2cd-db198906aa40 tempest-VolumesActionsTest-648269150 tempest-VolumesActionsTest-648269150-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 12:58:57.633588 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.policy [None req-ed715fac-aa36-4b45-b838-baabb0254a05 tempest-DeleteServersTestJSON-1329684180 tempest-DeleteServersTestJSON-1329684180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f4dc5a1bdfc4430b8fa39a5eec81f33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb24e38ec8e34dd9a93459b7ff9ba97a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116064) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 12:58:57.654886 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: INFO nova.api.openstack.requestlog [None req-ed715fac-aa36-4b45-b838-baabb0254a05 tempest-DeleteServersTestJSON-1329684180 tempest-DeleteServersTestJSON-1329684180-project] 10.222.0.49 "GET /compute/v2.1/servers/0632db38-ebd1-43c1-8ab9-04fbb19edfa7" status: 200 len: 1553 microversion: 2.1 time: 0.205698 Dec 14 12:58:57.664791 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: [pid: 116064|app: 0|req: 67/146] 10.222.0.49 () {58 vars in 1235 bytes} [Tue Dec 14 12:58:57 2021] GET /compute/v2.1/servers/0632db38-ebd1-43c1-8ab9-04fbb19edfa7 => generated 1553 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 14 12:58:57.664791 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.api.openstack.wsgi [None req-4af7f9e2-f9d2-410b-a79d-33b67d72069c tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116064) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 14 12:58:57.665473 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.compute.api [None req-4af7f9e2-f9d2-410b-a79d-33b67d72069c tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] [instance: c8de7730-62f2-4a77-b1e9-cf6a74fa366d] Fetching instance by UUID {{(pid=116064) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 12:58:57.681523 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-4af7f9e2-f9d2-410b-a79d-33b67d72069c tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 12:58:57.682200 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-4af7f9e2-f9d2-410b-a79d-33b67d72069c tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 12:58:57.684302 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-4af7f9e2-f9d2-410b-a79d-33b67d72069c tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 12:58:57.685013 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-4af7f9e2-f9d2-410b-a79d-33b67d72069c tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 12:58:57.710899 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.policy [None req-822a37f7-990d-46c5-b2cd-db198906aa40 tempest-VolumesActionsTest-648269150 tempest-VolumesActionsTest-648269150-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cc7290157ff4075b95ead815c2b332a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fa190426a6c4b9c9d6d259455a647ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116063) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 12:58:57.729074 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: INFO nova.api.openstack.requestlog [None req-822a37f7-990d-46c5-b2cd-db198906aa40 tempest-VolumesActionsTest-648269150 tempest-VolumesActionsTest-648269150-project] 10.222.0.49 "GET /compute/v2.1/servers/ce203e83-7410-4aa5-ade6-6595fc8a6393" status: 200 len: 1314 microversion: 2.1 time: 0.214350 Dec 14 12:58:57.730133 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: [pid: 116063|app: 0|req: 80/147] 10.222.0.49 () {58 vars in 1235 bytes} [Tue Dec 14 12:58:57 2021] GET /compute/v2.1/servers/ce203e83-7410-4aa5-ade6-6595fc8a6393 => generated 1314 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 14 12:58:57.768271 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: INFO nova.api.openstack.requestlog [None req-4af7f9e2-f9d2-410b-a79d-33b67d72069c tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] 10.222.0.49 "POST /compute/v2.1/servers/c8de7730-62f2-4a77-b1e9-cf6a74fa366d/action" status: 200 len: 14 microversion: 2.20 time: 0.110871 Dec 14 12:58:57.771553 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: [pid: 116064|app: 0|req: 68/148] 10.222.0.49 () {62 vars in 1318 bytes} [Tue Dec 14 12:58:57 2021] POST /compute/v2.1/servers/c8de7730-62f2-4a77-b1e9-cf6a74fa366d/action => generated 14 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 14 12:58:58.350691 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.api.openstack.wsgi [req-60f60da7-ec85-4b75-ba70-e7c01b90c9ea req-70ef97e6-7657-4185-b498-dcba2b3cc320 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0632db38-ebd1-43c1-8ab9-04fbb19edfa7", "name": "network-vif-deleted", "tag": "1fe1c28a-b855-4e98-8e95-d0334e66858c"}]} {{(pid=116063) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 14 12:58:58.352757 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 14 12:58:58.352757 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: warnings.warn(msg) Dec 14 12:58:58.361593 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [req-60f60da7-ec85-4b75-ba70-e7c01b90c9ea req-70ef97e6-7657-4185-b498-dcba2b3cc320 service nova] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 12:58:58.362004 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [req-60f60da7-ec85-4b75-ba70-e7c01b90c9ea req-70ef97e6-7657-4185-b498-dcba2b3cc320 service nova] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 12:58:58.374079 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: INFO nova.api.openstack.compute.server_external_events [req-60f60da7-ec85-4b75-ba70-e7c01b90c9ea req-70ef97e6-7657-4185-b498-dcba2b3cc320 service nova] Creating event network-vif-deleted:1fe1c28a-b855-4e98-8e95-d0334e66858c for instance 0632db38-ebd1-43c1-8ab9-04fbb19edfa7 on hv-cinder-78447 Dec 14 12:58:58.379289 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: INFO nova.api.openstack.requestlog [req-60f60da7-ec85-4b75-ba70-e7c01b90c9ea req-70ef97e6-7657-4185-b498-dcba2b3cc320 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032349 Dec 14 12:58:58.379924 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: [pid: 116063|app: 0|req: 81/149] 10.222.0.49 () {64 vars in 1317 bytes} [Tue Dec 14 12:58:58 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 14 12:58:58.401404 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.api.openstack.wsgi [None req-794af6cc-0191-4ca4-b9b5-21d9279a3351 tempest-ServerRescueNegativeTestJSON-1573931620 tempest-ServerRescueNegativeTestJSON-1573931620-project] Calling method '>' {{(pid=116064) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 12:58:58.402103 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.compute.api [None req-794af6cc-0191-4ca4-b9b5-21d9279a3351 tempest-ServerRescueNegativeTestJSON-1573931620 tempest-ServerRescueNegativeTestJSON-1573931620-project] [instance: 60694e1e-d0cb-41c8-adf5-bdda49804385] Fetching instance by UUID {{(pid=116064) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 12:58:58.411210 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-794af6cc-0191-4ca4-b9b5-21d9279a3351 tempest-ServerRescueNegativeTestJSON-1573931620 tempest-ServerRescueNegativeTestJSON-1573931620-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 12:58:58.411872 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-794af6cc-0191-4ca4-b9b5-21d9279a3351 tempest-ServerRescueNegativeTestJSON-1573931620 tempest-ServerRescueNegativeTestJSON-1573931620-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 12:58:58.415140 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-794af6cc-0191-4ca4-b9b5-21d9279a3351 tempest-ServerRescueNegativeTestJSON-1573931620 tempest-ServerRescueNegativeTestJSON-1573931620-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 12:58:58.415770 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-794af6cc-0191-4ca4-b9b5-21d9279a3351 tempest-ServerRescueNegativeTestJSON-1573931620 tempest-ServerRescueNegativeTestJSON-1573931620-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 12:58:58.562356 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.policy [None req-794af6cc-0191-4ca4-b9b5-21d9279a3351 tempest-ServerRescueNegativeTestJSON-1573931620 tempest-ServerRescueNegativeTestJSON-1573931620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '731cbbfe17214ded8ac66299d66dfc45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '010919ea84eb4eb8b936c63153600eba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116064) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 12:58:58.579723 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: INFO nova.api.openstack.requestlog [None req-794af6cc-0191-4ca4-b9b5-21d9279a3351 tempest-ServerRescueNegativeTestJSON-1573931620 tempest-ServerRescueNegativeTestJSON-1573931620-project] 10.222.0.49 "GET /compute/v2.1/servers/60694e1e-d0cb-41c8-adf5-bdda49804385" status: 200 len: 1523 microversion: 2.1 time: 0.182263 Dec 14 12:58:58.581216 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: [pid: 116064|app: 0|req: 69/150] 10.222.0.49 () {58 vars in 1235 bytes} [Tue Dec 14 12:58:58 2021] GET /compute/v2.1/servers/60694e1e-d0cb-41c8-adf5-bdda49804385 => generated 1523 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 14 12:58:58.673200 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.api.openstack.wsgi [None req-834626db-4175-4565-b552-6d853eb2f72f tempest-DeleteServersTestJSON-1329684180 tempest-DeleteServersTestJSON-1329684180-project] Calling method '>' {{(pid=116063) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 12:58:58.674585 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.compute.api [None req-834626db-4175-4565-b552-6d853eb2f72f tempest-DeleteServersTestJSON-1329684180 tempest-DeleteServersTestJSON-1329684180-project] [instance: 0632db38-ebd1-43c1-8ab9-04fbb19edfa7] Fetching instance by UUID {{(pid=116063) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 12:58:58.684699 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-834626db-4175-4565-b552-6d853eb2f72f tempest-DeleteServersTestJSON-1329684180 tempest-DeleteServersTestJSON-1329684180-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 12:58:58.693026 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-834626db-4175-4565-b552-6d853eb2f72f tempest-DeleteServersTestJSON-1329684180 tempest-DeleteServersTestJSON-1329684180-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 12:58:58.694037 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-834626db-4175-4565-b552-6d853eb2f72f tempest-DeleteServersTestJSON-1329684180 tempest-DeleteServersTestJSON-1329684180-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 12:58:58.694536 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-834626db-4175-4565-b552-6d853eb2f72f tempest-DeleteServersTestJSON-1329684180 tempest-DeleteServersTestJSON-1329684180-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 12:58:58.747524 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.api.openstack.wsgi [None req-155053c1-665c-40ff-8a7a-784c1a495d62 tempest-VolumesActionsTest-648269150 tempest-VolumesActionsTest-648269150-project] Calling method '>' {{(pid=116064) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 12:58:58.748227 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.compute.api [None req-155053c1-665c-40ff-8a7a-784c1a495d62 tempest-VolumesActionsTest-648269150 tempest-VolumesActionsTest-648269150-project] [instance: ce203e83-7410-4aa5-ade6-6595fc8a6393] Fetching instance by UUID {{(pid=116064) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 12:58:58.755216 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-155053c1-665c-40ff-8a7a-784c1a495d62 tempest-VolumesActionsTest-648269150 tempest-VolumesActionsTest-648269150-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 12:58:58.755829 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-155053c1-665c-40ff-8a7a-784c1a495d62 tempest-VolumesActionsTest-648269150 tempest-VolumesActionsTest-648269150-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 12:58:58.756957 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-155053c1-665c-40ff-8a7a-784c1a495d62 tempest-VolumesActionsTest-648269150 tempest-VolumesActionsTest-648269150-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 12:58:58.757917 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-155053c1-665c-40ff-8a7a-784c1a495d62 tempest-VolumesActionsTest-648269150 tempest-VolumesActionsTest-648269150-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 12:58:58.779530 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.policy [None req-834626db-4175-4565-b552-6d853eb2f72f tempest-DeleteServersTestJSON-1329684180 tempest-DeleteServersTestJSON-1329684180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f4dc5a1bdfc4430b8fa39a5eec81f33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb24e38ec8e34dd9a93459b7ff9ba97a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116063) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 12:58:58.799256 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: INFO nova.api.openstack.requestlog [None req-834626db-4175-4565-b552-6d853eb2f72f tempest-DeleteServersTestJSON-1329684180 tempest-DeleteServersTestJSON-1329684180-project] 10.222.0.49 "GET /compute/v2.1/servers/0632db38-ebd1-43c1-8ab9-04fbb19edfa7" status: 200 len: 1345 microversion: 2.1 time: 0.131095 Dec 14 12:58:58.800609 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: [pid: 116063|app: 0|req: 82/151] 10.222.0.49 () {58 vars in 1235 bytes} [Tue Dec 14 12:58:58 2021] GET /compute/v2.1/servers/0632db38-ebd1-43c1-8ab9-04fbb19edfa7 => generated 1345 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 14 12:58:58.805948 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.api.openstack.wsgi [None req-c3859c45-07e0-4ea6-890e-d20b82a39339 tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116063) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 14 12:58:58.806888 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.compute.api [None req-c3859c45-07e0-4ea6-890e-d20b82a39339 tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] [instance: c8de7730-62f2-4a77-b1e9-cf6a74fa366d] Fetching instance by UUID {{(pid=116063) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 12:58:58.813428 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-c3859c45-07e0-4ea6-890e-d20b82a39339 tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 12:58:58.814224 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-c3859c45-07e0-4ea6-890e-d20b82a39339 tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 12:58:58.815725 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-c3859c45-07e0-4ea6-890e-d20b82a39339 tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 12:58:58.816412 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-c3859c45-07e0-4ea6-890e-d20b82a39339 tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 12:58:58.901330 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: INFO nova.api.openstack.requestlog [None req-c3859c45-07e0-4ea6-890e-d20b82a39339 tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] 10.222.0.49 "POST /compute/v2.1/servers/c8de7730-62f2-4a77-b1e9-cf6a74fa366d/action" status: 200 len: 14 microversion: 2.20 time: 0.099354 Dec 14 12:58:58.902102 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: [pid: 116063|app: 0|req: 83/152] 10.222.0.49 () {62 vars in 1318 bytes} [Tue Dec 14 12:58:58 2021] POST /compute/v2.1/servers/c8de7730-62f2-4a77-b1e9-cf6a74fa366d/action => generated 14 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 14 12:58:58.908166 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.policy [None req-155053c1-665c-40ff-8a7a-784c1a495d62 tempest-VolumesActionsTest-648269150 tempest-VolumesActionsTest-648269150-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cc7290157ff4075b95ead815c2b332a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fa190426a6c4b9c9d6d259455a647ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116064) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 12:58:58.915590 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: INFO nova.api.openstack.requestlog [None req-155053c1-665c-40ff-8a7a-784c1a495d62 tempest-VolumesActionsTest-648269150 tempest-VolumesActionsTest-648269150-project] 10.222.0.49 "GET /compute/v2.1/servers/ce203e83-7410-4aa5-ade6-6595fc8a6393" status: 200 len: 1314 microversion: 2.1 time: 0.173334 Dec 14 12:58:58.916168 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: [pid: 116064|app: 0|req: 70/153] 10.222.0.49 () {58 vars in 1235 bytes} [Tue Dec 14 12:58:58 2021] GET /compute/v2.1/servers/ce203e83-7410-4aa5-ade6-6595fc8a6393 => generated 1314 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 14 12:58:59.600315 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.api.openstack.wsgi [None req-55c4930e-e06b-4a10-8ba0-0febf330f9e9 tempest-ServerRescueNegativeTestJSON-1573931620 tempest-ServerRescueNegativeTestJSON-1573931620-project] Calling method '>' {{(pid=116063) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 12:58:59.601197 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.compute.api [None req-55c4930e-e06b-4a10-8ba0-0febf330f9e9 tempest-ServerRescueNegativeTestJSON-1573931620 tempest-ServerRescueNegativeTestJSON-1573931620-project] [instance: 60694e1e-d0cb-41c8-adf5-bdda49804385] Fetching instance by UUID {{(pid=116063) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 12:58:59.609025 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-55c4930e-e06b-4a10-8ba0-0febf330f9e9 tempest-ServerRescueNegativeTestJSON-1573931620 tempest-ServerRescueNegativeTestJSON-1573931620-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 12:58:59.609470 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-55c4930e-e06b-4a10-8ba0-0febf330f9e9 tempest-ServerRescueNegativeTestJSON-1573931620 tempest-ServerRescueNegativeTestJSON-1573931620-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 12:58:59.610381 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-55c4930e-e06b-4a10-8ba0-0febf330f9e9 tempest-ServerRescueNegativeTestJSON-1573931620 tempest-ServerRescueNegativeTestJSON-1573931620-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 12:58:59.610813 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-55c4930e-e06b-4a10-8ba0-0febf330f9e9 tempest-ServerRescueNegativeTestJSON-1573931620 tempest-ServerRescueNegativeTestJSON-1573931620-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 12:58:59.756293 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.policy [None req-55c4930e-e06b-4a10-8ba0-0febf330f9e9 tempest-ServerRescueNegativeTestJSON-1573931620 tempest-ServerRescueNegativeTestJSON-1573931620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '731cbbfe17214ded8ac66299d66dfc45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '010919ea84eb4eb8b936c63153600eba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116063) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 12:58:59.763966 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: INFO nova.api.openstack.requestlog [None req-55c4930e-e06b-4a10-8ba0-0febf330f9e9 tempest-ServerRescueNegativeTestJSON-1573931620 tempest-ServerRescueNegativeTestJSON-1573931620-project] 10.222.0.49 "GET /compute/v2.1/servers/60694e1e-d0cb-41c8-adf5-bdda49804385" status: 200 len: 1523 microversion: 2.1 time: 0.167946 Dec 14 12:58:59.764543 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: [pid: 116063|app: 0|req: 84/154] 10.222.0.49 () {58 vars in 1235 bytes} [Tue Dec 14 12:58:59 2021] GET /compute/v2.1/servers/60694e1e-d0cb-41c8-adf5-bdda49804385 => generated 1523 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 14 12:58:59.817501 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.api.openstack.wsgi [None req-ac849cfe-d7d1-4ba1-a4e9-07d01ce447ca tempest-DeleteServersTestJSON-1329684180 tempest-DeleteServersTestJSON-1329684180-project] Calling method '>' {{(pid=116064) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 12:58:59.818089 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.compute.api [None req-ac849cfe-d7d1-4ba1-a4e9-07d01ce447ca tempest-DeleteServersTestJSON-1329684180 tempest-DeleteServersTestJSON-1329684180-project] [instance: 0632db38-ebd1-43c1-8ab9-04fbb19edfa7] Fetching instance by UUID {{(pid=116064) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 12:58:59.824739 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-ac849cfe-d7d1-4ba1-a4e9-07d01ce447ca tempest-DeleteServersTestJSON-1329684180 tempest-DeleteServersTestJSON-1329684180-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 12:58:59.825217 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-ac849cfe-d7d1-4ba1-a4e9-07d01ce447ca tempest-DeleteServersTestJSON-1329684180 tempest-DeleteServersTestJSON-1329684180-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 12:58:59.825991 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-ac849cfe-d7d1-4ba1-a4e9-07d01ce447ca tempest-DeleteServersTestJSON-1329684180 tempest-DeleteServersTestJSON-1329684180-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 12:58:59.826402 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-ac849cfe-d7d1-4ba1-a4e9-07d01ce447ca tempest-DeleteServersTestJSON-1329684180 tempest-DeleteServersTestJSON-1329684180-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 12:58:59.845314 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: INFO nova.api.openstack.wsgi [None req-ac849cfe-d7d1-4ba1-a4e9-07d01ce447ca tempest-DeleteServersTestJSON-1329684180 tempest-DeleteServersTestJSON-1329684180-project] HTTP exception thrown: Instance 0632db38-ebd1-43c1-8ab9-04fbb19edfa7 could not be found. Dec 14 12:58:59.845314 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.api.openstack.wsgi [None req-ac849cfe-d7d1-4ba1-a4e9-07d01ce447ca tempest-DeleteServersTestJSON-1329684180 tempest-DeleteServersTestJSON-1329684180-project] Returning 404 to user: Instance 0632db38-ebd1-43c1-8ab9-04fbb19edfa7 could not be found. {{(pid=116064) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 14 12:58:59.845314 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: INFO nova.api.openstack.requestlog [None req-ac849cfe-d7d1-4ba1-a4e9-07d01ce447ca tempest-DeleteServersTestJSON-1329684180 tempest-DeleteServersTestJSON-1329684180-project] 10.222.0.49 "GET /compute/v2.1/servers/0632db38-ebd1-43c1-8ab9-04fbb19edfa7" status: 404 len: 111 microversion: 2.1 time: 0.027135 Dec 14 12:58:59.845314 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: [pid: 116064|app: 0|req: 71/155] 10.222.0.49 () {58 vars in 1235 bytes} [Tue Dec 14 12:58:59 2021] GET /compute/v2.1/servers/0632db38-ebd1-43c1-8ab9-04fbb19edfa7 => generated 111 bytes in 28 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Dec 14 12:58:59.913270 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.api.openstack.wsgi [None req-60fa0c19-b788-492e-bf78-add87a510497 tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116063) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 14 12:58:59.914187 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.compute.api [None req-60fa0c19-b788-492e-bf78-add87a510497 tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] [instance: c8de7730-62f2-4a77-b1e9-cf6a74fa366d] Fetching instance by UUID {{(pid=116063) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 12:58:59.932701 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.api.openstack.wsgi [None req-a565a307-3cbc-435b-953b-e401bdb7e7c7 tempest-VolumesActionsTest-648269150 tempest-VolumesActionsTest-648269150-project] Calling method '>' {{(pid=116064) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 12:58:59.933515 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.compute.api [None req-a565a307-3cbc-435b-953b-e401bdb7e7c7 tempest-VolumesActionsTest-648269150 tempest-VolumesActionsTest-648269150-project] [instance: ce203e83-7410-4aa5-ade6-6595fc8a6393] Fetching instance by UUID {{(pid=116064) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 12:58:59.936932 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-60fa0c19-b788-492e-bf78-add87a510497 tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 12:58:59.937381 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-60fa0c19-b788-492e-bf78-add87a510497 tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 12:58:59.938172 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-60fa0c19-b788-492e-bf78-add87a510497 tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 12:58:59.938599 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-60fa0c19-b788-492e-bf78-add87a510497 tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 12:58:59.944257 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-a565a307-3cbc-435b-953b-e401bdb7e7c7 tempest-VolumesActionsTest-648269150 tempest-VolumesActionsTest-648269150-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 12:58:59.944699 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-a565a307-3cbc-435b-953b-e401bdb7e7c7 tempest-VolumesActionsTest-648269150 tempest-VolumesActionsTest-648269150-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 12:58:59.945537 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-a565a307-3cbc-435b-953b-e401bdb7e7c7 tempest-VolumesActionsTest-648269150 tempest-VolumesActionsTest-648269150-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 12:58:59.945959 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-a565a307-3cbc-435b-953b-e401bdb7e7c7 tempest-VolumesActionsTest-648269150 tempest-VolumesActionsTest-648269150-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 12:59:00.091524 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.policy [None req-a565a307-3cbc-435b-953b-e401bdb7e7c7 tempest-VolumesActionsTest-648269150 tempest-VolumesActionsTest-648269150-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cc7290157ff4075b95ead815c2b332a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fa190426a6c4b9c9d6d259455a647ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116064) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 12:59:00.098454 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: INFO nova.api.openstack.requestlog [None req-60fa0c19-b788-492e-bf78-add87a510497 tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] 10.222.0.49 "POST /compute/v2.1/servers/c8de7730-62f2-4a77-b1e9-cf6a74fa366d/action" status: 200 len: 14 microversion: 2.20 time: 0.189338 Dec 14 12:59:00.098853 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: INFO nova.api.openstack.requestlog [None req-a565a307-3cbc-435b-953b-e401bdb7e7c7 tempest-VolumesActionsTest-648269150 tempest-VolumesActionsTest-648269150-project] 10.222.0.49 "GET /compute/v2.1/servers/ce203e83-7410-4aa5-ade6-6595fc8a6393" status: 200 len: 1314 microversion: 2.1 time: 0.169783 Dec 14 12:59:00.101800 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: [pid: 116063|app: 0|req: 85/157] 10.222.0.49 () {62 vars in 1318 bytes} [Tue Dec 14 12:58:59 2021] POST /compute/v2.1/servers/c8de7730-62f2-4a77-b1e9-cf6a74fa366d/action => generated 14 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 14 12:59:00.101951 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: [pid: 116064|app: 0|req: 72/157] 10.222.0.49 () {58 vars in 1235 bytes} [Tue Dec 14 12:58:59 2021] GET /compute/v2.1/servers/ce203e83-7410-4aa5-ade6-6595fc8a6393 => generated 1314 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 14 12:59:00.104497 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.api.openstack.wsgi [None req-067782a3-3d3a-410e-8fd4-23c4a13b60f1 tempest-DeleteServersTestJSON-1329684180 tempest-DeleteServersTestJSON-1329684180-project] Calling method '>' {{(pid=116063) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 12:59:00.105541 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.compute.api [None req-067782a3-3d3a-410e-8fd4-23c4a13b60f1 tempest-DeleteServersTestJSON-1329684180 tempest-DeleteServersTestJSON-1329684180-project] [instance: 0632db38-ebd1-43c1-8ab9-04fbb19edfa7] Fetching instance by UUID {{(pid=116063) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 12:59:00.112361 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-067782a3-3d3a-410e-8fd4-23c4a13b60f1 tempest-DeleteServersTestJSON-1329684180 tempest-DeleteServersTestJSON-1329684180-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 12:59:00.112801 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-067782a3-3d3a-410e-8fd4-23c4a13b60f1 tempest-DeleteServersTestJSON-1329684180 tempest-DeleteServersTestJSON-1329684180-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 12:59:00.113607 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-067782a3-3d3a-410e-8fd4-23c4a13b60f1 tempest-DeleteServersTestJSON-1329684180 tempest-DeleteServersTestJSON-1329684180-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 12:59:00.114033 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-067782a3-3d3a-410e-8fd4-23c4a13b60f1 tempest-DeleteServersTestJSON-1329684180 tempest-DeleteServersTestJSON-1329684180-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 12:59:00.126885 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: INFO nova.api.openstack.wsgi [None req-067782a3-3d3a-410e-8fd4-23c4a13b60f1 tempest-DeleteServersTestJSON-1329684180 tempest-DeleteServersTestJSON-1329684180-project] HTTP exception thrown: Instance 0632db38-ebd1-43c1-8ab9-04fbb19edfa7 could not be found. Dec 14 12:59:00.127468 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.api.openstack.wsgi [None req-067782a3-3d3a-410e-8fd4-23c4a13b60f1 tempest-DeleteServersTestJSON-1329684180 tempest-DeleteServersTestJSON-1329684180-project] Returning 404 to user: Instance 0632db38-ebd1-43c1-8ab9-04fbb19edfa7 could not be found. {{(pid=116063) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 14 12:59:00.128281 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: INFO nova.api.openstack.requestlog [None req-067782a3-3d3a-410e-8fd4-23c4a13b60f1 tempest-DeleteServersTestJSON-1329684180 tempest-DeleteServersTestJSON-1329684180-project] 10.222.0.49 "GET /compute/v2.1/servers/0632db38-ebd1-43c1-8ab9-04fbb19edfa7/os-volume_attachments" status: 404 len: 111 microversion: 2.1 time: 0.027783 Dec 14 12:59:00.128804 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: [pid: 116063|app: 0|req: 86/158] 10.222.0.49 () {58 vars in 1301 bytes} [Tue Dec 14 12:59:00 2021] GET /compute/v2.1/servers/0632db38-ebd1-43c1-8ab9-04fbb19edfa7/os-volume_attachments => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Dec 14 12:59:00.651895 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.api.openstack.wsgi [req-5c2093a6-a3ea-460d-8f73-15fa8585c60f req-239a0a7a-2639-4449-b1df-7e9cb7711228 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ce203e83-7410-4aa5-ade6-6595fc8a6393", "name": "network-vif-plugged", "status": "completed", "tag": "2f7ee134-4a53-4bf3-b113-860ae25ab31f"}]} {{(pid=116064) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 14 12:59:00.653622 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 14 12:59:00.653622 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: warnings.warn(msg) Dec 14 12:59:00.661416 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [req-5c2093a6-a3ea-460d-8f73-15fa8585c60f req-239a0a7a-2639-4449-b1df-7e9cb7711228 service nova] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 12:59:00.661958 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [req-5c2093a6-a3ea-460d-8f73-15fa8585c60f req-239a0a7a-2639-4449-b1df-7e9cb7711228 service nova] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 12:59:00.675340 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: INFO nova.api.openstack.compute.server_external_events [req-5c2093a6-a3ea-460d-8f73-15fa8585c60f req-239a0a7a-2639-4449-b1df-7e9cb7711228 service nova] Creating event network-vif-plugged:2f7ee134-4a53-4bf3-b113-860ae25ab31f for instance ce203e83-7410-4aa5-ade6-6595fc8a6393 on hv-cinder-78447 Dec 14 12:59:00.681399 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: INFO nova.api.openstack.requestlog [req-5c2093a6-a3ea-460d-8f73-15fa8585c60f req-239a0a7a-2639-4449-b1df-7e9cb7711228 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033069 Dec 14 12:59:00.682867 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: [pid: 116064|app: 0|req: 73/159] 10.222.0.49 () {64 vars in 1317 bytes} [Tue Dec 14 12:59:00 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 14 12:59:00.781144 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.api.openstack.wsgi [None req-29ea41b0-b580-4e57-b22e-48a2787ba76a tempest-ServerRescueNegativeTestJSON-1573931620 tempest-ServerRescueNegativeTestJSON-1573931620-project] Calling method '>' {{(pid=116063) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 12:59:00.781872 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.compute.api [None req-29ea41b0-b580-4e57-b22e-48a2787ba76a tempest-ServerRescueNegativeTestJSON-1573931620 tempest-ServerRescueNegativeTestJSON-1573931620-project] [instance: 60694e1e-d0cb-41c8-adf5-bdda49804385] Fetching instance by UUID {{(pid=116063) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 12:59:00.792729 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-29ea41b0-b580-4e57-b22e-48a2787ba76a tempest-ServerRescueNegativeTestJSON-1573931620 tempest-ServerRescueNegativeTestJSON-1573931620-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 12:59:00.793319 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-29ea41b0-b580-4e57-b22e-48a2787ba76a tempest-ServerRescueNegativeTestJSON-1573931620 tempest-ServerRescueNegativeTestJSON-1573931620-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 12:59:00.794485 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-29ea41b0-b580-4e57-b22e-48a2787ba76a tempest-ServerRescueNegativeTestJSON-1573931620 tempest-ServerRescueNegativeTestJSON-1573931620-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 12:59:00.795264 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-29ea41b0-b580-4e57-b22e-48a2787ba76a tempest-ServerRescueNegativeTestJSON-1573931620 tempest-ServerRescueNegativeTestJSON-1573931620-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 12:59:01.111606 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.api.openstack.wsgi [None req-7b30715d-1ea9-41e8-ae27-d43af1a86676 tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116064) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 14 12:59:01.113018 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.compute.api [None req-7b30715d-1ea9-41e8-ae27-d43af1a86676 tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] [instance: c8de7730-62f2-4a77-b1e9-cf6a74fa366d] Fetching instance by UUID {{(pid=116064) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 12:59:01.120480 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-7b30715d-1ea9-41e8-ae27-d43af1a86676 tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 12:59:01.121284 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-7b30715d-1ea9-41e8-ae27-d43af1a86676 tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 12:59:01.122197 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-7b30715d-1ea9-41e8-ae27-d43af1a86676 tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 12:59:01.123201 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-7b30715d-1ea9-41e8-ae27-d43af1a86676 tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 12:59:01.181522 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.policy [None req-29ea41b0-b580-4e57-b22e-48a2787ba76a tempest-ServerRescueNegativeTestJSON-1573931620 tempest-ServerRescueNegativeTestJSON-1573931620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '731cbbfe17214ded8ac66299d66dfc45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '010919ea84eb4eb8b936c63153600eba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116063) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 12:59:01.189558 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: INFO nova.api.openstack.requestlog [None req-29ea41b0-b580-4e57-b22e-48a2787ba76a tempest-ServerRescueNegativeTestJSON-1573931620 tempest-ServerRescueNegativeTestJSON-1573931620-project] 10.222.0.49 "GET /compute/v2.1/servers/60694e1e-d0cb-41c8-adf5-bdda49804385" status: 200 len: 1523 microversion: 2.1 time: 0.412411 Dec 14 12:59:01.191480 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: [pid: 116063|app: 0|req: 87/160] 10.222.0.49 () {58 vars in 1235 bytes} [Tue Dec 14 12:59:00 2021] GET /compute/v2.1/servers/60694e1e-d0cb-41c8-adf5-bdda49804385 => generated 1523 bytes in 414 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 14 12:59:01.196523 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.api.openstack.wsgi [None req-8c7f2dcf-bab0-4416-9d78-97748c337e9d tempest-VolumesActionsTest-648269150 tempest-VolumesActionsTest-648269150-project] Calling method '>' {{(pid=116063) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 12:59:01.197406 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.compute.api [None req-8c7f2dcf-bab0-4416-9d78-97748c337e9d tempest-VolumesActionsTest-648269150 tempest-VolumesActionsTest-648269150-project] [instance: ce203e83-7410-4aa5-ade6-6595fc8a6393] Fetching instance by UUID {{(pid=116063) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 12:59:01.203486 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-8c7f2dcf-bab0-4416-9d78-97748c337e9d tempest-VolumesActionsTest-648269150 tempest-VolumesActionsTest-648269150-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 12:59:01.203929 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-8c7f2dcf-bab0-4416-9d78-97748c337e9d tempest-VolumesActionsTest-648269150 tempest-VolumesActionsTest-648269150-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 12:59:01.204836 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-8c7f2dcf-bab0-4416-9d78-97748c337e9d tempest-VolumesActionsTest-648269150 tempest-VolumesActionsTest-648269150-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 12:59:01.205336 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-8c7f2dcf-bab0-4416-9d78-97748c337e9d tempest-VolumesActionsTest-648269150 tempest-VolumesActionsTest-648269150-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 12:59:01.396569 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: INFO nova.api.openstack.requestlog [None req-7b30715d-1ea9-41e8-ae27-d43af1a86676 tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] 10.222.0.49 "POST /compute/v2.1/servers/c8de7730-62f2-4a77-b1e9-cf6a74fa366d/action" status: 200 len: 14 microversion: 2.20 time: 0.290498 Dec 14 12:59:01.397359 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: [pid: 116064|app: 0|req: 74/161] 10.222.0.49 () {62 vars in 1318 bytes} [Tue Dec 14 12:59:01 2021] POST /compute/v2.1/servers/c8de7730-62f2-4a77-b1e9-cf6a74fa366d/action => generated 14 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 14 12:59:01.402665 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.api.openstack.wsgi [None req-588bd521-6f97-4d1a-844a-48ac3d7ebee7 tempest-AttachVolumeNegativeTest-1000400951 tempest-AttachVolumeNegativeTest-1000400951-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-273225043", "imageRef": "1733dcd4-5ded-44e1-8b8d-392adb05c67a", "flavorRef": "452", "networks": [{"uuid": "f9d231ae-628f-4043-969c-cf414631d868"}]}} {{(pid=116064) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 14 12:59:01.456495 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.network.neutron [None req-588bd521-6f97-4d1a-844a-48ac3d7ebee7 tempest-AttachVolumeNegativeTest-1000400951 tempest-AttachVolumeNegativeTest-1000400951-project] validate_networks() for [('f9d231ae-628f-4043-969c-cf414631d868', None, None, None, None, None)] {{(pid=116064) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Dec 14 12:59:01.456668 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.policy [None req-8c7f2dcf-bab0-4416-9d78-97748c337e9d tempest-VolumesActionsTest-648269150 tempest-VolumesActionsTest-648269150-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cc7290157ff4075b95ead815c2b332a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fa190426a6c4b9c9d6d259455a647ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116063) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 12:59:01.466000 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: INFO nova.api.openstack.requestlog [None req-8c7f2dcf-bab0-4416-9d78-97748c337e9d tempest-VolumesActionsTest-648269150 tempest-VolumesActionsTest-648269150-project] 10.222.0.49 "GET /compute/v2.1/servers/ce203e83-7410-4aa5-ade6-6595fc8a6393" status: 200 len: 1314 microversion: 2.1 time: 0.273272 Dec 14 12:59:01.466949 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: [pid: 116063|app: 0|req: 88/162] 10.222.0.49 () {58 vars in 1235 bytes} [Tue Dec 14 12:59:01 2021] GET /compute/v2.1/servers/ce203e83-7410-4aa5-ade6-6595fc8a6393 => generated 1314 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 14 12:59:01.471821 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.api.openstack.wsgi [None req-ccfc7f5c-38a1-4cee-96bf-ebac4b7b809f tempest-DeleteServersTestJSON-1329684180 tempest-DeleteServersTestJSON-1329684180-project] Calling method '>' {{(pid=116063) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 12:59:01.472303 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.compute.api [None req-ccfc7f5c-38a1-4cee-96bf-ebac4b7b809f tempest-DeleteServersTestJSON-1329684180 tempest-DeleteServersTestJSON-1329684180-project] [instance: 0632db38-ebd1-43c1-8ab9-04fbb19edfa7] Fetching instance by UUID {{(pid=116063) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 12:59:01.477983 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-ccfc7f5c-38a1-4cee-96bf-ebac4b7b809f tempest-DeleteServersTestJSON-1329684180 tempest-DeleteServersTestJSON-1329684180-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 12:59:01.478541 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-ccfc7f5c-38a1-4cee-96bf-ebac4b7b809f tempest-DeleteServersTestJSON-1329684180 tempest-DeleteServersTestJSON-1329684180-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 12:59:01.479313 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-ccfc7f5c-38a1-4cee-96bf-ebac4b7b809f tempest-DeleteServersTestJSON-1329684180 tempest-DeleteServersTestJSON-1329684180-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 12:59:01.479738 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-ccfc7f5c-38a1-4cee-96bf-ebac4b7b809f tempest-DeleteServersTestJSON-1329684180 tempest-DeleteServersTestJSON-1329684180-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 12:59:01.492825 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: INFO nova.api.openstack.wsgi [None req-ccfc7f5c-38a1-4cee-96bf-ebac4b7b809f tempest-DeleteServersTestJSON-1329684180 tempest-DeleteServersTestJSON-1329684180-project] HTTP exception thrown: Instance 0632db38-ebd1-43c1-8ab9-04fbb19edfa7 could not be found. Dec 14 12:59:01.493432 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.api.openstack.wsgi [None req-ccfc7f5c-38a1-4cee-96bf-ebac4b7b809f tempest-DeleteServersTestJSON-1329684180 tempest-DeleteServersTestJSON-1329684180-project] Returning 404 to user: Instance 0632db38-ebd1-43c1-8ab9-04fbb19edfa7 could not be found. {{(pid=116063) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 14 12:59:01.494246 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: INFO nova.api.openstack.requestlog [None req-ccfc7f5c-38a1-4cee-96bf-ebac4b7b809f tempest-DeleteServersTestJSON-1329684180 tempest-DeleteServersTestJSON-1329684180-project] 10.222.0.49 "DELETE /compute/v2.1/servers/0632db38-ebd1-43c1-8ab9-04fbb19edfa7" status: 404 len: 111 microversion: 2.1 time: 0.026220 Dec 14 12:59:01.494789 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: [pid: 116063|app: 0|req: 89/163] 10.222.0.49 () {58 vars in 1238 bytes} [Tue Dec 14 12:59:01 2021] DELETE /compute/v2.1/servers/0632db38-ebd1-43c1-8ab9-04fbb19edfa7 => generated 111 bytes in 27 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Dec 14 12:59:01.502383 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.api.openstack.wsgi [None req-344184f6-c07b-4c1f-b62f-6b692a612d64 tempest-DeleteServersTestJSON-1329684180 tempest-DeleteServersTestJSON-1329684180-project] Calling method '>' {{(pid=116063) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 12:59:01.502931 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.compute.api [None req-344184f6-c07b-4c1f-b62f-6b692a612d64 tempest-DeleteServersTestJSON-1329684180 tempest-DeleteServersTestJSON-1329684180-project] [instance: 0632db38-ebd1-43c1-8ab9-04fbb19edfa7] Fetching instance by UUID {{(pid=116063) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 12:59:01.508576 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-344184f6-c07b-4c1f-b62f-6b692a612d64 tempest-DeleteServersTestJSON-1329684180 tempest-DeleteServersTestJSON-1329684180-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 12:59:01.509067 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-344184f6-c07b-4c1f-b62f-6b692a612d64 tempest-DeleteServersTestJSON-1329684180 tempest-DeleteServersTestJSON-1329684180-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 12:59:01.509831 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-344184f6-c07b-4c1f-b62f-6b692a612d64 tempest-DeleteServersTestJSON-1329684180 tempest-DeleteServersTestJSON-1329684180-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 12:59:01.510250 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-344184f6-c07b-4c1f-b62f-6b692a612d64 tempest-DeleteServersTestJSON-1329684180 tempest-DeleteServersTestJSON-1329684180-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 12:59:01.524988 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: INFO nova.api.openstack.wsgi [None req-344184f6-c07b-4c1f-b62f-6b692a612d64 tempest-DeleteServersTestJSON-1329684180 tempest-DeleteServersTestJSON-1329684180-project] HTTP exception thrown: Instance 0632db38-ebd1-43c1-8ab9-04fbb19edfa7 could not be found. Dec 14 12:59:01.525567 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.api.openstack.wsgi [None req-344184f6-c07b-4c1f-b62f-6b692a612d64 tempest-DeleteServersTestJSON-1329684180 tempest-DeleteServersTestJSON-1329684180-project] Returning 404 to user: Instance 0632db38-ebd1-43c1-8ab9-04fbb19edfa7 could not be found. {{(pid=116063) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 14 12:59:01.526380 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: INFO nova.api.openstack.requestlog [None req-344184f6-c07b-4c1f-b62f-6b692a612d64 tempest-DeleteServersTestJSON-1329684180 tempest-DeleteServersTestJSON-1329684180-project] 10.222.0.49 "GET /compute/v2.1/servers/0632db38-ebd1-43c1-8ab9-04fbb19edfa7" status: 404 len: 111 microversion: 2.1 time: 0.027439 Dec 14 12:59:01.526950 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: [pid: 116063|app: 0|req: 90/164] 10.222.0.49 () {58 vars in 1235 bytes} [Tue Dec 14 12:59:01 2021] GET /compute/v2.1/servers/0632db38-ebd1-43c1-8ab9-04fbb19edfa7 => generated 111 bytes in 28 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Dec 14 12:59:01.956357 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.virt.hardware [None req-588bd521-6f97-4d1a-844a-48ac3d7ebee7 tempest-AttachVolumeNegativeTest-1000400951 tempest-AttachVolumeNegativeTest-1000400951-project] Flavor limits 0:0:0 {{(pid=116064) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Dec 14 12:59:01.957273 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.virt.hardware [None req-588bd521-6f97-4d1a-844a-48ac3d7ebee7 tempest-AttachVolumeNegativeTest-1000400951 tempest-AttachVolumeNegativeTest-1000400951-project] Image limits 0:0:0 {{(pid=116064) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Dec 14 12:59:01.957927 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.virt.hardware [None req-588bd521-6f97-4d1a-844a-48ac3d7ebee7 tempest-AttachVolumeNegativeTest-1000400951 tempest-AttachVolumeNegativeTest-1000400951-project] Flavor pref 0:0:0 {{(pid=116064) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Dec 14 12:59:01.958511 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.virt.hardware [None req-588bd521-6f97-4d1a-844a-48ac3d7ebee7 tempest-AttachVolumeNegativeTest-1000400951 tempest-AttachVolumeNegativeTest-1000400951-project] Image pref 0:0:0 {{(pid=116064) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Dec 14 12:59:01.959472 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.virt.hardware [None req-588bd521-6f97-4d1a-844a-48ac3d7ebee7 tempest-AttachVolumeNegativeTest-1000400951 tempest-AttachVolumeNegativeTest-1000400951-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=116064) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Dec 14 12:59:01.975582 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-588bd521-6f97-4d1a-844a-48ac3d7ebee7 tempest-AttachVolumeNegativeTest-1000400951 tempest-AttachVolumeNegativeTest-1000400951-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 12:59:01.976997 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-588bd521-6f97-4d1a-844a-48ac3d7ebee7 tempest-AttachVolumeNegativeTest-1000400951 tempest-AttachVolumeNegativeTest-1000400951-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 12:59:01.977922 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-588bd521-6f97-4d1a-844a-48ac3d7ebee7 tempest-AttachVolumeNegativeTest-1000400951 tempest-AttachVolumeNegativeTest-1000400951-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 12:59:01.978352 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-588bd521-6f97-4d1a-844a-48ac3d7ebee7 tempest-AttachVolumeNegativeTest-1000400951 tempest-AttachVolumeNegativeTest-1000400951-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 12:59:01.996348 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.quota [None req-588bd521-6f97-4d1a-844a-48ac3d7ebee7 tempest-AttachVolumeNegativeTest-1000400951 tempest-AttachVolumeNegativeTest-1000400951-project] Getting quotas for project ad27b8951cae4eeeafa257f45217653a. Resources: {'cores', 'instances', 'ram'} {{(pid=116064) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 14 12:59:02.000265 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.quota [None req-588bd521-6f97-4d1a-844a-48ac3d7ebee7 tempest-AttachVolumeNegativeTest-1000400951 tempest-AttachVolumeNegativeTest-1000400951-project] Getting quotas for user 57d0ec01f0784c8ea87d339980bed3cf and project ad27b8951cae4eeeafa257f45217653a. Resources: {'cores', 'instances', 'ram'} {{(pid=116064) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 14 12:59:02.010861 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.compute.api [None req-588bd521-6f97-4d1a-844a-48ac3d7ebee7 tempest-AttachVolumeNegativeTest-1000400951 tempest-AttachVolumeNegativeTest-1000400951-project] Going to run 1 instances... {{(pid=116064) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Dec 14 12:59:02.013373 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.compute.api [None req-588bd521-6f97-4d1a-844a-48ac3d7ebee7 tempest-AttachVolumeNegativeTest-1000400951 tempest-AttachVolumeNegativeTest-1000400951-project] [instance: 6601be22-57ed-4f24-a26d-d909c51113c8] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='1733dcd4-5ded-44e1-8b8d-392adb05c67a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=116064) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Dec 14 12:59:02.059706 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: INFO nova.api.openstack.requestlog [None req-588bd521-6f97-4d1a-844a-48ac3d7ebee7 tempest-AttachVolumeNegativeTest-1000400951 tempest-AttachVolumeNegativeTest-1000400951-project] 10.222.0.49 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.660876 Dec 14 12:59:02.060580 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: [pid: 116064|app: 0|req: 75/165] 10.222.0.49 () {60 vars in 1146 bytes} [Tue Dec 14 12:59:01 2021] POST /compute/v2.1/servers => generated 380 bytes in 662 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Dec 14 12:59:02.070895 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.api.openstack.wsgi [None req-5b5298ca-db02-44d4-99a4-2e2d5da96c1e tempest-AttachVolumeNegativeTest-1000400951 tempest-AttachVolumeNegativeTest-1000400951-project] Calling method '>' {{(pid=116063) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 12:59:02.072263 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.compute.api [None req-5b5298ca-db02-44d4-99a4-2e2d5da96c1e tempest-AttachVolumeNegativeTest-1000400951 tempest-AttachVolumeNegativeTest-1000400951-project] [instance: 6601be22-57ed-4f24-a26d-d909c51113c8] Fetching instance by UUID {{(pid=116063) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 12:59:02.166235 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.policy [None req-5b5298ca-db02-44d4-99a4-2e2d5da96c1e tempest-AttachVolumeNegativeTest-1000400951 tempest-AttachVolumeNegativeTest-1000400951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57d0ec01f0784c8ea87d339980bed3cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad27b8951cae4eeeafa257f45217653a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116063) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 12:59:02.173677 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: INFO nova.api.openstack.requestlog [None req-5b5298ca-db02-44d4-99a4-2e2d5da96c1e tempest-AttachVolumeNegativeTest-1000400951 tempest-AttachVolumeNegativeTest-1000400951-project] 10.222.0.49 "GET /compute/v2.1/servers/6601be22-57ed-4f24-a26d-d909c51113c8" status: 200 len: 1217 microversion: 2.1 time: 0.106910 Dec 14 12:59:02.174554 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: [pid: 116063|app: 0|req: 91/166] 10.222.0.49 () {58 vars in 1235 bytes} [Tue Dec 14 12:59:02 2021] GET /compute/v2.1/servers/6601be22-57ed-4f24-a26d-d909c51113c8 => generated 1217 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 14 12:59:02.207294 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.api.openstack.wsgi [None req-dd330758-d44d-4ff4-8238-1aa68a52afe8 tempest-ServerRescueNegativeTestJSON-1573931620 tempest-ServerRescueNegativeTestJSON-1573931620-project] Calling method '>' {{(pid=116064) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 12:59:02.207977 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.compute.api [None req-dd330758-d44d-4ff4-8238-1aa68a52afe8 tempest-ServerRescueNegativeTestJSON-1573931620 tempest-ServerRescueNegativeTestJSON-1573931620-project] [instance: 60694e1e-d0cb-41c8-adf5-bdda49804385] Fetching instance by UUID {{(pid=116064) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 12:59:02.214573 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-dd330758-d44d-4ff4-8238-1aa68a52afe8 tempest-ServerRescueNegativeTestJSON-1573931620 tempest-ServerRescueNegativeTestJSON-1573931620-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 12:59:02.215096 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-dd330758-d44d-4ff4-8238-1aa68a52afe8 tempest-ServerRescueNegativeTestJSON-1573931620 tempest-ServerRescueNegativeTestJSON-1573931620-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 12:59:02.215914 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-dd330758-d44d-4ff4-8238-1aa68a52afe8 tempest-ServerRescueNegativeTestJSON-1573931620 tempest-ServerRescueNegativeTestJSON-1573931620-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 12:59:02.216341 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-dd330758-d44d-4ff4-8238-1aa68a52afe8 tempest-ServerRescueNegativeTestJSON-1573931620 tempest-ServerRescueNegativeTestJSON-1573931620-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 12:59:02.409791 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.api.openstack.wsgi [None req-a5fdce73-f785-43a2-9e4a-96cf083fac43 tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116063) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 14 12:59:02.411676 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.compute.api [None req-a5fdce73-f785-43a2-9e4a-96cf083fac43 tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] [instance: c8de7730-62f2-4a77-b1e9-cf6a74fa366d] Fetching instance by UUID {{(pid=116063) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 12:59:02.424244 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-a5fdce73-f785-43a2-9e4a-96cf083fac43 tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 12:59:02.424684 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-a5fdce73-f785-43a2-9e4a-96cf083fac43 tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 12:59:02.425493 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-a5fdce73-f785-43a2-9e4a-96cf083fac43 tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 12:59:02.425917 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-a5fdce73-f785-43a2-9e4a-96cf083fac43 tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 12:59:02.565359 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.policy [None req-dd330758-d44d-4ff4-8238-1aa68a52afe8 tempest-ServerRescueNegativeTestJSON-1573931620 tempest-ServerRescueNegativeTestJSON-1573931620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '731cbbfe17214ded8ac66299d66dfc45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '010919ea84eb4eb8b936c63153600eba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116064) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 12:59:02.567510 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: INFO nova.api.openstack.requestlog [None req-a5fdce73-f785-43a2-9e4a-96cf083fac43 tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] 10.222.0.49 "POST /compute/v2.1/servers/c8de7730-62f2-4a77-b1e9-cf6a74fa366d/action" status: 200 len: 14 microversion: 2.20 time: 0.162270 Dec 14 12:59:02.570805 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: [pid: 116063|app: 0|req: 92/167] 10.222.0.49 () {62 vars in 1318 bytes} [Tue Dec 14 12:59:02 2021] POST /compute/v2.1/servers/c8de7730-62f2-4a77-b1e9-cf6a74fa366d/action => generated 14 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 14 12:59:02.576476 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: INFO nova.api.openstack.requestlog [None req-dd330758-d44d-4ff4-8238-1aa68a52afe8 tempest-ServerRescueNegativeTestJSON-1573931620 tempest-ServerRescueNegativeTestJSON-1573931620-project] 10.222.0.49 "GET /compute/v2.1/servers/60694e1e-d0cb-41c8-adf5-bdda49804385" status: 200 len: 1523 microversion: 2.1 time: 0.373235 Dec 14 12:59:02.578349 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: [pid: 116064|app: 0|req: 76/168] 10.222.0.49 () {58 vars in 1235 bytes} [Tue Dec 14 12:59:02 2021] GET /compute/v2.1/servers/60694e1e-d0cb-41c8-adf5-bdda49804385 => generated 1523 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 14 12:59:02.588791 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.api.openstack.wsgi [None req-95036afb-f4ca-4e5b-a4eb-74ad7afc84ee tempest-VolumesActionsTest-648269150 tempest-VolumesActionsTest-648269150-project] Calling method '>' {{(pid=116063) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 12:59:02.602281 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.compute.api [None req-95036afb-f4ca-4e5b-a4eb-74ad7afc84ee tempest-VolumesActionsTest-648269150 tempest-VolumesActionsTest-648269150-project] [instance: ce203e83-7410-4aa5-ade6-6595fc8a6393] Fetching instance by UUID {{(pid=116063) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 12:59:02.622458 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-95036afb-f4ca-4e5b-a4eb-74ad7afc84ee tempest-VolumesActionsTest-648269150 tempest-VolumesActionsTest-648269150-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 12:59:02.622918 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-95036afb-f4ca-4e5b-a4eb-74ad7afc84ee tempest-VolumesActionsTest-648269150 tempest-VolumesActionsTest-648269150-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 12:59:02.631063 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-95036afb-f4ca-4e5b-a4eb-74ad7afc84ee tempest-VolumesActionsTest-648269150 tempest-VolumesActionsTest-648269150-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 12:59:02.633932 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-95036afb-f4ca-4e5b-a4eb-74ad7afc84ee tempest-VolumesActionsTest-648269150 tempest-VolumesActionsTest-648269150-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 12:59:02.808200 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.policy [None req-95036afb-f4ca-4e5b-a4eb-74ad7afc84ee tempest-VolumesActionsTest-648269150 tempest-VolumesActionsTest-648269150-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cc7290157ff4075b95ead815c2b332a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fa190426a6c4b9c9d6d259455a647ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116063) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 12:59:02.825762 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: INFO nova.api.openstack.requestlog [None req-95036afb-f4ca-4e5b-a4eb-74ad7afc84ee tempest-VolumesActionsTest-648269150 tempest-VolumesActionsTest-648269150-project] 10.222.0.49 "GET /compute/v2.1/servers/ce203e83-7410-4aa5-ade6-6595fc8a6393" status: 200 len: 1314 microversion: 2.1 time: 0.254758 Dec 14 12:59:02.826793 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: [pid: 116063|app: 0|req: 93/169] 10.222.0.49 () {58 vars in 1235 bytes} [Tue Dec 14 12:59:02 2021] GET /compute/v2.1/servers/ce203e83-7410-4aa5-ade6-6595fc8a6393 => generated 1314 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 14 12:59:03.191692 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.api.openstack.wsgi [None req-dd8b6807-be9d-49ec-942d-5b682c204951 tempest-AttachVolumeNegativeTest-1000400951 tempest-AttachVolumeNegativeTest-1000400951-project] Calling method '>' {{(pid=116064) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 12:59:03.193584 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.compute.api [None req-dd8b6807-be9d-49ec-942d-5b682c204951 tempest-AttachVolumeNegativeTest-1000400951 tempest-AttachVolumeNegativeTest-1000400951-project] [instance: 6601be22-57ed-4f24-a26d-d909c51113c8] Fetching instance by UUID {{(pid=116064) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 12:59:03.201567 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-dd8b6807-be9d-49ec-942d-5b682c204951 tempest-AttachVolumeNegativeTest-1000400951 tempest-AttachVolumeNegativeTest-1000400951-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 12:59:03.202610 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-dd8b6807-be9d-49ec-942d-5b682c204951 tempest-AttachVolumeNegativeTest-1000400951 tempest-AttachVolumeNegativeTest-1000400951-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 12:59:03.203788 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-dd8b6807-be9d-49ec-942d-5b682c204951 tempest-AttachVolumeNegativeTest-1000400951 tempest-AttachVolumeNegativeTest-1000400951-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 12:59:03.204918 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-dd8b6807-be9d-49ec-942d-5b682c204951 tempest-AttachVolumeNegativeTest-1000400951 tempest-AttachVolumeNegativeTest-1000400951-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 12:59:03.321306 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.policy [None req-dd8b6807-be9d-49ec-942d-5b682c204951 tempest-AttachVolumeNegativeTest-1000400951 tempest-AttachVolumeNegativeTest-1000400951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57d0ec01f0784c8ea87d339980bed3cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad27b8951cae4eeeafa257f45217653a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116064) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 12:59:03.331426 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: INFO nova.api.openstack.requestlog [None req-dd8b6807-be9d-49ec-942d-5b682c204951 tempest-AttachVolumeNegativeTest-1000400951 tempest-AttachVolumeNegativeTest-1000400951-project] 10.222.0.49 "GET /compute/v2.1/servers/6601be22-57ed-4f24-a26d-d909c51113c8" status: 200 len: 1269 microversion: 2.1 time: 0.144607 Dec 14 12:59:03.334320 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: [pid: 116064|app: 0|req: 77/170] 10.222.0.49 () {58 vars in 1235 bytes} [Tue Dec 14 12:59:03 2021] GET /compute/v2.1/servers/6601be22-57ed-4f24-a26d-d909c51113c8 => generated 1269 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 14 12:59:03.581321 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.api.openstack.wsgi [None req-81328fc7-f811-480b-a091-f700d4576813 tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116063) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 14 12:59:03.583065 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.compute.api [None req-81328fc7-f811-480b-a091-f700d4576813 tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] [instance: c8de7730-62f2-4a77-b1e9-cf6a74fa366d] Fetching instance by UUID {{(pid=116063) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 12:59:03.603333 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.api.openstack.wsgi [None req-561dfe39-c5a2-41fc-ab5b-8dfd64996c88 tempest-ServerRescueNegativeTestJSON-1573931620 tempest-ServerRescueNegativeTestJSON-1573931620-project] Calling method '>' {{(pid=116064) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 12:59:03.604245 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.compute.api [None req-561dfe39-c5a2-41fc-ab5b-8dfd64996c88 tempest-ServerRescueNegativeTestJSON-1573931620 tempest-ServerRescueNegativeTestJSON-1573931620-project] [instance: 60694e1e-d0cb-41c8-adf5-bdda49804385] Fetching instance by UUID {{(pid=116064) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 12:59:03.614371 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-81328fc7-f811-480b-a091-f700d4576813 tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 12:59:03.614823 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-81328fc7-f811-480b-a091-f700d4576813 tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 12:59:03.615699 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-81328fc7-f811-480b-a091-f700d4576813 tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 12:59:03.619315 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-561dfe39-c5a2-41fc-ab5b-8dfd64996c88 tempest-ServerRescueNegativeTestJSON-1573931620 tempest-ServerRescueNegativeTestJSON-1573931620-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 12:59:03.619315 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-561dfe39-c5a2-41fc-ab5b-8dfd64996c88 tempest-ServerRescueNegativeTestJSON-1573931620 tempest-ServerRescueNegativeTestJSON-1573931620-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 12:59:03.620026 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-561dfe39-c5a2-41fc-ab5b-8dfd64996c88 tempest-ServerRescueNegativeTestJSON-1573931620 tempest-ServerRescueNegativeTestJSON-1573931620-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 12:59:03.620494 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-561dfe39-c5a2-41fc-ab5b-8dfd64996c88 tempest-ServerRescueNegativeTestJSON-1573931620 tempest-ServerRescueNegativeTestJSON-1573931620-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 12:59:03.623123 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-81328fc7-f811-480b-a091-f700d4576813 tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 12:59:03.767481 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: INFO nova.api.openstack.requestlog [None req-81328fc7-f811-480b-a091-f700d4576813 tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] 10.222.0.49 "POST /compute/v2.1/servers/c8de7730-62f2-4a77-b1e9-cf6a74fa366d/action" status: 200 len: 4447 microversion: 2.20 time: 0.192712 Dec 14 12:59:03.768454 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: [pid: 116063|app: 0|req: 94/171] 10.222.0.49 () {62 vars in 1318 bytes} [Tue Dec 14 12:59:03 2021] POST /compute/v2.1/servers/c8de7730-62f2-4a77-b1e9-cf6a74fa366d/action => generated 4447 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 14 12:59:03.848209 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.policy [None req-561dfe39-c5a2-41fc-ab5b-8dfd64996c88 tempest-ServerRescueNegativeTestJSON-1573931620 tempest-ServerRescueNegativeTestJSON-1573931620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '731cbbfe17214ded8ac66299d66dfc45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '010919ea84eb4eb8b936c63153600eba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116064) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 12:59:03.848410 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.api.openstack.wsgi [None req-988cf633-721c-47e8-9827-848352d8304b tempest-VolumesActionsTest-648269150 tempest-VolumesActionsTest-648269150-project] Calling method '>' {{(pid=116063) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 12:59:03.849343 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.compute.api [None req-988cf633-721c-47e8-9827-848352d8304b tempest-VolumesActionsTest-648269150 tempest-VolumesActionsTest-648269150-project] [instance: ce203e83-7410-4aa5-ade6-6595fc8a6393] Fetching instance by UUID {{(pid=116063) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 12:59:03.861967 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-988cf633-721c-47e8-9827-848352d8304b tempest-VolumesActionsTest-648269150 tempest-VolumesActionsTest-648269150-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 12:59:03.862795 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-988cf633-721c-47e8-9827-848352d8304b tempest-VolumesActionsTest-648269150 tempest-VolumesActionsTest-648269150-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 12:59:03.865723 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-988cf633-721c-47e8-9827-848352d8304b tempest-VolumesActionsTest-648269150 tempest-VolumesActionsTest-648269150-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 12:59:03.867553 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-988cf633-721c-47e8-9827-848352d8304b tempest-VolumesActionsTest-648269150 tempest-VolumesActionsTest-648269150-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 12:59:03.884442 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: INFO nova.api.openstack.requestlog [None req-561dfe39-c5a2-41fc-ab5b-8dfd64996c88 tempest-ServerRescueNegativeTestJSON-1573931620 tempest-ServerRescueNegativeTestJSON-1573931620-project] 10.222.0.49 "GET /compute/v2.1/servers/60694e1e-d0cb-41c8-adf5-bdda49804385" status: 200 len: 1523 microversion: 2.1 time: 0.293021 Dec 14 12:59:03.887996 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: [pid: 116064|app: 0|req: 78/172] 10.222.0.49 () {58 vars in 1235 bytes} [Tue Dec 14 12:59:03 2021] GET /compute/v2.1/servers/60694e1e-d0cb-41c8-adf5-bdda49804385 => generated 1523 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 14 12:59:04.091553 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.policy [None req-988cf633-721c-47e8-9827-848352d8304b tempest-VolumesActionsTest-648269150 tempest-VolumesActionsTest-648269150-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cc7290157ff4075b95ead815c2b332a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fa190426a6c4b9c9d6d259455a647ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116063) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 12:59:04.099211 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: INFO nova.api.openstack.requestlog [None req-988cf633-721c-47e8-9827-848352d8304b tempest-VolumesActionsTest-648269150 tempest-VolumesActionsTest-648269150-project] 10.222.0.49 "GET /compute/v2.1/servers/ce203e83-7410-4aa5-ade6-6595fc8a6393" status: 200 len: 1499 microversion: 2.1 time: 0.256853 Dec 14 12:59:04.099890 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: [pid: 116063|app: 0|req: 95/173] 10.222.0.49 () {58 vars in 1235 bytes} [Tue Dec 14 12:59:03 2021] GET /compute/v2.1/servers/ce203e83-7410-4aa5-ade6-6595fc8a6393 => generated 1499 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 14 12:59:04.350125 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.api.openstack.wsgi [None req-d8135dc2-d3ea-42ad-b5bf-aa2da4d8da25 tempest-AttachVolumeNegativeTest-1000400951 tempest-AttachVolumeNegativeTest-1000400951-project] Calling method '>' {{(pid=116064) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 12:59:04.350728 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.compute.api [None req-d8135dc2-d3ea-42ad-b5bf-aa2da4d8da25 tempest-AttachVolumeNegativeTest-1000400951 tempest-AttachVolumeNegativeTest-1000400951-project] [instance: 6601be22-57ed-4f24-a26d-d909c51113c8] Fetching instance by UUID {{(pid=116064) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 12:59:04.365464 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-d8135dc2-d3ea-42ad-b5bf-aa2da4d8da25 tempest-AttachVolumeNegativeTest-1000400951 tempest-AttachVolumeNegativeTest-1000400951-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 12:59:04.366183 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-d8135dc2-d3ea-42ad-b5bf-aa2da4d8da25 tempest-AttachVolumeNegativeTest-1000400951 tempest-AttachVolumeNegativeTest-1000400951-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 12:59:04.367745 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-d8135dc2-d3ea-42ad-b5bf-aa2da4d8da25 tempest-AttachVolumeNegativeTest-1000400951 tempest-AttachVolumeNegativeTest-1000400951-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 12:59:04.368321 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-d8135dc2-d3ea-42ad-b5bf-aa2da4d8da25 tempest-AttachVolumeNegativeTest-1000400951 tempest-AttachVolumeNegativeTest-1000400951-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 12:59:04.661848 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.policy [None req-d8135dc2-d3ea-42ad-b5bf-aa2da4d8da25 tempest-AttachVolumeNegativeTest-1000400951 tempest-AttachVolumeNegativeTest-1000400951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57d0ec01f0784c8ea87d339980bed3cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad27b8951cae4eeeafa257f45217653a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116064) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 12:59:04.672991 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: INFO nova.api.openstack.requestlog [None req-d8135dc2-d3ea-42ad-b5bf-aa2da4d8da25 tempest-AttachVolumeNegativeTest-1000400951 tempest-AttachVolumeNegativeTest-1000400951-project] 10.222.0.49 "GET /compute/v2.1/servers/6601be22-57ed-4f24-a26d-d909c51113c8" status: 200 len: 1317 microversion: 2.1 time: 0.325775 Dec 14 12:59:04.674220 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: [pid: 116064|app: 0|req: 79/174] 10.222.0.49 () {58 vars in 1235 bytes} [Tue Dec 14 12:59:04 2021] GET /compute/v2.1/servers/6601be22-57ed-4f24-a26d-d909c51113c8 => generated 1317 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 14 12:59:04.780108 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.api.openstack.wsgi [None req-07c6c2dc-5fa0-4a09-9239-41663d888c71 tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116063) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 14 12:59:04.780567 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.compute.api [None req-07c6c2dc-5fa0-4a09-9239-41663d888c71 tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] [instance: c8de7730-62f2-4a77-b1e9-cf6a74fa366d] Fetching instance by UUID {{(pid=116063) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 12:59:04.787318 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.api.openstack.wsgi [None req-008bf078-dddc-4196-983d-e7ed84653071 tempest-VolumesActionsTest-648269150 tempest-VolumesActionsTest-648269150-project] Calling method '>' {{(pid=116064) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 12:59:04.787976 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.compute.api [None req-008bf078-dddc-4196-983d-e7ed84653071 tempest-VolumesActionsTest-648269150 tempest-VolumesActionsTest-648269150-project] [instance: ce203e83-7410-4aa5-ade6-6595fc8a6393] Fetching instance by UUID {{(pid=116064) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 12:59:04.789631 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-07c6c2dc-5fa0-4a09-9239-41663d888c71 tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 12:59:04.791144 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-07c6c2dc-5fa0-4a09-9239-41663d888c71 tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 12:59:04.792414 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-07c6c2dc-5fa0-4a09-9239-41663d888c71 tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 12:59:04.794813 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-07c6c2dc-5fa0-4a09-9239-41663d888c71 tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 12:59:04.801074 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-008bf078-dddc-4196-983d-e7ed84653071 tempest-VolumesActionsTest-648269150 tempest-VolumesActionsTest-648269150-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 12:59:04.802594 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-008bf078-dddc-4196-983d-e7ed84653071 tempest-VolumesActionsTest-648269150 tempest-VolumesActionsTest-648269150-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 12:59:04.805226 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-008bf078-dddc-4196-983d-e7ed84653071 tempest-VolumesActionsTest-648269150 tempest-VolumesActionsTest-648269150-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 12:59:04.805764 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-008bf078-dddc-4196-983d-e7ed84653071 tempest-VolumesActionsTest-648269150 tempest-VolumesActionsTest-648269150-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 12:59:04.843550 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.compute.api [None req-008bf078-dddc-4196-983d-e7ed84653071 tempest-VolumesActionsTest-648269150 tempest-VolumesActionsTest-648269150-project] [instance: ce203e83-7410-4aa5-ade6-6595fc8a6393] Going to try to terminate instance {{(pid=116064) delete /opt/stack/nova/nova/compute/api.py:2614}} Dec 14 12:59:04.927206 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: INFO nova.api.openstack.requestlog [None req-07c6c2dc-5fa0-4a09-9239-41663d888c71 tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] 10.222.0.49 "POST /compute/v2.1/servers/c8de7730-62f2-4a77-b1e9-cf6a74fa366d/action" status: 200 len: 10367 microversion: 2.20 time: 0.152006 Dec 14 12:59:04.928399 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: [pid: 116063|app: 0|req: 96/175] 10.222.0.49 () {62 vars in 1318 bytes} [Tue Dec 14 12:59:04 2021] POST /compute/v2.1/servers/c8de7730-62f2-4a77-b1e9-cf6a74fa366d/action => generated 10367 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 14 12:59:04.935580 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.api.openstack.wsgi [None req-753716be-eb12-4d20-b23d-bed1472056fd tempest-ServerRescueNegativeTestJSON-1573931620 tempest-ServerRescueNegativeTestJSON-1573931620-project] Calling method '>' {{(pid=116063) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 12:59:04.938413 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.compute.api [None req-753716be-eb12-4d20-b23d-bed1472056fd tempest-ServerRescueNegativeTestJSON-1573931620 tempest-ServerRescueNegativeTestJSON-1573931620-project] [instance: 60694e1e-d0cb-41c8-adf5-bdda49804385] Fetching instance by UUID {{(pid=116063) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 12:59:04.960911 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-753716be-eb12-4d20-b23d-bed1472056fd tempest-ServerRescueNegativeTestJSON-1573931620 tempest-ServerRescueNegativeTestJSON-1573931620-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 12:59:04.961367 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-753716be-eb12-4d20-b23d-bed1472056fd tempest-ServerRescueNegativeTestJSON-1573931620 tempest-ServerRescueNegativeTestJSON-1573931620-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 12:59:04.966497 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-753716be-eb12-4d20-b23d-bed1472056fd tempest-ServerRescueNegativeTestJSON-1573931620 tempest-ServerRescueNegativeTestJSON-1573931620-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 12:59:04.966950 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-753716be-eb12-4d20-b23d-bed1472056fd tempest-ServerRescueNegativeTestJSON-1573931620 tempest-ServerRescueNegativeTestJSON-1573931620-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 12:59:05.032979 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: INFO nova.api.openstack.requestlog [None req-008bf078-dddc-4196-983d-e7ed84653071 tempest-VolumesActionsTest-648269150 tempest-VolumesActionsTest-648269150-project] 10.222.0.49 "DELETE /compute/v2.1/servers/ce203e83-7410-4aa5-ade6-6595fc8a6393" status: 204 len: 0 microversion: 2.1 time: 0.249301 Dec 14 12:59:05.034713 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: [pid: 116064|app: 0|req: 80/176] 10.222.0.49 () {58 vars in 1238 bytes} [Tue Dec 14 12:59:04 2021] DELETE /compute/v2.1/servers/ce203e83-7410-4aa5-ade6-6595fc8a6393 => generated 0 bytes in 253 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Dec 14 12:59:05.044973 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.api.openstack.wsgi [None req-0ea456eb-6cbe-40ad-9e1c-064963f60f4e tempest-VolumesActionsTest-648269150 tempest-VolumesActionsTest-648269150-project] Calling method '>' {{(pid=116064) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 12:59:05.046762 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.compute.api [None req-0ea456eb-6cbe-40ad-9e1c-064963f60f4e tempest-VolumesActionsTest-648269150 tempest-VolumesActionsTest-648269150-project] [instance: ce203e83-7410-4aa5-ade6-6595fc8a6393] Fetching instance by UUID {{(pid=116064) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 12:59:05.065486 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-0ea456eb-6cbe-40ad-9e1c-064963f60f4e tempest-VolumesActionsTest-648269150 tempest-VolumesActionsTest-648269150-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 12:59:05.067059 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-0ea456eb-6cbe-40ad-9e1c-064963f60f4e tempest-VolumesActionsTest-648269150 tempest-VolumesActionsTest-648269150-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 12:59:05.068590 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-0ea456eb-6cbe-40ad-9e1c-064963f60f4e tempest-VolumesActionsTest-648269150 tempest-VolumesActionsTest-648269150-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 12:59:05.070231 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-0ea456eb-6cbe-40ad-9e1c-064963f60f4e tempest-VolumesActionsTest-648269150 tempest-VolumesActionsTest-648269150-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 12:59:05.325805 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.policy [None req-753716be-eb12-4d20-b23d-bed1472056fd tempest-ServerRescueNegativeTestJSON-1573931620 tempest-ServerRescueNegativeTestJSON-1573931620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '731cbbfe17214ded8ac66299d66dfc45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '010919ea84eb4eb8b936c63153600eba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116063) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 12:59:05.336098 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: INFO nova.api.openstack.requestlog [None req-753716be-eb12-4d20-b23d-bed1472056fd tempest-ServerRescueNegativeTestJSON-1573931620 tempest-ServerRescueNegativeTestJSON-1573931620-project] 10.222.0.49 "GET /compute/v2.1/servers/60694e1e-d0cb-41c8-adf5-bdda49804385" status: 200 len: 1523 microversion: 2.1 time: 0.405944 Dec 14 12:59:05.340955 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: [pid: 116063|app: 0|req: 97/177] 10.222.0.49 () {58 vars in 1235 bytes} [Tue Dec 14 12:59:04 2021] GET /compute/v2.1/servers/60694e1e-d0cb-41c8-adf5-bdda49804385 => generated 1523 bytes in 412 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 14 12:59:05.373375 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.policy [None req-0ea456eb-6cbe-40ad-9e1c-064963f60f4e tempest-VolumesActionsTest-648269150 tempest-VolumesActionsTest-648269150-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cc7290157ff4075b95ead815c2b332a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fa190426a6c4b9c9d6d259455a647ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116064) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 12:59:05.385066 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: INFO nova.api.openstack.requestlog [None req-0ea456eb-6cbe-40ad-9e1c-064963f60f4e tempest-VolumesActionsTest-648269150 tempest-VolumesActionsTest-648269150-project] 10.222.0.49 "GET /compute/v2.1/servers/ce203e83-7410-4aa5-ade6-6595fc8a6393" status: 200 len: 1505 microversion: 2.1 time: 0.345723 Dec 14 12:59:05.401174 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: [pid: 116064|app: 0|req: 81/178] 10.222.0.49 () {58 vars in 1235 bytes} [Tue Dec 14 12:59:05 2021] GET /compute/v2.1/servers/ce203e83-7410-4aa5-ade6-6595fc8a6393 => generated 1505 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 14 12:59:05.620304 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.api.openstack.wsgi [req-38b6d063-fda9-46a4-a781-803872ee7c79 req-1c7821de-3a43-4df7-8408-b28f0a61398b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6601be22-57ed-4f24-a26d-d909c51113c8", "tag": "e2735b0b-3196-41ad-8a1f-2f0ee1dc4cfe"}]} {{(pid=116063) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 14 12:59:05.622399 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 14 12:59:05.622399 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: warnings.warn(msg) Dec 14 12:59:05.633623 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [req-38b6d063-fda9-46a4-a781-803872ee7c79 req-1c7821de-3a43-4df7-8408-b28f0a61398b service nova] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 12:59:05.634062 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [req-38b6d063-fda9-46a4-a781-803872ee7c79 req-1c7821de-3a43-4df7-8408-b28f0a61398b service nova] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 12:59:05.690499 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.api.openstack.wsgi [None req-25e5aa40-8a1e-42ec-9f8b-36d9364f19cf tempest-AttachVolumeNegativeTest-1000400951 tempest-AttachVolumeNegativeTest-1000400951-project] Calling method '>' {{(pid=116064) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 12:59:05.691116 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.compute.api [None req-25e5aa40-8a1e-42ec-9f8b-36d9364f19cf tempest-AttachVolumeNegativeTest-1000400951 tempest-AttachVolumeNegativeTest-1000400951-project] [instance: 6601be22-57ed-4f24-a26d-d909c51113c8] Fetching instance by UUID {{(pid=116064) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 12:59:05.703337 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-25e5aa40-8a1e-42ec-9f8b-36d9364f19cf tempest-AttachVolumeNegativeTest-1000400951 tempest-AttachVolumeNegativeTest-1000400951-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 12:59:05.705053 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-25e5aa40-8a1e-42ec-9f8b-36d9364f19cf tempest-AttachVolumeNegativeTest-1000400951 tempest-AttachVolumeNegativeTest-1000400951-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 12:59:05.708793 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-25e5aa40-8a1e-42ec-9f8b-36d9364f19cf tempest-AttachVolumeNegativeTest-1000400951 tempest-AttachVolumeNegativeTest-1000400951-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 12:59:05.711034 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-25e5aa40-8a1e-42ec-9f8b-36d9364f19cf tempest-AttachVolumeNegativeTest-1000400951 tempest-AttachVolumeNegativeTest-1000400951-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 12:59:05.826462 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: INFO nova.api.openstack.compute.server_external_events [req-38b6d063-fda9-46a4-a781-803872ee7c79 req-1c7821de-3a43-4df7-8408-b28f0a61398b service nova] Creating event network-changed:e2735b0b-3196-41ad-8a1f-2f0ee1dc4cfe for instance 6601be22-57ed-4f24-a26d-d909c51113c8 on hv-cinder-78447 Dec 14 12:59:05.839738 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: INFO nova.api.openstack.requestlog [req-38b6d063-fda9-46a4-a781-803872ee7c79 req-1c7821de-3a43-4df7-8408-b28f0a61398b service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.237177 Dec 14 12:59:05.840707 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: [pid: 116063|app: 0|req: 98/179] 10.222.0.49 () {64 vars in 1317 bytes} [Tue Dec 14 12:59:05 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 14 12:59:05.909315 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.policy [None req-25e5aa40-8a1e-42ec-9f8b-36d9364f19cf tempest-AttachVolumeNegativeTest-1000400951 tempest-AttachVolumeNegativeTest-1000400951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57d0ec01f0784c8ea87d339980bed3cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad27b8951cae4eeeafa257f45217653a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116064) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 12:59:05.919263 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: INFO nova.api.openstack.requestlog [None req-25e5aa40-8a1e-42ec-9f8b-36d9364f19cf tempest-AttachVolumeNegativeTest-1000400951 tempest-AttachVolumeNegativeTest-1000400951-project] 10.222.0.49 "GET /compute/v2.1/servers/6601be22-57ed-4f24-a26d-d909c51113c8" status: 200 len: 1317 microversion: 2.1 time: 0.233301 Dec 14 12:59:05.920960 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: [pid: 116064|app: 0|req: 82/180] 10.222.0.49 () {58 vars in 1235 bytes} [Tue Dec 14 12:59:05 2021] GET /compute/v2.1/servers/6601be22-57ed-4f24-a26d-d909c51113c8 => generated 1317 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 14 12:59:05.942714 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.api.openstack.wsgi [None req-0510eb9c-0f42-457a-8780-0fe56944be41 tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116063) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 14 12:59:05.945361 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.compute.api [None req-0510eb9c-0f42-457a-8780-0fe56944be41 tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] [instance: c8de7730-62f2-4a77-b1e9-cf6a74fa366d] Fetching instance by UUID {{(pid=116063) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 12:59:05.954005 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-0510eb9c-0f42-457a-8780-0fe56944be41 tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 12:59:05.954874 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-0510eb9c-0f42-457a-8780-0fe56944be41 tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 12:59:05.955815 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-0510eb9c-0f42-457a-8780-0fe56944be41 tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 12:59:05.956405 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-0510eb9c-0f42-457a-8780-0fe56944be41 tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 12:59:06.050536 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: INFO nova.api.openstack.requestlog [None req-0510eb9c-0f42-457a-8780-0fe56944be41 tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] 10.222.0.49 "POST /compute/v2.1/servers/c8de7730-62f2-4a77-b1e9-cf6a74fa366d/action" status: 200 len: 15025 microversion: 2.20 time: 0.114703 Dec 14 12:59:06.055186 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: [pid: 116063|app: 0|req: 99/181] 10.222.0.49 () {62 vars in 1318 bytes} [Tue Dec 14 12:59:05 2021] POST /compute/v2.1/servers/c8de7730-62f2-4a77-b1e9-cf6a74fa366d/action => generated 15025 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 14 12:59:06.355501 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.api.openstack.wsgi [None req-98ce30b0-2f24-4b82-ad47-e6cc690e2c21 tempest-ServerRescueNegativeTestJSON-1573931620 tempest-ServerRescueNegativeTestJSON-1573931620-project] Calling method '>' {{(pid=116064) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 12:59:06.356342 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.compute.api [None req-98ce30b0-2f24-4b82-ad47-e6cc690e2c21 tempest-ServerRescueNegativeTestJSON-1573931620 tempest-ServerRescueNegativeTestJSON-1573931620-project] [instance: 60694e1e-d0cb-41c8-adf5-bdda49804385] Fetching instance by UUID {{(pid=116064) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 12:59:06.364580 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-98ce30b0-2f24-4b82-ad47-e6cc690e2c21 tempest-ServerRescueNegativeTestJSON-1573931620 tempest-ServerRescueNegativeTestJSON-1573931620-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 12:59:06.365105 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-98ce30b0-2f24-4b82-ad47-e6cc690e2c21 tempest-ServerRescueNegativeTestJSON-1573931620 tempest-ServerRescueNegativeTestJSON-1573931620-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 12:59:06.366335 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-98ce30b0-2f24-4b82-ad47-e6cc690e2c21 tempest-ServerRescueNegativeTestJSON-1573931620 tempest-ServerRescueNegativeTestJSON-1573931620-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 12:59:06.367429 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-98ce30b0-2f24-4b82-ad47-e6cc690e2c21 tempest-ServerRescueNegativeTestJSON-1573931620 tempest-ServerRescueNegativeTestJSON-1573931620-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 12:59:06.382095 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.api.openstack.wsgi [None req-9a1fbaf0-c4c1-45de-a949-7ae51ed73b76 tempest-VolumesTestJSON-1145439577 tempest-VolumesTestJSON-1145439577-project] Calling method '.version_select at 0x7f2acdca9b80>' {{(pid=116063) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 12:59:06.463553 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: INFO nova.api.openstack.requestlog [None req-9a1fbaf0-c4c1-45de-a949-7ae51ed73b76 tempest-VolumesTestJSON-1145439577 tempest-VolumesTestJSON-1145439577-project] 10.222.0.49 "GET /compute/v2.1/os-volumes/4a8af99e-4a62-48ba-a78c-def0e2f63d1a" status: 200 len: 349 microversion: 2.1 time: 0.085671 Dec 14 12:59:06.464125 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: [pid: 116063|app: 0|req: 100/182] 10.222.0.49 () {58 vars in 1244 bytes} [Tue Dec 14 12:59:06 2021] GET /compute/v2.1/os-volumes/4a8af99e-4a62-48ba-a78c-def0e2f63d1a => generated 349 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Dec 14 12:59:06.475631 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.api.openstack.wsgi [None req-1ca7dbea-e79d-439e-afff-d7bd8d68f237 tempest-VolumesActionsTest-648269150 tempest-VolumesActionsTest-648269150-project] Calling method '>' {{(pid=116063) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 12:59:06.476473 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.compute.api [None req-1ca7dbea-e79d-439e-afff-d7bd8d68f237 tempest-VolumesActionsTest-648269150 tempest-VolumesActionsTest-648269150-project] [instance: ce203e83-7410-4aa5-ade6-6595fc8a6393] Fetching instance by UUID {{(pid=116063) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 12:59:06.494625 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-1ca7dbea-e79d-439e-afff-d7bd8d68f237 tempest-VolumesActionsTest-648269150 tempest-VolumesActionsTest-648269150-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 12:59:06.495074 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-1ca7dbea-e79d-439e-afff-d7bd8d68f237 tempest-VolumesActionsTest-648269150 tempest-VolumesActionsTest-648269150-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 12:59:06.495903 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-1ca7dbea-e79d-439e-afff-d7bd8d68f237 tempest-VolumesActionsTest-648269150 tempest-VolumesActionsTest-648269150-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 12:59:06.496329 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-1ca7dbea-e79d-439e-afff-d7bd8d68f237 tempest-VolumesActionsTest-648269150 tempest-VolumesActionsTest-648269150-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 12:59:06.570691 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.policy [None req-98ce30b0-2f24-4b82-ad47-e6cc690e2c21 tempest-ServerRescueNegativeTestJSON-1573931620 tempest-ServerRescueNegativeTestJSON-1573931620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '731cbbfe17214ded8ac66299d66dfc45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '010919ea84eb4eb8b936c63153600eba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116064) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 12:59:06.596323 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: INFO nova.api.openstack.requestlog [None req-98ce30b0-2f24-4b82-ad47-e6cc690e2c21 tempest-ServerRescueNegativeTestJSON-1573931620 tempest-ServerRescueNegativeTestJSON-1573931620-project] 10.222.0.49 "GET /compute/v2.1/servers/60694e1e-d0cb-41c8-adf5-bdda49804385" status: 200 len: 1523 microversion: 2.1 time: 0.246100 Dec 14 12:59:06.598405 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: [pid: 116064|app: 0|req: 83/183] 10.222.0.49 () {58 vars in 1235 bytes} [Tue Dec 14 12:59:06 2021] GET /compute/v2.1/servers/60694e1e-d0cb-41c8-adf5-bdda49804385 => generated 1523 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 14 12:59:06.749337 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.policy [None req-1ca7dbea-e79d-439e-afff-d7bd8d68f237 tempest-VolumesActionsTest-648269150 tempest-VolumesActionsTest-648269150-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cc7290157ff4075b95ead815c2b332a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fa190426a6c4b9c9d6d259455a647ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116063) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 12:59:06.765461 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: INFO nova.api.openstack.requestlog [None req-1ca7dbea-e79d-439e-afff-d7bd8d68f237 tempest-VolumesActionsTest-648269150 tempest-VolumesActionsTest-648269150-project] 10.222.0.49 "GET /compute/v2.1/servers/ce203e83-7410-4aa5-ade6-6595fc8a6393" status: 200 len: 1505 microversion: 2.1 time: 0.300186 Dec 14 12:59:06.772214 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: [pid: 116063|app: 0|req: 101/184] 10.222.0.49 () {58 vars in 1235 bytes} [Tue Dec 14 12:59:06 2021] GET /compute/v2.1/servers/ce203e83-7410-4aa5-ade6-6595fc8a6393 => generated 1505 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 14 12:59:06.936663 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.api.openstack.wsgi [None req-c07252cd-5b50-4b61-a44d-22dd77f0a5ab tempest-AttachVolumeNegativeTest-1000400951 tempest-AttachVolumeNegativeTest-1000400951-project] Calling method '>' {{(pid=116064) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 12:59:06.937676 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.compute.api [None req-c07252cd-5b50-4b61-a44d-22dd77f0a5ab tempest-AttachVolumeNegativeTest-1000400951 tempest-AttachVolumeNegativeTest-1000400951-project] [instance: 6601be22-57ed-4f24-a26d-d909c51113c8] Fetching instance by UUID {{(pid=116064) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 12:59:06.944175 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-c07252cd-5b50-4b61-a44d-22dd77f0a5ab tempest-AttachVolumeNegativeTest-1000400951 tempest-AttachVolumeNegativeTest-1000400951-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 12:59:06.945056 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-c07252cd-5b50-4b61-a44d-22dd77f0a5ab tempest-AttachVolumeNegativeTest-1000400951 tempest-AttachVolumeNegativeTest-1000400951-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 12:59:06.946064 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-c07252cd-5b50-4b61-a44d-22dd77f0a5ab tempest-AttachVolumeNegativeTest-1000400951 tempest-AttachVolumeNegativeTest-1000400951-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 12:59:06.946735 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-c07252cd-5b50-4b61-a44d-22dd77f0a5ab tempest-AttachVolumeNegativeTest-1000400951 tempest-AttachVolumeNegativeTest-1000400951-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 12:59:07.063309 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.api.openstack.wsgi [None req-d8c62c17-dfc9-4bf3-a78f-db1718000547 tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116063) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 14 12:59:07.064449 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.compute.api [None req-d8c62c17-dfc9-4bf3-a78f-db1718000547 tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] [instance: c8de7730-62f2-4a77-b1e9-cf6a74fa366d] Fetching instance by UUID {{(pid=116063) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 12:59:07.076770 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-d8c62c17-dfc9-4bf3-a78f-db1718000547 tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 12:59:07.079031 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-d8c62c17-dfc9-4bf3-a78f-db1718000547 tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 12:59:07.080009 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-d8c62c17-dfc9-4bf3-a78f-db1718000547 tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 12:59:07.083415 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-d8c62c17-dfc9-4bf3-a78f-db1718000547 tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 12:59:07.180353 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.policy [None req-c07252cd-5b50-4b61-a44d-22dd77f0a5ab tempest-AttachVolumeNegativeTest-1000400951 tempest-AttachVolumeNegativeTest-1000400951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57d0ec01f0784c8ea87d339980bed3cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad27b8951cae4eeeafa257f45217653a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116064) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 12:59:07.190443 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: INFO nova.api.openstack.requestlog [None req-c07252cd-5b50-4b61-a44d-22dd77f0a5ab tempest-AttachVolumeNegativeTest-1000400951 tempest-AttachVolumeNegativeTest-1000400951-project] 10.222.0.49 "GET /compute/v2.1/servers/6601be22-57ed-4f24-a26d-d909c51113c8" status: 200 len: 1317 microversion: 2.1 time: 0.257274 Dec 14 12:59:07.191983 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: [pid: 116064|app: 0|req: 84/185] 10.222.0.49 () {58 vars in 1235 bytes} [Tue Dec 14 12:59:06 2021] GET /compute/v2.1/servers/6601be22-57ed-4f24-a26d-d909c51113c8 => generated 1317 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 14 12:59:07.205030 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: INFO nova.api.openstack.requestlog [None req-d8c62c17-dfc9-4bf3-a78f-db1718000547 tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] 10.222.0.49 "POST /compute/v2.1/servers/c8de7730-62f2-4a77-b1e9-cf6a74fa366d/action" status: 200 len: 17354 microversion: 2.20 time: 0.145904 Dec 14 12:59:07.205946 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: [pid: 116063|app: 0|req: 102/186] 10.222.0.49 () {62 vars in 1318 bytes} [Tue Dec 14 12:59:07 2021] POST /compute/v2.1/servers/c8de7730-62f2-4a77-b1e9-cf6a74fa366d/action => generated 17354 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 14 12:59:07.614390 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.api.openstack.wsgi [None req-7e6ad9b6-4a04-4bc8-b982-d46144bbd4cd tempest-ServerRescueNegativeTestJSON-1573931620 tempest-ServerRescueNegativeTestJSON-1573931620-project] Calling method '>' {{(pid=116064) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 12:59:07.615028 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.compute.api [None req-7e6ad9b6-4a04-4bc8-b982-d46144bbd4cd tempest-ServerRescueNegativeTestJSON-1573931620 tempest-ServerRescueNegativeTestJSON-1573931620-project] [instance: 60694e1e-d0cb-41c8-adf5-bdda49804385] Fetching instance by UUID {{(pid=116064) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 12:59:07.620787 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-7e6ad9b6-4a04-4bc8-b982-d46144bbd4cd tempest-ServerRescueNegativeTestJSON-1573931620 tempest-ServerRescueNegativeTestJSON-1573931620-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 12:59:07.621451 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-7e6ad9b6-4a04-4bc8-b982-d46144bbd4cd tempest-ServerRescueNegativeTestJSON-1573931620 tempest-ServerRescueNegativeTestJSON-1573931620-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 12:59:07.622362 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-7e6ad9b6-4a04-4bc8-b982-d46144bbd4cd tempest-ServerRescueNegativeTestJSON-1573931620 tempest-ServerRescueNegativeTestJSON-1573931620-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 12:59:07.623072 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-7e6ad9b6-4a04-4bc8-b982-d46144bbd4cd tempest-ServerRescueNegativeTestJSON-1573931620 tempest-ServerRescueNegativeTestJSON-1573931620-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 12:59:07.785184 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.api.openstack.wsgi [None req-56a1a1c0-776f-4e7e-8c0a-54e14579285c tempest-VolumesActionsTest-648269150 tempest-VolumesActionsTest-648269150-project] Calling method '>' {{(pid=116063) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 12:59:07.786320 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.compute.api [None req-56a1a1c0-776f-4e7e-8c0a-54e14579285c tempest-VolumesActionsTest-648269150 tempest-VolumesActionsTest-648269150-project] [instance: ce203e83-7410-4aa5-ade6-6595fc8a6393] Fetching instance by UUID {{(pid=116063) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 12:59:07.794133 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-56a1a1c0-776f-4e7e-8c0a-54e14579285c tempest-VolumesActionsTest-648269150 tempest-VolumesActionsTest-648269150-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 12:59:07.794945 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-56a1a1c0-776f-4e7e-8c0a-54e14579285c tempest-VolumesActionsTest-648269150 tempest-VolumesActionsTest-648269150-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 12:59:07.795749 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-56a1a1c0-776f-4e7e-8c0a-54e14579285c tempest-VolumesActionsTest-648269150 tempest-VolumesActionsTest-648269150-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 12:59:07.796350 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-56a1a1c0-776f-4e7e-8c0a-54e14579285c tempest-VolumesActionsTest-648269150 tempest-VolumesActionsTest-648269150-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 12:59:07.890471 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.policy [None req-7e6ad9b6-4a04-4bc8-b982-d46144bbd4cd tempest-ServerRescueNegativeTestJSON-1573931620 tempest-ServerRescueNegativeTestJSON-1573931620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '731cbbfe17214ded8ac66299d66dfc45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '010919ea84eb4eb8b936c63153600eba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116064) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 12:59:07.907222 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: INFO nova.api.openstack.requestlog [None req-7e6ad9b6-4a04-4bc8-b982-d46144bbd4cd tempest-ServerRescueNegativeTestJSON-1573931620 tempest-ServerRescueNegativeTestJSON-1573931620-project] 10.222.0.49 "GET /compute/v2.1/servers/60694e1e-d0cb-41c8-adf5-bdda49804385" status: 200 len: 1523 microversion: 2.1 time: 0.294414 Dec 14 12:59:07.910484 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.policy [None req-56a1a1c0-776f-4e7e-8c0a-54e14579285c tempest-VolumesActionsTest-648269150 tempest-VolumesActionsTest-648269150-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cc7290157ff4075b95ead815c2b332a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fa190426a6c4b9c9d6d259455a647ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116063) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 12:59:07.914376 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: [pid: 116064|app: 0|req: 85/187] 10.222.0.49 () {58 vars in 1235 bytes} [Tue Dec 14 12:59:07 2021] GET /compute/v2.1/servers/60694e1e-d0cb-41c8-adf5-bdda49804385 => generated 1523 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 14 12:59:07.919467 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.api.openstack.wsgi [req-71903e7d-b727-46a2-aaa7-9d47d2ce6e3a req-d7e8811f-1b0b-473e-b661-303380443788 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ce203e83-7410-4aa5-ade6-6595fc8a6393", "name": "network-vif-deleted", "tag": "2f7ee134-4a53-4bf3-b113-860ae25ab31f"}]} {{(pid=116064) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 14 12:59:07.921248 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 14 12:59:07.921248 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: warnings.warn(msg) Dec 14 12:59:07.927912 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: INFO nova.api.openstack.requestlog [None req-56a1a1c0-776f-4e7e-8c0a-54e14579285c tempest-VolumesActionsTest-648269150 tempest-VolumesActionsTest-648269150-project] 10.222.0.49 "GET /compute/v2.1/servers/ce203e83-7410-4aa5-ade6-6595fc8a6393" status: 200 len: 1463 microversion: 2.1 time: 0.147290 Dec 14 12:59:07.937835 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: [pid: 116063|app: 0|req: 103/188] 10.222.0.49 () {58 vars in 1235 bytes} [Tue Dec 14 12:59:07 2021] GET /compute/v2.1/servers/ce203e83-7410-4aa5-ade6-6595fc8a6393 => generated 1463 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 14 12:59:07.938004 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [req-71903e7d-b727-46a2-aaa7-9d47d2ce6e3a req-d7e8811f-1b0b-473e-b661-303380443788 service nova] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 12:59:07.938004 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [req-71903e7d-b727-46a2-aaa7-9d47d2ce6e3a req-d7e8811f-1b0b-473e-b661-303380443788 service nova] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 12:59:07.938236 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.api.openstack.wsgi [None req-ec3d059e-722b-438f-8647-df9d5369688c tempest-VolumesTestJSON-1145439577 tempest-VolumesTestJSON-1145439577-project] Calling method '.version_select at 0x7f2acdc88700>' {{(pid=116063) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 12:59:07.940211 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: INFO nova.api.openstack.compute.server_external_events [req-71903e7d-b727-46a2-aaa7-9d47d2ce6e3a req-d7e8811f-1b0b-473e-b661-303380443788 service nova] Creating event network-vif-deleted:2f7ee134-4a53-4bf3-b113-860ae25ab31f for instance ce203e83-7410-4aa5-ade6-6595fc8a6393 on hv-cinder-78447 Dec 14 12:59:07.948509 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: INFO nova.api.openstack.requestlog [req-71903e7d-b727-46a2-aaa7-9d47d2ce6e3a req-d7e8811f-1b0b-473e-b661-303380443788 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032459 Dec 14 12:59:07.949320 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: [pid: 116064|app: 0|req: 86/189] 10.222.0.49 () {64 vars in 1317 bytes} [Tue Dec 14 12:59:07 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 14 12:59:08.002724 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: INFO nova.api.openstack.requestlog [None req-ec3d059e-722b-438f-8647-df9d5369688c tempest-VolumesTestJSON-1145439577 tempest-VolumesTestJSON-1145439577-project] 10.222.0.49 "GET /compute/v2.1/os-volumes/5128236e-746b-48fa-a51b-9c4788652f98" status: 200 len: 351 microversion: 2.1 time: 0.073148 Dec 14 12:59:08.003434 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: [pid: 116063|app: 0|req: 104/190] 10.222.0.49 () {58 vars in 1244 bytes} [Tue Dec 14 12:59:07 2021] GET /compute/v2.1/os-volumes/5128236e-746b-48fa-a51b-9c4788652f98 => generated 351 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 14 12:59:08.208749 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.api.openstack.wsgi [None req-2ae504ac-7e20-4b65-a08c-3afc50089fef tempest-AttachVolumeNegativeTest-1000400951 tempest-AttachVolumeNegativeTest-1000400951-project] Calling method '>' {{(pid=116064) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 12:59:08.211429 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.compute.api [None req-2ae504ac-7e20-4b65-a08c-3afc50089fef tempest-AttachVolumeNegativeTest-1000400951 tempest-AttachVolumeNegativeTest-1000400951-project] [instance: 6601be22-57ed-4f24-a26d-d909c51113c8] Fetching instance by UUID {{(pid=116064) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 12:59:08.217955 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.api.openstack.wsgi [None req-7a0bc6fc-fe23-4437-bd68-75dfd5685368 tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116063) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 14 12:59:08.218448 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-2ae504ac-7e20-4b65-a08c-3afc50089fef tempest-AttachVolumeNegativeTest-1000400951 tempest-AttachVolumeNegativeTest-1000400951-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 12:59:08.218612 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-2ae504ac-7e20-4b65-a08c-3afc50089fef tempest-AttachVolumeNegativeTest-1000400951 tempest-AttachVolumeNegativeTest-1000400951-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 12:59:08.218929 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.compute.api [None req-7a0bc6fc-fe23-4437-bd68-75dfd5685368 tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] [instance: c8de7730-62f2-4a77-b1e9-cf6a74fa366d] Fetching instance by UUID {{(pid=116063) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 12:59:08.219451 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-2ae504ac-7e20-4b65-a08c-3afc50089fef tempest-AttachVolumeNegativeTest-1000400951 tempest-AttachVolumeNegativeTest-1000400951-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 12:59:08.219894 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-2ae504ac-7e20-4b65-a08c-3afc50089fef tempest-AttachVolumeNegativeTest-1000400951 tempest-AttachVolumeNegativeTest-1000400951-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 12:59:08.233567 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-7a0bc6fc-fe23-4437-bd68-75dfd5685368 tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 12:59:08.234400 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-7a0bc6fc-fe23-4437-bd68-75dfd5685368 tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 12:59:08.237000 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-7a0bc6fc-fe23-4437-bd68-75dfd5685368 tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 12:59:08.238503 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-7a0bc6fc-fe23-4437-bd68-75dfd5685368 tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 12:59:08.364087 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: INFO nova.api.openstack.requestlog [None req-7a0bc6fc-fe23-4437-bd68-75dfd5685368 tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] 10.222.0.49 "POST /compute/v2.1/servers/c8de7730-62f2-4a77-b1e9-cf6a74fa366d/action" status: 200 len: 17960 microversion: 2.20 time: 0.151237 Dec 14 12:59:08.364748 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: [pid: 116063|app: 0|req: 105/191] 10.222.0.49 () {62 vars in 1318 bytes} [Tue Dec 14 12:59:08 2021] POST /compute/v2.1/servers/c8de7730-62f2-4a77-b1e9-cf6a74fa366d/action => generated 17960 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Dec 14 12:59:08.423163 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.policy [None req-2ae504ac-7e20-4b65-a08c-3afc50089fef tempest-AttachVolumeNegativeTest-1000400951 tempest-AttachVolumeNegativeTest-1000400951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57d0ec01f0784c8ea87d339980bed3cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad27b8951cae4eeeafa257f45217653a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116064) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 12:59:08.431956 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: INFO nova.api.openstack.requestlog [None req-2ae504ac-7e20-4b65-a08c-3afc50089fef tempest-AttachVolumeNegativeTest-1000400951 tempest-AttachVolumeNegativeTest-1000400951-project] 10.222.0.49 "GET /compute/v2.1/servers/6601be22-57ed-4f24-a26d-d909c51113c8" status: 200 len: 1317 microversion: 2.1 time: 0.227567 Dec 14 12:59:08.436999 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: [pid: 116064|app: 0|req: 87/192] 10.222.0.49 () {58 vars in 1235 bytes} [Tue Dec 14 12:59:08 2021] GET /compute/v2.1/servers/6601be22-57ed-4f24-a26d-d909c51113c8 => generated 1317 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 14 12:59:08.931315 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.api.openstack.wsgi [None req-e567ec99-1a49-4733-b1f5-f2ab8f0b5abe tempest-ServerRescueNegativeTestJSON-1573931620 tempest-ServerRescueNegativeTestJSON-1573931620-project] Calling method '>' {{(pid=116063) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 12:59:08.932019 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.compute.api [None req-e567ec99-1a49-4733-b1f5-f2ab8f0b5abe tempest-ServerRescueNegativeTestJSON-1573931620 tempest-ServerRescueNegativeTestJSON-1573931620-project] [instance: 60694e1e-d0cb-41c8-adf5-bdda49804385] Fetching instance by UUID {{(pid=116063) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 12:59:08.939211 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-e567ec99-1a49-4733-b1f5-f2ab8f0b5abe tempest-ServerRescueNegativeTestJSON-1573931620 tempest-ServerRescueNegativeTestJSON-1573931620-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 12:59:08.940301 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-e567ec99-1a49-4733-b1f5-f2ab8f0b5abe tempest-ServerRescueNegativeTestJSON-1573931620 tempest-ServerRescueNegativeTestJSON-1573931620-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 12:59:08.941322 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-e567ec99-1a49-4733-b1f5-f2ab8f0b5abe tempest-ServerRescueNegativeTestJSON-1573931620 tempest-ServerRescueNegativeTestJSON-1573931620-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 12:59:08.941907 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-e567ec99-1a49-4733-b1f5-f2ab8f0b5abe tempest-ServerRescueNegativeTestJSON-1573931620 tempest-ServerRescueNegativeTestJSON-1573931620-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 12:59:08.950555 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.api.openstack.wsgi [None req-1091ef4b-e053-466f-abe2-8a104e969844 tempest-VolumesActionsTest-648269150 tempest-VolumesActionsTest-648269150-project] Calling method '>' {{(pid=116064) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 12:59:08.951089 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.compute.api [None req-1091ef4b-e053-466f-abe2-8a104e969844 tempest-VolumesActionsTest-648269150 tempest-VolumesActionsTest-648269150-project] [instance: ce203e83-7410-4aa5-ade6-6595fc8a6393] Fetching instance by UUID {{(pid=116064) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 12:59:08.957580 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-1091ef4b-e053-466f-abe2-8a104e969844 tempest-VolumesActionsTest-648269150 tempest-VolumesActionsTest-648269150-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 12:59:08.959439 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-1091ef4b-e053-466f-abe2-8a104e969844 tempest-VolumesActionsTest-648269150 tempest-VolumesActionsTest-648269150-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 12:59:08.960456 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-1091ef4b-e053-466f-abe2-8a104e969844 tempest-VolumesActionsTest-648269150 tempest-VolumesActionsTest-648269150-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 12:59:08.961022 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-1091ef4b-e053-466f-abe2-8a104e969844 tempest-VolumesActionsTest-648269150 tempest-VolumesActionsTest-648269150-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 12:59:08.976203 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: INFO nova.api.openstack.wsgi [None req-1091ef4b-e053-466f-abe2-8a104e969844 tempest-VolumesActionsTest-648269150 tempest-VolumesActionsTest-648269150-project] HTTP exception thrown: Instance ce203e83-7410-4aa5-ade6-6595fc8a6393 could not be found. Dec 14 12:59:08.977393 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.api.openstack.wsgi [None req-1091ef4b-e053-466f-abe2-8a104e969844 tempest-VolumesActionsTest-648269150 tempest-VolumesActionsTest-648269150-project] Returning 404 to user: Instance ce203e83-7410-4aa5-ade6-6595fc8a6393 could not be found. {{(pid=116064) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 14 12:59:08.978681 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: INFO nova.api.openstack.requestlog [None req-1091ef4b-e053-466f-abe2-8a104e969844 tempest-VolumesActionsTest-648269150 tempest-VolumesActionsTest-648269150-project] 10.222.0.49 "GET /compute/v2.1/servers/ce203e83-7410-4aa5-ade6-6595fc8a6393" status: 404 len: 111 microversion: 2.1 time: 0.036441 Dec 14 12:59:08.979943 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: [pid: 116064|app: 0|req: 88/193] 10.222.0.49 () {58 vars in 1235 bytes} [Tue Dec 14 12:59:08 2021] GET /compute/v2.1/servers/ce203e83-7410-4aa5-ade6-6595fc8a6393 => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Dec 14 12:59:09.090683 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.policy [None req-e567ec99-1a49-4733-b1f5-f2ab8f0b5abe tempest-ServerRescueNegativeTestJSON-1573931620 tempest-ServerRescueNegativeTestJSON-1573931620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '731cbbfe17214ded8ac66299d66dfc45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '010919ea84eb4eb8b936c63153600eba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116063) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 12:59:09.098014 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: INFO nova.api.openstack.requestlog [None req-e567ec99-1a49-4733-b1f5-f2ab8f0b5abe tempest-ServerRescueNegativeTestJSON-1573931620 tempest-ServerRescueNegativeTestJSON-1573931620-project] 10.222.0.49 "GET /compute/v2.1/servers/60694e1e-d0cb-41c8-adf5-bdda49804385" status: 200 len: 1523 microversion: 2.1 time: 0.170672 Dec 14 12:59:09.107758 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: [pid: 116063|app: 0|req: 106/194] 10.222.0.49 () {58 vars in 1235 bytes} [Tue Dec 14 12:59:08 2021] GET /compute/v2.1/servers/60694e1e-d0cb-41c8-adf5-bdda49804385 => generated 1523 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 14 12:59:09.135331 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.api.openstack.wsgi [None req-2dbbcdb7-9351-4f4b-a745-06e4a19f1e2a tempest-VolumesActionsTest-648269150 tempest-VolumesActionsTest-648269150-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-837633995", "imageRef": "1733dcd4-5ded-44e1-8b8d-392adb05c67a", "flavorRef": "452", "networks": [{"uuid": "f9b2329a-0b17-4b80-8a98-25a960af76f5"}]}} {{(pid=116064) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 14 12:59:09.213665 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.network.neutron [None req-2dbbcdb7-9351-4f4b-a745-06e4a19f1e2a tempest-VolumesActionsTest-648269150 tempest-VolumesActionsTest-648269150-project] validate_networks() for [('f9b2329a-0b17-4b80-8a98-25a960af76f5', None, None, None, None, None)] {{(pid=116064) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Dec 14 12:59:09.374677 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.api.openstack.wsgi [None req-8e5550cf-db20-4782-8555-3580085430c7 tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116063) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 14 12:59:09.376212 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.compute.api [None req-8e5550cf-db20-4782-8555-3580085430c7 tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] [instance: c8de7730-62f2-4a77-b1e9-cf6a74fa366d] Fetching instance by UUID {{(pid=116063) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 12:59:09.382673 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-8e5550cf-db20-4782-8555-3580085430c7 tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 12:59:09.383287 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-8e5550cf-db20-4782-8555-3580085430c7 tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 12:59:09.384232 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-8e5550cf-db20-4782-8555-3580085430c7 tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 12:59:09.384799 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-8e5550cf-db20-4782-8555-3580085430c7 tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 12:59:09.495313 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: INFO nova.api.openstack.requestlog [None req-8e5550cf-db20-4782-8555-3580085430c7 tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] 10.222.0.49 "POST /compute/v2.1/servers/c8de7730-62f2-4a77-b1e9-cf6a74fa366d/action" status: 200 len: 20148 microversion: 2.20 time: 0.124056 Dec 14 12:59:09.499356 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: [pid: 116063|app: 0|req: 107/195] 10.222.0.49 () {62 vars in 1318 bytes} [Tue Dec 14 12:59:09 2021] POST /compute/v2.1/servers/c8de7730-62f2-4a77-b1e9-cf6a74fa366d/action => generated 20148 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 14 12:59:09.501184 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.api.openstack.wsgi [None req-5df41f07-052e-4b71-b49d-8976f8796b4a tempest-AttachVolumeNegativeTest-1000400951 tempest-AttachVolumeNegativeTest-1000400951-project] Calling method '>' {{(pid=116063) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 12:59:09.501961 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.compute.api [None req-5df41f07-052e-4b71-b49d-8976f8796b4a tempest-AttachVolumeNegativeTest-1000400951 tempest-AttachVolumeNegativeTest-1000400951-project] [instance: 6601be22-57ed-4f24-a26d-d909c51113c8] Fetching instance by UUID {{(pid=116063) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 12:59:09.508960 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-5df41f07-052e-4b71-b49d-8976f8796b4a tempest-AttachVolumeNegativeTest-1000400951 tempest-AttachVolumeNegativeTest-1000400951-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 12:59:09.509512 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-5df41f07-052e-4b71-b49d-8976f8796b4a tempest-AttachVolumeNegativeTest-1000400951 tempest-AttachVolumeNegativeTest-1000400951-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 12:59:09.510371 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-5df41f07-052e-4b71-b49d-8976f8796b4a tempest-AttachVolumeNegativeTest-1000400951 tempest-AttachVolumeNegativeTest-1000400951-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 12:59:09.510871 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-5df41f07-052e-4b71-b49d-8976f8796b4a tempest-AttachVolumeNegativeTest-1000400951 tempest-AttachVolumeNegativeTest-1000400951-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 12:59:09.789018 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.virt.hardware [None req-2dbbcdb7-9351-4f4b-a745-06e4a19f1e2a tempest-VolumesActionsTest-648269150 tempest-VolumesActionsTest-648269150-project] Flavor limits 0:0:0 {{(pid=116064) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Dec 14 12:59:09.790091 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.virt.hardware [None req-2dbbcdb7-9351-4f4b-a745-06e4a19f1e2a tempest-VolumesActionsTest-648269150 tempest-VolumesActionsTest-648269150-project] Image limits 0:0:0 {{(pid=116064) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Dec 14 12:59:09.790721 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.virt.hardware [None req-2dbbcdb7-9351-4f4b-a745-06e4a19f1e2a tempest-VolumesActionsTest-648269150 tempest-VolumesActionsTest-648269150-project] Flavor pref 0:0:0 {{(pid=116064) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Dec 14 12:59:09.791341 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.virt.hardware [None req-2dbbcdb7-9351-4f4b-a745-06e4a19f1e2a tempest-VolumesActionsTest-648269150 tempest-VolumesActionsTest-648269150-project] Image pref 0:0:0 {{(pid=116064) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Dec 14 12:59:09.791791 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.virt.hardware [None req-2dbbcdb7-9351-4f4b-a745-06e4a19f1e2a tempest-VolumesActionsTest-648269150 tempest-VolumesActionsTest-648269150-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=116064) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Dec 14 12:59:09.794780 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.policy [None req-5df41f07-052e-4b71-b49d-8976f8796b4a tempest-AttachVolumeNegativeTest-1000400951 tempest-AttachVolumeNegativeTest-1000400951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57d0ec01f0784c8ea87d339980bed3cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad27b8951cae4eeeafa257f45217653a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116063) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 12:59:09.803613 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-2dbbcdb7-9351-4f4b-a745-06e4a19f1e2a tempest-VolumesActionsTest-648269150 tempest-VolumesActionsTest-648269150-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 12:59:09.804097 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: INFO nova.api.openstack.requestlog [None req-5df41f07-052e-4b71-b49d-8976f8796b4a tempest-AttachVolumeNegativeTest-1000400951 tempest-AttachVolumeNegativeTest-1000400951-project] 10.222.0.49 "GET /compute/v2.1/servers/6601be22-57ed-4f24-a26d-d909c51113c8" status: 200 len: 1317 microversion: 2.1 time: 0.306776 Dec 14 12:59:09.804491 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-2dbbcdb7-9351-4f4b-a745-06e4a19f1e2a tempest-VolumesActionsTest-648269150 tempest-VolumesActionsTest-648269150-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 12:59:09.804773 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: [pid: 116063|app: 0|req: 108/196] 10.222.0.49 () {58 vars in 1235 bytes} [Tue Dec 14 12:59:09 2021] GET /compute/v2.1/servers/6601be22-57ed-4f24-a26d-d909c51113c8 => generated 1317 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 14 12:59:09.806175 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-2dbbcdb7-9351-4f4b-a745-06e4a19f1e2a tempest-VolumesActionsTest-648269150 tempest-VolumesActionsTest-648269150-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 12:59:09.806871 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-2dbbcdb7-9351-4f4b-a745-06e4a19f1e2a tempest-VolumesActionsTest-648269150 tempest-VolumesActionsTest-648269150-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 12:59:09.820366 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.api.openstack.wsgi [None req-6006f91c-a996-40a3-8da5-2b5404b79a03 tempest-VolumesTestJSON-1145439577 tempest-VolumesTestJSON-1145439577-project] Calling method '.version_select at 0x7f2acdcf84c0>' {{(pid=116063) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 12:59:09.827535 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.quota [None req-2dbbcdb7-9351-4f4b-a745-06e4a19f1e2a tempest-VolumesActionsTest-648269150 tempest-VolumesActionsTest-648269150-project] Getting quotas for project 9fa190426a6c4b9c9d6d259455a647ca. Resources: {'cores', 'instances', 'ram'} {{(pid=116064) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 14 12:59:09.832533 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.quota [None req-2dbbcdb7-9351-4f4b-a745-06e4a19f1e2a tempest-VolumesActionsTest-648269150 tempest-VolumesActionsTest-648269150-project] Getting quotas for user 3cc7290157ff4075b95ead815c2b332a and project 9fa190426a6c4b9c9d6d259455a647ca. Resources: {'cores', 'instances', 'ram'} {{(pid=116064) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 14 12:59:09.864092 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.compute.api [None req-2dbbcdb7-9351-4f4b-a745-06e4a19f1e2a tempest-VolumesActionsTest-648269150 tempest-VolumesActionsTest-648269150-project] Going to run 1 instances... {{(pid=116064) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Dec 14 12:59:09.867056 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.compute.api [None req-2dbbcdb7-9351-4f4b-a745-06e4a19f1e2a tempest-VolumesActionsTest-648269150 tempest-VolumesActionsTest-648269150-project] [instance: 7a410a38-0f6d-4e02-8db7-abd99e6a4fa1] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='1733dcd4-5ded-44e1-8b8d-392adb05c67a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=116064) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Dec 14 12:59:09.879995 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: INFO nova.api.openstack.requestlog [None req-6006f91c-a996-40a3-8da5-2b5404b79a03 tempest-VolumesTestJSON-1145439577 tempest-VolumesTestJSON-1145439577-project] 10.222.0.49 "GET /compute/v2.1/os-volumes/c19fdc1c-fb0e-44a8-8e10-fa5b2054a97a" status: 200 len: 350 microversion: 2.1 time: 0.063254 Dec 14 12:59:09.880900 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: [pid: 116063|app: 0|req: 109/197] 10.222.0.49 () {58 vars in 1244 bytes} [Tue Dec 14 12:59:09 2021] GET /compute/v2.1/os-volumes/c19fdc1c-fb0e-44a8-8e10-fa5b2054a97a => generated 350 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 14 12:59:09.891888 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.api.openstack.wsgi [None req-50ac8b75-6587-4995-a861-b180d0b5706f tempest-VolumesTestJSON-1145439577 tempest-VolumesTestJSON-1145439577-project] Calling method '.version_select at 0x7f2acdca9d30>' {{(pid=116063) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 12:59:09.954113 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: INFO nova.api.openstack.requestlog [None req-2dbbcdb7-9351-4f4b-a745-06e4a19f1e2a tempest-VolumesActionsTest-648269150 tempest-VolumesActionsTest-648269150-project] 10.222.0.49 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.815580 Dec 14 12:59:09.960330 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: [pid: 116064|app: 0|req: 89/198] 10.222.0.49 () {60 vars in 1146 bytes} [Tue Dec 14 12:59:09 2021] POST /compute/v2.1/servers => generated 380 bytes in 829 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Dec 14 12:59:09.965519 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.api.openstack.wsgi [None req-6cdb13a9-6e47-4721-aac6-2cabbde17ecb tempest-VolumesActionsTest-648269150 tempest-VolumesActionsTest-648269150-project] Calling method '>' {{(pid=116064) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 12:59:09.967357 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.compute.api [None req-6cdb13a9-6e47-4721-aac6-2cabbde17ecb tempest-VolumesActionsTest-648269150 tempest-VolumesActionsTest-648269150-project] [instance: 7a410a38-0f6d-4e02-8db7-abd99e6a4fa1] Fetching instance by UUID {{(pid=116064) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 12:59:09.982777 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: INFO nova.api.openstack.requestlog [None req-50ac8b75-6587-4995-a861-b180d0b5706f tempest-VolumesTestJSON-1145439577 tempest-VolumesTestJSON-1145439577-project] 10.222.0.49 "GET /compute/v2.1/os-volumes" status: 200 len: 1033 microversion: 2.1 time: 0.094370 Dec 14 12:59:09.983697 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: [pid: 116063|app: 0|req: 110/199] 10.222.0.49 () {58 vars in 1133 bytes} [Tue Dec 14 12:59:09 2021] GET /compute/v2.1/os-volumes => generated 1033 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 14 12:59:09.999953 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.api.openstack.wsgi [None req-b8fecfe6-b3ba-4587-8a84-ad6a05b0c6c8 tempest-VolumesTestJSON-1145439577 tempest-VolumesTestJSON-1145439577-project] Calling method '.version_select at 0x7f2acdca93a0>' {{(pid=116063) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 12:59:10.125138 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: INFO nova.api.openstack.requestlog [None req-b8fecfe6-b3ba-4587-8a84-ad6a05b0c6c8 tempest-VolumesTestJSON-1145439577 tempest-VolumesTestJSON-1145439577-project] 10.222.0.49 "GET /compute/v2.1/os-volumes?limit=2" status: 200 len: 694 microversion: 2.1 time: 0.129278 Dec 14 12:59:10.125932 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: [pid: 116063|app: 0|req: 111/200] 10.222.0.49 () {58 vars in 1148 bytes} [Tue Dec 14 12:59:09 2021] GET /compute/v2.1/os-volumes?limit=2 => generated 694 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Dec 14 12:59:10.140138 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.api.openstack.wsgi [None req-5cc1bfd9-2e1e-4c26-9ff7-d7c817cd6ce3 tempest-ServerRescueNegativeTestJSON-1573931620 tempest-ServerRescueNegativeTestJSON-1573931620-project] Calling method '>' {{(pid=116063) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 12:59:10.141636 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.compute.api [None req-5cc1bfd9-2e1e-4c26-9ff7-d7c817cd6ce3 tempest-ServerRescueNegativeTestJSON-1573931620 tempest-ServerRescueNegativeTestJSON-1573931620-project] [instance: 60694e1e-d0cb-41c8-adf5-bdda49804385] Fetching instance by UUID {{(pid=116063) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 12:59:10.159046 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-5cc1bfd9-2e1e-4c26-9ff7-d7c817cd6ce3 tempest-ServerRescueNegativeTestJSON-1573931620 tempest-ServerRescueNegativeTestJSON-1573931620-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 12:59:10.159733 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-5cc1bfd9-2e1e-4c26-9ff7-d7c817cd6ce3 tempest-ServerRescueNegativeTestJSON-1573931620 tempest-ServerRescueNegativeTestJSON-1573931620-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 12:59:10.160739 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-5cc1bfd9-2e1e-4c26-9ff7-d7c817cd6ce3 tempest-ServerRescueNegativeTestJSON-1573931620 tempest-ServerRescueNegativeTestJSON-1573931620-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 12:59:10.161397 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-5cc1bfd9-2e1e-4c26-9ff7-d7c817cd6ce3 tempest-ServerRescueNegativeTestJSON-1573931620 tempest-ServerRescueNegativeTestJSON-1573931620-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 12:59:10.250238 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.policy [None req-6cdb13a9-6e47-4721-aac6-2cabbde17ecb tempest-VolumesActionsTest-648269150 tempest-VolumesActionsTest-648269150-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cc7290157ff4075b95ead815c2b332a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fa190426a6c4b9c9d6d259455a647ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116064) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 12:59:10.265648 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: INFO nova.api.openstack.requestlog [None req-6cdb13a9-6e47-4721-aac6-2cabbde17ecb tempest-VolumesActionsTest-648269150 tempest-VolumesActionsTest-648269150-project] 10.222.0.49 "GET /compute/v2.1/servers/7a410a38-0f6d-4e02-8db7-abd99e6a4fa1" status: 200 len: 1213 microversion: 2.1 time: 0.303623 Dec 14 12:59:10.268055 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: [pid: 116064|app: 0|req: 90/201] 10.222.0.49 () {58 vars in 1235 bytes} [Tue Dec 14 12:59:09 2021] GET /compute/v2.1/servers/7a410a38-0f6d-4e02-8db7-abd99e6a4fa1 => generated 1213 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 14 12:59:10.272692 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.api.openstack.wsgi [None req-5dc20480-047b-4fb3-a426-3ab710b5520a tempest-VolumesTestJSON-1145439577 tempest-VolumesTestJSON-1145439577-project] Calling method '.version_select at 0x7f2ace570280>' {{(pid=116064) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 12:59:10.372349 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.policy [None req-5cc1bfd9-2e1e-4c26-9ff7-d7c817cd6ce3 tempest-ServerRescueNegativeTestJSON-1573931620 tempest-ServerRescueNegativeTestJSON-1573931620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '731cbbfe17214ded8ac66299d66dfc45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '010919ea84eb4eb8b936c63153600eba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116063) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 12:59:10.382999 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: INFO nova.api.openstack.requestlog [None req-5cc1bfd9-2e1e-4c26-9ff7-d7c817cd6ce3 tempest-ServerRescueNegativeTestJSON-1573931620 tempest-ServerRescueNegativeTestJSON-1573931620-project] 10.222.0.49 "GET /compute/v2.1/servers/60694e1e-d0cb-41c8-adf5-bdda49804385" status: 200 len: 1523 microversion: 2.1 time: 0.247087 Dec 14 12:59:10.384956 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: [pid: 116063|app: 0|req: 112/202] 10.222.0.49 () {58 vars in 1235 bytes} [Tue Dec 14 12:59:10 2021] GET /compute/v2.1/servers/60694e1e-d0cb-41c8-adf5-bdda49804385 => generated 1523 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 14 12:59:10.447683 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: INFO nova.api.openstack.requestlog [None req-5dc20480-047b-4fb3-a426-3ab710b5520a tempest-VolumesTestJSON-1145439577 tempest-VolumesTestJSON-1145439577-project] 10.222.0.49 "GET /compute/v2.1/os-volumes" status: 200 len: 1033 microversion: 2.1 time: 0.178409 Dec 14 12:59:10.448181 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: [pid: 116064|app: 0|req: 91/203] 10.222.0.49 () {58 vars in 1133 bytes} [Tue Dec 14 12:59:10 2021] GET /compute/v2.1/os-volumes => generated 1033 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 14 12:59:10.459388 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.api.openstack.wsgi [None req-09dcfbfd-afa1-45b1-86de-8775d3062d2b tempest-VolumesTestJSON-1145439577 tempest-VolumesTestJSON-1145439577-project] Calling method '.version_select at 0x7f2acddd3310>' {{(pid=116063) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 12:59:10.509487 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.api.openstack.wsgi [None req-20ea88ff-6c94-475b-a459-cba319efa59f tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116064) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 14 12:59:10.510739 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.compute.api [None req-20ea88ff-6c94-475b-a459-cba319efa59f tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] [instance: c8de7730-62f2-4a77-b1e9-cf6a74fa366d] Fetching instance by UUID {{(pid=116064) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 12:59:10.517648 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-20ea88ff-6c94-475b-a459-cba319efa59f tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 12:59:10.518151 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-20ea88ff-6c94-475b-a459-cba319efa59f tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 12:59:10.519586 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-20ea88ff-6c94-475b-a459-cba319efa59f tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 12:59:10.520238 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-20ea88ff-6c94-475b-a459-cba319efa59f tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 12:59:10.567802 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: INFO nova.api.openstack.requestlog [None req-09dcfbfd-afa1-45b1-86de-8775d3062d2b tempest-VolumesTestJSON-1145439577 tempest-VolumesTestJSON-1145439577-project] 10.222.0.49 "GET /compute/v2.1/os-volumes?offset=1&limit=1" status: 200 len: 354 microversion: 2.1 time: 0.111981 Dec 14 12:59:10.568380 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: [pid: 116063|app: 0|req: 113/204] 10.222.0.49 () {58 vars in 1166 bytes} [Tue Dec 14 12:59:10 2021] GET /compute/v2.1/os-volumes?offset=1&limit=1 => generated 354 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 14 12:59:10.581454 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.api.openstack.wsgi [None req-acca685c-a1cd-4e10-a865-3d1aa9f787b5 tempest-VolumesTestJSON-1145439577 tempest-VolumesTestJSON-1145439577-project] Calling method '.version_select at 0x7f2acdc880d0>' {{(pid=116063) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 12:59:10.619629 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: INFO nova.api.openstack.requestlog [None req-20ea88ff-6c94-475b-a459-cba319efa59f tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] 10.222.0.49 "POST /compute/v2.1/servers/c8de7730-62f2-4a77-b1e9-cf6a74fa366d/action" status: 200 len: 22003 microversion: 2.20 time: 0.115850 Dec 14 12:59:10.624587 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: [pid: 116064|app: 0|req: 92/205] 10.222.0.49 () {62 vars in 1318 bytes} [Tue Dec 14 12:59:10 2021] POST /compute/v2.1/servers/c8de7730-62f2-4a77-b1e9-cf6a74fa366d/action => generated 22003 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Dec 14 12:59:10.679548 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: INFO nova.api.openstack.requestlog [None req-acca685c-a1cd-4e10-a865-3d1aa9f787b5 tempest-VolumesTestJSON-1145439577 tempest-VolumesTestJSON-1145439577-project] 10.222.0.49 "GET /compute/v2.1/os-volumes/detail?limit=2" status: 200 len: 694 microversion: 2.1 time: 0.101017 Dec 14 12:59:10.679548 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: [pid: 116063|app: 0|req: 114/206] 10.222.0.49 () {58 vars in 1169 bytes} [Tue Dec 14 12:59:10 2021] GET /compute/v2.1/os-volumes/detail?limit=2 => generated 694 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 14 12:59:10.691218 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.api.openstack.wsgi [None req-20276838-4e03-4dfa-a44a-d9110e1219e0 tempest-VolumesTestJSON-1145439577 tempest-VolumesTestJSON-1145439577-project] Calling method '.version_select at 0x7f2ace570160>' {{(pid=116064) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 12:59:10.786906 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: INFO nova.api.openstack.requestlog [None req-20276838-4e03-4dfa-a44a-d9110e1219e0 tempest-VolumesTestJSON-1145439577 tempest-VolumesTestJSON-1145439577-project] 10.222.0.49 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1033 microversion: 2.1 time: 0.099757 Dec 14 12:59:10.795180 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: [pid: 116064|app: 0|req: 93/207] 10.222.0.49 () {58 vars in 1154 bytes} [Tue Dec 14 12:59:10 2021] GET /compute/v2.1/os-volumes/detail => generated 1033 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 14 12:59:10.807172 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.api.openstack.wsgi [None req-a9586a1c-5235-445b-9bfb-a2b4bfc08ba5 tempest-VolumesTestJSON-1145439577 tempest-VolumesTestJSON-1145439577-project] Calling method '.version_select at 0x7f2acdcbe700>' {{(pid=116063) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 12:59:10.821980 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.api.openstack.wsgi [None req-a73cae1b-1c7b-43f8-a8cb-af564adc5b48 tempest-AttachVolumeNegativeTest-1000400951 tempest-AttachVolumeNegativeTest-1000400951-project] Calling method '>' {{(pid=116064) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 12:59:10.822841 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.compute.api [None req-a73cae1b-1c7b-43f8-a8cb-af564adc5b48 tempest-AttachVolumeNegativeTest-1000400951 tempest-AttachVolumeNegativeTest-1000400951-project] [instance: 6601be22-57ed-4f24-a26d-d909c51113c8] Fetching instance by UUID {{(pid=116064) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 12:59:10.833408 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-a73cae1b-1c7b-43f8-a8cb-af564adc5b48 tempest-AttachVolumeNegativeTest-1000400951 tempest-AttachVolumeNegativeTest-1000400951-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 12:59:10.834310 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-a73cae1b-1c7b-43f8-a8cb-af564adc5b48 tempest-AttachVolumeNegativeTest-1000400951 tempest-AttachVolumeNegativeTest-1000400951-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 12:59:10.835792 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-a73cae1b-1c7b-43f8-a8cb-af564adc5b48 tempest-AttachVolumeNegativeTest-1000400951 tempest-AttachVolumeNegativeTest-1000400951-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 12:59:10.836416 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-a73cae1b-1c7b-43f8-a8cb-af564adc5b48 tempest-AttachVolumeNegativeTest-1000400951 tempest-AttachVolumeNegativeTest-1000400951-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 12:59:10.947355 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: INFO nova.api.openstack.requestlog [None req-a9586a1c-5235-445b-9bfb-a2b4bfc08ba5 tempest-VolumesTestJSON-1145439577 tempest-VolumesTestJSON-1145439577-project] 10.222.0.49 "GET /compute/v2.1/os-volumes/detail?offset=1&limit=1" status: 200 len: 354 microversion: 2.1 time: 0.151216 Dec 14 12:59:10.948184 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: [pid: 116063|app: 0|req: 115/208] 10.222.0.49 () {58 vars in 1187 bytes} [Tue Dec 14 12:59:10 2021] GET /compute/v2.1/os-volumes/detail?offset=1&limit=1 => generated 354 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Dec 14 12:59:10.959389 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.api.openstack.wsgi [None req-130ea5ed-1901-49aa-b588-3902ec41b8b6 tempest-VolumesTestJSON-1145439577 tempest-VolumesTestJSON-1145439577-project] Calling method '.version_select at 0x7f2acdca9f70>' {{(pid=116063) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 12:59:11.035323 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.policy [None req-a73cae1b-1c7b-43f8-a8cb-af564adc5b48 tempest-AttachVolumeNegativeTest-1000400951 tempest-AttachVolumeNegativeTest-1000400951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57d0ec01f0784c8ea87d339980bed3cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad27b8951cae4eeeafa257f45217653a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116064) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 12:59:11.044090 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: INFO nova.api.openstack.requestlog [None req-a73cae1b-1c7b-43f8-a8cb-af564adc5b48 tempest-AttachVolumeNegativeTest-1000400951 tempest-AttachVolumeNegativeTest-1000400951-project] 10.222.0.49 "GET /compute/v2.1/servers/6601be22-57ed-4f24-a26d-d909c51113c8" status: 200 len: 1317 microversion: 2.1 time: 0.225949 Dec 14 12:59:11.045073 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: [pid: 116064|app: 0|req: 94/209] 10.222.0.49 () {58 vars in 1235 bytes} [Tue Dec 14 12:59:10 2021] GET /compute/v2.1/servers/6601be22-57ed-4f24-a26d-d909c51113c8 => generated 1317 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 14 12:59:11.050527 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.api.openstack.wsgi [req-e24b4e62-f170-4f99-85bd-2da6d214f410 req-a7edc8f5-9be2-4362-a1db-272abb9de7a7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6601be22-57ed-4f24-a26d-d909c51113c8", "name": "network-vif-plugged", "status": "completed", "tag": "e2735b0b-3196-41ad-8a1f-2f0ee1dc4cfe"}]} {{(pid=116064) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 14 12:59:11.052822 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 14 12:59:11.052822 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: warnings.warn(msg) Dec 14 12:59:11.061153 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [req-e24b4e62-f170-4f99-85bd-2da6d214f410 req-a7edc8f5-9be2-4362-a1db-272abb9de7a7 service nova] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 12:59:11.061832 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [req-e24b4e62-f170-4f99-85bd-2da6d214f410 req-a7edc8f5-9be2-4362-a1db-272abb9de7a7 service nova] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 12:59:11.066673 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: INFO nova.api.openstack.requestlog [None req-130ea5ed-1901-49aa-b588-3902ec41b8b6 tempest-VolumesTestJSON-1145439577 tempest-VolumesTestJSON-1145439577-project] 10.222.0.49 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1033 microversion: 2.1 time: 0.110597 Dec 14 12:59:11.067486 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: [pid: 116063|app: 0|req: 116/210] 10.222.0.49 () {58 vars in 1154 bytes} [Tue Dec 14 12:59:10 2021] GET /compute/v2.1/os-volumes/detail => generated 1033 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 14 12:59:11.077505 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: INFO nova.api.openstack.compute.server_external_events [req-e24b4e62-f170-4f99-85bd-2da6d214f410 req-a7edc8f5-9be2-4362-a1db-272abb9de7a7 service nova] Creating event network-vif-plugged:e2735b0b-3196-41ad-8a1f-2f0ee1dc4cfe for instance 6601be22-57ed-4f24-a26d-d909c51113c8 on hv-cinder-78447 Dec 14 12:59:11.085258 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: INFO nova.api.openstack.requestlog [req-e24b4e62-f170-4f99-85bd-2da6d214f410 req-a7edc8f5-9be2-4362-a1db-272abb9de7a7 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038059 Dec 14 12:59:11.086414 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: [pid: 116064|app: 0|req: 95/211] 10.222.0.49 () {64 vars in 1317 bytes} [Tue Dec 14 12:59:11 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 14 12:59:11.282207 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.api.openstack.wsgi [None req-dbd87952-33b9-4b7a-a6eb-2c01040ba4c7 tempest-VolumesActionsTest-648269150 tempest-VolumesActionsTest-648269150-project] Calling method '>' {{(pid=116063) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 12:59:11.282813 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.compute.api [None req-dbd87952-33b9-4b7a-a6eb-2c01040ba4c7 tempest-VolumesActionsTest-648269150 tempest-VolumesActionsTest-648269150-project] [instance: 7a410a38-0f6d-4e02-8db7-abd99e6a4fa1] Fetching instance by UUID {{(pid=116063) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 12:59:11.289880 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-dbd87952-33b9-4b7a-a6eb-2c01040ba4c7 tempest-VolumesActionsTest-648269150 tempest-VolumesActionsTest-648269150-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 12:59:11.290587 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-dbd87952-33b9-4b7a-a6eb-2c01040ba4c7 tempest-VolumesActionsTest-648269150 tempest-VolumesActionsTest-648269150-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 12:59:11.291552 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-dbd87952-33b9-4b7a-a6eb-2c01040ba4c7 tempest-VolumesActionsTest-648269150 tempest-VolumesActionsTest-648269150-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 12:59:11.292116 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-dbd87952-33b9-4b7a-a6eb-2c01040ba4c7 tempest-VolumesActionsTest-648269150 tempest-VolumesActionsTest-648269150-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 12:59:11.357015 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.policy [None req-dbd87952-33b9-4b7a-a6eb-2c01040ba4c7 tempest-VolumesActionsTest-648269150 tempest-VolumesActionsTest-648269150-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cc7290157ff4075b95ead815c2b332a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fa190426a6c4b9c9d6d259455a647ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116063) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 12:59:11.366725 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: INFO nova.api.openstack.requestlog [None req-dbd87952-33b9-4b7a-a6eb-2c01040ba4c7 tempest-VolumesActionsTest-648269150 tempest-VolumesActionsTest-648269150-project] 10.222.0.49 "GET /compute/v2.1/servers/7a410a38-0f6d-4e02-8db7-abd99e6a4fa1" status: 200 len: 1265 microversion: 2.1 time: 0.088415 Dec 14 12:59:11.367314 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: [pid: 116063|app: 0|req: 117/212] 10.222.0.49 () {58 vars in 1235 bytes} [Tue Dec 14 12:59:11 2021] GET /compute/v2.1/servers/7a410a38-0f6d-4e02-8db7-abd99e6a4fa1 => generated 1265 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 14 12:59:11.400694 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.api.openstack.wsgi [None req-126fba3e-bed0-499a-b9c2-280f539d9870 tempest-ServerRescueNegativeTestJSON-1573931620 tempest-ServerRescueNegativeTestJSON-1573931620-project] Calling method '>' {{(pid=116064) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 12:59:11.401586 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.compute.api [None req-126fba3e-bed0-499a-b9c2-280f539d9870 tempest-ServerRescueNegativeTestJSON-1573931620 tempest-ServerRescueNegativeTestJSON-1573931620-project] [instance: 60694e1e-d0cb-41c8-adf5-bdda49804385] Fetching instance by UUID {{(pid=116064) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 12:59:11.409265 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-126fba3e-bed0-499a-b9c2-280f539d9870 tempest-ServerRescueNegativeTestJSON-1573931620 tempest-ServerRescueNegativeTestJSON-1573931620-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 12:59:11.410434 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-126fba3e-bed0-499a-b9c2-280f539d9870 tempest-ServerRescueNegativeTestJSON-1573931620 tempest-ServerRescueNegativeTestJSON-1573931620-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 12:59:11.411514 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-126fba3e-bed0-499a-b9c2-280f539d9870 tempest-ServerRescueNegativeTestJSON-1573931620 tempest-ServerRescueNegativeTestJSON-1573931620-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 12:59:11.412114 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-126fba3e-bed0-499a-b9c2-280f539d9870 tempest-ServerRescueNegativeTestJSON-1573931620 tempest-ServerRescueNegativeTestJSON-1573931620-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 12:59:11.555796 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.policy [None req-126fba3e-bed0-499a-b9c2-280f539d9870 tempest-ServerRescueNegativeTestJSON-1573931620 tempest-ServerRescueNegativeTestJSON-1573931620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '731cbbfe17214ded8ac66299d66dfc45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '010919ea84eb4eb8b936c63153600eba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116064) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 12:59:11.563587 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: INFO nova.api.openstack.requestlog [None req-126fba3e-bed0-499a-b9c2-280f539d9870 tempest-ServerRescueNegativeTestJSON-1573931620 tempest-ServerRescueNegativeTestJSON-1573931620-project] 10.222.0.49 "GET /compute/v2.1/servers/60694e1e-d0cb-41c8-adf5-bdda49804385" status: 200 len: 1523 microversion: 2.1 time: 0.167492 Dec 14 12:59:11.564180 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: [pid: 116064|app: 0|req: 96/213] 10.222.0.49 () {58 vars in 1235 bytes} [Tue Dec 14 12:59:11 2021] GET /compute/v2.1/servers/60694e1e-d0cb-41c8-adf5-bdda49804385 => generated 1523 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 14 12:59:11.639830 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.api.openstack.wsgi [None req-be1faf3c-bf56-4c5d-be54-864672118b9e tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116063) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 14 12:59:11.642626 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.compute.api [None req-be1faf3c-bf56-4c5d-be54-864672118b9e tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] [instance: c8de7730-62f2-4a77-b1e9-cf6a74fa366d] Fetching instance by UUID {{(pid=116063) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 12:59:11.658177 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-be1faf3c-bf56-4c5d-be54-864672118b9e tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 12:59:11.664587 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-be1faf3c-bf56-4c5d-be54-864672118b9e tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 12:59:11.665716 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-be1faf3c-bf56-4c5d-be54-864672118b9e tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 12:59:11.666309 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-be1faf3c-bf56-4c5d-be54-864672118b9e tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 12:59:11.772054 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: INFO nova.api.openstack.requestlog [None req-be1faf3c-bf56-4c5d-be54-864672118b9e tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] 10.222.0.49 "POST /compute/v2.1/servers/c8de7730-62f2-4a77-b1e9-cf6a74fa366d/action" status: 200 len: 23041 microversion: 2.20 time: 0.142166 Dec 14 12:59:11.773133 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: [pid: 116063|app: 0|req: 118/214] 10.222.0.49 () {62 vars in 1318 bytes} [Tue Dec 14 12:59:11 2021] POST /compute/v2.1/servers/c8de7730-62f2-4a77-b1e9-cf6a74fa366d/action => generated 23041 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 14 12:59:12.061878 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.api.openstack.wsgi [None req-9746041d-3f7a-4cbb-bae8-21d767a9afbb tempest-AttachVolumeNegativeTest-1000400951 tempest-AttachVolumeNegativeTest-1000400951-project] Calling method '>' {{(pid=116064) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 12:59:12.062493 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.compute.api [None req-9746041d-3f7a-4cbb-bae8-21d767a9afbb tempest-AttachVolumeNegativeTest-1000400951 tempest-AttachVolumeNegativeTest-1000400951-project] [instance: 6601be22-57ed-4f24-a26d-d909c51113c8] Fetching instance by UUID {{(pid=116064) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 12:59:12.069442 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-9746041d-3f7a-4cbb-bae8-21d767a9afbb tempest-AttachVolumeNegativeTest-1000400951 tempest-AttachVolumeNegativeTest-1000400951-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 12:59:12.069854 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-9746041d-3f7a-4cbb-bae8-21d767a9afbb tempest-AttachVolumeNegativeTest-1000400951 tempest-AttachVolumeNegativeTest-1000400951-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 12:59:12.070961 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-9746041d-3f7a-4cbb-bae8-21d767a9afbb tempest-AttachVolumeNegativeTest-1000400951 tempest-AttachVolumeNegativeTest-1000400951-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 12:59:12.071350 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-9746041d-3f7a-4cbb-bae8-21d767a9afbb tempest-AttachVolumeNegativeTest-1000400951 tempest-AttachVolumeNegativeTest-1000400951-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 12:59:12.220645 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.policy [None req-9746041d-3f7a-4cbb-bae8-21d767a9afbb tempest-AttachVolumeNegativeTest-1000400951 tempest-AttachVolumeNegativeTest-1000400951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57d0ec01f0784c8ea87d339980bed3cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad27b8951cae4eeeafa257f45217653a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116064) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 12:59:12.229757 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: INFO nova.api.openstack.requestlog [None req-9746041d-3f7a-4cbb-bae8-21d767a9afbb tempest-AttachVolumeNegativeTest-1000400951 tempest-AttachVolumeNegativeTest-1000400951-project] 10.222.0.49 "GET /compute/v2.1/servers/6601be22-57ed-4f24-a26d-d909c51113c8" status: 200 len: 1317 microversion: 2.1 time: 0.171672 Dec 14 12:59:12.230848 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: [pid: 116064|app: 0|req: 97/215] 10.222.0.49 () {58 vars in 1235 bytes} [Tue Dec 14 12:59:12 2021] GET /compute/v2.1/servers/6601be22-57ed-4f24-a26d-d909c51113c8 => generated 1317 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 14 12:59:12.373958 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.api.openstack.wsgi [None req-84970e21-b9cb-4e34-a13a-e515acf3af46 tempest-VolumesSnapshotTestJSON-1649574085 tempest-VolumesSnapshotTestJSON-1649574085-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-1504143423", "imageRef": "1733dcd4-5ded-44e1-8b8d-392adb05c67a", "flavorRef": "452", "networks": [{"uuid": "5a723a9f-3224-4b49-afa4-08d253222330"}]}} {{(pid=116063) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 14 12:59:12.383097 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.api.openstack.wsgi [None req-1fadfc89-c082-47e3-ae90-127614a40a3b tempest-VolumesActionsTest-648269150 tempest-VolumesActionsTest-648269150-project] Calling method '>' {{(pid=116064) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 12:59:12.383693 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.compute.api [None req-1fadfc89-c082-47e3-ae90-127614a40a3b tempest-VolumesActionsTest-648269150 tempest-VolumesActionsTest-648269150-project] [instance: 7a410a38-0f6d-4e02-8db7-abd99e6a4fa1] Fetching instance by UUID {{(pid=116064) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 12:59:12.390896 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-1fadfc89-c082-47e3-ae90-127614a40a3b tempest-VolumesActionsTest-648269150 tempest-VolumesActionsTest-648269150-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 12:59:12.391562 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-1fadfc89-c082-47e3-ae90-127614a40a3b tempest-VolumesActionsTest-648269150 tempest-VolumesActionsTest-648269150-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 12:59:12.392602 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-1fadfc89-c082-47e3-ae90-127614a40a3b tempest-VolumesActionsTest-648269150 tempest-VolumesActionsTest-648269150-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 12:59:12.393169 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-1fadfc89-c082-47e3-ae90-127614a40a3b tempest-VolumesActionsTest-648269150 tempest-VolumesActionsTest-648269150-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 12:59:12.445799 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.network.neutron [None req-84970e21-b9cb-4e34-a13a-e515acf3af46 tempest-VolumesSnapshotTestJSON-1649574085 tempest-VolumesSnapshotTestJSON-1649574085-project] validate_networks() for [('5a723a9f-3224-4b49-afa4-08d253222330', None, None, None, None, None)] {{(pid=116063) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Dec 14 12:59:12.634271 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.policy [None req-1fadfc89-c082-47e3-ae90-127614a40a3b tempest-VolumesActionsTest-648269150 tempest-VolumesActionsTest-648269150-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cc7290157ff4075b95ead815c2b332a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fa190426a6c4b9c9d6d259455a647ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116064) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 12:59:12.661211 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: INFO nova.api.openstack.requestlog [None req-1fadfc89-c082-47e3-ae90-127614a40a3b tempest-VolumesActionsTest-648269150 tempest-VolumesActionsTest-648269150-project] 10.222.0.49 "GET /compute/v2.1/servers/7a410a38-0f6d-4e02-8db7-abd99e6a4fa1" status: 200 len: 1313 microversion: 2.1 time: 0.281425 Dec 14 12:59:12.665672 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: [pid: 116064|app: 0|req: 98/216] 10.222.0.49 () {58 vars in 1235 bytes} [Tue Dec 14 12:59:12 2021] GET /compute/v2.1/servers/7a410a38-0f6d-4e02-8db7-abd99e6a4fa1 => generated 1313 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 14 12:59:12.671343 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.api.openstack.wsgi [None req-bb1f9f63-ccd0-4055-9054-08b021ab892b tempest-ServerRescueNegativeTestJSON-1573931620 tempest-ServerRescueNegativeTestJSON-1573931620-project] Calling method '>' {{(pid=116064) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 12:59:12.672072 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.compute.api [None req-bb1f9f63-ccd0-4055-9054-08b021ab892b tempest-ServerRescueNegativeTestJSON-1573931620 tempest-ServerRescueNegativeTestJSON-1573931620-project] [instance: 60694e1e-d0cb-41c8-adf5-bdda49804385] Fetching instance by UUID {{(pid=116064) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 12:59:12.678354 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-bb1f9f63-ccd0-4055-9054-08b021ab892b tempest-ServerRescueNegativeTestJSON-1573931620 tempest-ServerRescueNegativeTestJSON-1573931620-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 12:59:12.679303 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-bb1f9f63-ccd0-4055-9054-08b021ab892b tempest-ServerRescueNegativeTestJSON-1573931620 tempest-ServerRescueNegativeTestJSON-1573931620-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 12:59:12.680291 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-bb1f9f63-ccd0-4055-9054-08b021ab892b tempest-ServerRescueNegativeTestJSON-1573931620 tempest-ServerRescueNegativeTestJSON-1573931620-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 12:59:12.680820 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-bb1f9f63-ccd0-4055-9054-08b021ab892b tempest-ServerRescueNegativeTestJSON-1573931620 tempest-ServerRescueNegativeTestJSON-1573931620-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 12:59:12.916576 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.policy [None req-bb1f9f63-ccd0-4055-9054-08b021ab892b tempest-ServerRescueNegativeTestJSON-1573931620 tempest-ServerRescueNegativeTestJSON-1573931620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '731cbbfe17214ded8ac66299d66dfc45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '010919ea84eb4eb8b936c63153600eba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116064) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 12:59:12.928708 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: INFO nova.api.openstack.requestlog [None req-bb1f9f63-ccd0-4055-9054-08b021ab892b tempest-ServerRescueNegativeTestJSON-1573931620 tempest-ServerRescueNegativeTestJSON-1573931620-project] 10.222.0.49 "GET /compute/v2.1/servers/60694e1e-d0cb-41c8-adf5-bdda49804385" status: 200 len: 1523 microversion: 2.1 time: 0.260634 Dec 14 12:59:12.929862 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: [pid: 116064|app: 0|req: 99/217] 10.222.0.49 () {58 vars in 1235 bytes} [Tue Dec 14 12:59:12 2021] GET /compute/v2.1/servers/60694e1e-d0cb-41c8-adf5-bdda49804385 => generated 1523 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 14 12:59:12.937523 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.api.openstack.wsgi [None req-0b423dc5-acb5-4b04-a82e-26104a2c1b17 tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116064) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 14 12:59:12.939082 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.compute.api [None req-0b423dc5-acb5-4b04-a82e-26104a2c1b17 tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] [instance: c8de7730-62f2-4a77-b1e9-cf6a74fa366d] Fetching instance by UUID {{(pid=116064) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 12:59:12.945880 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-0b423dc5-acb5-4b04-a82e-26104a2c1b17 tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 12:59:12.946395 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-0b423dc5-acb5-4b04-a82e-26104a2c1b17 tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 12:59:12.947196 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-0b423dc5-acb5-4b04-a82e-26104a2c1b17 tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 12:59:12.947633 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-0b423dc5-acb5-4b04-a82e-26104a2c1b17 tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 12:59:12.949284 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.virt.hardware [None req-84970e21-b9cb-4e34-a13a-e515acf3af46 tempest-VolumesSnapshotTestJSON-1649574085 tempest-VolumesSnapshotTestJSON-1649574085-project] Flavor limits 0:0:0 {{(pid=116063) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Dec 14 12:59:12.950324 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.virt.hardware [None req-84970e21-b9cb-4e34-a13a-e515acf3af46 tempest-VolumesSnapshotTestJSON-1649574085 tempest-VolumesSnapshotTestJSON-1649574085-project] Image limits 0:0:0 {{(pid=116063) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Dec 14 12:59:12.950794 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.virt.hardware [None req-84970e21-b9cb-4e34-a13a-e515acf3af46 tempest-VolumesSnapshotTestJSON-1649574085 tempest-VolumesSnapshotTestJSON-1649574085-project] Flavor pref 0:0:0 {{(pid=116063) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Dec 14 12:59:12.951195 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.virt.hardware [None req-84970e21-b9cb-4e34-a13a-e515acf3af46 tempest-VolumesSnapshotTestJSON-1649574085 tempest-VolumesSnapshotTestJSON-1649574085-project] Image pref 0:0:0 {{(pid=116063) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Dec 14 12:59:12.951853 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.virt.hardware [None req-84970e21-b9cb-4e34-a13a-e515acf3af46 tempest-VolumesSnapshotTestJSON-1649574085 tempest-VolumesSnapshotTestJSON-1649574085-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=116063) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Dec 14 12:59:12.960816 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-84970e21-b9cb-4e34-a13a-e515acf3af46 tempest-VolumesSnapshotTestJSON-1649574085 tempest-VolumesSnapshotTestJSON-1649574085-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 12:59:12.961313 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-84970e21-b9cb-4e34-a13a-e515acf3af46 tempest-VolumesSnapshotTestJSON-1649574085 tempest-VolumesSnapshotTestJSON-1649574085-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 12:59:12.962272 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-84970e21-b9cb-4e34-a13a-e515acf3af46 tempest-VolumesSnapshotTestJSON-1649574085 tempest-VolumesSnapshotTestJSON-1649574085-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 12:59:12.962857 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-84970e21-b9cb-4e34-a13a-e515acf3af46 tempest-VolumesSnapshotTestJSON-1649574085 tempest-VolumesSnapshotTestJSON-1649574085-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 12:59:12.979752 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.quota [None req-84970e21-b9cb-4e34-a13a-e515acf3af46 tempest-VolumesSnapshotTestJSON-1649574085 tempest-VolumesSnapshotTestJSON-1649574085-project] Getting quotas for project e1bf776f341b4721b28eb9a5c84ba866. Resources: {'cores', 'instances', 'ram'} {{(pid=116063) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 14 12:59:12.983818 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.quota [None req-84970e21-b9cb-4e34-a13a-e515acf3af46 tempest-VolumesSnapshotTestJSON-1649574085 tempest-VolumesSnapshotTestJSON-1649574085-project] Getting quotas for user 0e18311fd2704616a778d36332f199ea and project e1bf776f341b4721b28eb9a5c84ba866. Resources: {'cores', 'instances', 'ram'} {{(pid=116063) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 14 12:59:12.994261 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.compute.api [None req-84970e21-b9cb-4e34-a13a-e515acf3af46 tempest-VolumesSnapshotTestJSON-1649574085 tempest-VolumesSnapshotTestJSON-1649574085-project] Going to run 1 instances... {{(pid=116063) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Dec 14 12:59:12.996713 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.compute.api [None req-84970e21-b9cb-4e34-a13a-e515acf3af46 tempest-VolumesSnapshotTestJSON-1649574085 tempest-VolumesSnapshotTestJSON-1649574085-project] [instance: c48d3c23-3b4b-4220-8ead-d04a670ec64f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='1733dcd4-5ded-44e1-8b8d-392adb05c67a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=116063) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Dec 14 12:59:13.041045 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: INFO nova.api.openstack.requestlog [None req-84970e21-b9cb-4e34-a13a-e515acf3af46 tempest-VolumesSnapshotTestJSON-1649574085 tempest-VolumesSnapshotTestJSON-1649574085-project] 10.222.0.49 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.671599 Dec 14 12:59:13.041894 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: [pid: 116063|app: 0|req: 119/218] 10.222.0.49 () {60 vars in 1146 bytes} [Tue Dec 14 12:59:12 2021] POST /compute/v2.1/servers => generated 380 bytes in 674 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Dec 14 12:59:13.048926 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: INFO nova.api.openstack.requestlog [None req-0b423dc5-acb5-4b04-a82e-26104a2c1b17 tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] 10.222.0.49 "POST /compute/v2.1/servers/c8de7730-62f2-4a77-b1e9-cf6a74fa366d/action" status: 200 len: 23782 microversion: 2.20 time: 0.116032 Dec 14 12:59:13.050090 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: [pid: 116064|app: 0|req: 100/219] 10.222.0.49 () {62 vars in 1318 bytes} [Tue Dec 14 12:59:12 2021] POST /compute/v2.1/servers/c8de7730-62f2-4a77-b1e9-cf6a74fa366d/action => generated 23782 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 14 12:59:13.054739 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.api.openstack.wsgi [None req-9ba4b0da-d35d-4b01-8a4e-d6f8a4dea3b7 tempest-VolumesSnapshotTestJSON-1649574085 tempest-VolumesSnapshotTestJSON-1649574085-project] Calling method '>' {{(pid=116063) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 12:59:13.055647 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.compute.api [None req-9ba4b0da-d35d-4b01-8a4e-d6f8a4dea3b7 tempest-VolumesSnapshotTestJSON-1649574085 tempest-VolumesSnapshotTestJSON-1649574085-project] [instance: c48d3c23-3b4b-4220-8ead-d04a670ec64f] Fetching instance by UUID {{(pid=116063) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 12:59:13.080900 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.api.openstack.wsgi [req-9f082cf4-e84e-4173-9fca-010441e8dcc1 req-86b12a25-a4d7-4271-a0e0-c677c48dd7d8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7a410a38-0f6d-4e02-8db7-abd99e6a4fa1", "tag": "7d1aa989-c06a-4f16-bb14-af862f53bf9b"}]} {{(pid=116064) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 14 12:59:13.082474 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 14 12:59:13.082474 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: warnings.warn(msg) Dec 14 12:59:13.091587 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [req-9f082cf4-e84e-4173-9fca-010441e8dcc1 req-86b12a25-a4d7-4271-a0e0-c677c48dd7d8 service nova] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 12:59:13.092293 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [req-9f082cf4-e84e-4173-9fca-010441e8dcc1 req-86b12a25-a4d7-4271-a0e0-c677c48dd7d8 service nova] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 12:59:13.118349 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: INFO nova.api.openstack.compute.server_external_events [req-9f082cf4-e84e-4173-9fca-010441e8dcc1 req-86b12a25-a4d7-4271-a0e0-c677c48dd7d8 service nova] Creating event network-changed:7d1aa989-c06a-4f16-bb14-af862f53bf9b for instance 7a410a38-0f6d-4e02-8db7-abd99e6a4fa1 on hv-cinder-78447 Dec 14 12:59:13.123523 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: INFO nova.api.openstack.requestlog [req-9f082cf4-e84e-4173-9fca-010441e8dcc1 req-86b12a25-a4d7-4271-a0e0-c677c48dd7d8 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.047184 Dec 14 12:59:13.127815 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: [pid: 116064|app: 0|req: 101/220] 10.222.0.49 () {64 vars in 1317 bytes} [Tue Dec 14 12:59:13 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Dec 14 12:59:13.129688 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.policy [None req-9ba4b0da-d35d-4b01-8a4e-d6f8a4dea3b7 tempest-VolumesSnapshotTestJSON-1649574085 tempest-VolumesSnapshotTestJSON-1649574085-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e18311fd2704616a778d36332f199ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1bf776f341b4721b28eb9a5c84ba866', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116063) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 12:59:13.136557 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: INFO nova.api.openstack.requestlog [None req-9ba4b0da-d35d-4b01-8a4e-d6f8a4dea3b7 tempest-VolumesSnapshotTestJSON-1649574085 tempest-VolumesSnapshotTestJSON-1649574085-project] 10.222.0.49 "GET /compute/v2.1/servers/c48d3c23-3b4b-4220-8ead-d04a670ec64f" status: 200 len: 1219 microversion: 2.1 time: 0.088699 Dec 14 12:59:13.137305 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: [pid: 116063|app: 0|req: 120/221] 10.222.0.49 () {58 vars in 1235 bytes} [Tue Dec 14 12:59:13 2021] GET /compute/v2.1/servers/c48d3c23-3b4b-4220-8ead-d04a670ec64f => generated 1219 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 14 12:59:13.247834 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.api.openstack.wsgi [None req-fceb31fb-65d2-4340-8029-c34d6942133d tempest-AttachVolumeNegativeTest-1000400951 tempest-AttachVolumeNegativeTest-1000400951-project] Calling method '>' {{(pid=116064) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 12:59:13.248531 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.compute.api [None req-fceb31fb-65d2-4340-8029-c34d6942133d tempest-AttachVolumeNegativeTest-1000400951 tempest-AttachVolumeNegativeTest-1000400951-project] [instance: 6601be22-57ed-4f24-a26d-d909c51113c8] Fetching instance by UUID {{(pid=116064) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 12:59:13.256836 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-fceb31fb-65d2-4340-8029-c34d6942133d tempest-AttachVolumeNegativeTest-1000400951 tempest-AttachVolumeNegativeTest-1000400951-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 12:59:13.257553 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-fceb31fb-65d2-4340-8029-c34d6942133d tempest-AttachVolumeNegativeTest-1000400951 tempest-AttachVolumeNegativeTest-1000400951-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 12:59:13.258316 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-fceb31fb-65d2-4340-8029-c34d6942133d tempest-AttachVolumeNegativeTest-1000400951 tempest-AttachVolumeNegativeTest-1000400951-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 12:59:13.258916 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-fceb31fb-65d2-4340-8029-c34d6942133d tempest-AttachVolumeNegativeTest-1000400951 tempest-AttachVolumeNegativeTest-1000400951-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 12:59:13.425147 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.policy [None req-fceb31fb-65d2-4340-8029-c34d6942133d tempest-AttachVolumeNegativeTest-1000400951 tempest-AttachVolumeNegativeTest-1000400951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57d0ec01f0784c8ea87d339980bed3cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad27b8951cae4eeeafa257f45217653a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116064) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 12:59:13.433558 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: INFO nova.api.openstack.requestlog [None req-fceb31fb-65d2-4340-8029-c34d6942133d tempest-AttachVolumeNegativeTest-1000400951 tempest-AttachVolumeNegativeTest-1000400951-project] 10.222.0.49 "GET /compute/v2.1/servers/6601be22-57ed-4f24-a26d-d909c51113c8" status: 200 len: 1506 microversion: 2.1 time: 0.190229 Dec 14 12:59:13.436000 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: [pid: 116064|app: 0|req: 102/222] 10.222.0.49 () {58 vars in 1235 bytes} [Tue Dec 14 12:59:13 2021] GET /compute/v2.1/servers/6601be22-57ed-4f24-a26d-d909c51113c8 => generated 1506 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 14 12:59:13.453809 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.api.openstack.wsgi [None req-c8223795-78ed-4031-94d7-45394ba5e6c7 tempest-AttachVolumeNegativeTest-1000400951 tempest-AttachVolumeNegativeTest-1000400951-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "b622e425-4dd6-4dbb-9952-362e113ef923"}} {{(pid=116063) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 14 12:59:13.455617 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.compute.api [None req-c8223795-78ed-4031-94d7-45394ba5e6c7 tempest-AttachVolumeNegativeTest-1000400951 tempest-AttachVolumeNegativeTest-1000400951-project] [instance: 6601be22-57ed-4f24-a26d-d909c51113c8] Fetching instance by UUID {{(pid=116063) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 12:59:13.472577 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-c8223795-78ed-4031-94d7-45394ba5e6c7 tempest-AttachVolumeNegativeTest-1000400951 tempest-AttachVolumeNegativeTest-1000400951-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 12:59:13.473203 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-c8223795-78ed-4031-94d7-45394ba5e6c7 tempest-AttachVolumeNegativeTest-1000400951 tempest-AttachVolumeNegativeTest-1000400951-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 12:59:13.475408 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-c8223795-78ed-4031-94d7-45394ba5e6c7 tempest-AttachVolumeNegativeTest-1000400951 tempest-AttachVolumeNegativeTest-1000400951-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 12:59:13.476484 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-c8223795-78ed-4031-94d7-45394ba5e6c7 tempest-AttachVolumeNegativeTest-1000400951 tempest-AttachVolumeNegativeTest-1000400951-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 12:59:13.617073 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: INFO nova.api.openstack.wsgi [None req-c8223795-78ed-4031-94d7-45394ba5e6c7 tempest-AttachVolumeNegativeTest-1000400951 tempest-AttachVolumeNegativeTest-1000400951-project] HTTP exception thrown: Invalid volume: volume b622e425-4dd6-4dbb-9952-362e113ef923 is already attached to instances: 824eca5b-954f-402d-aa22-14f24ddd77ba Dec 14 12:59:13.618579 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.api.openstack.wsgi [None req-c8223795-78ed-4031-94d7-45394ba5e6c7 tempest-AttachVolumeNegativeTest-1000400951 tempest-AttachVolumeNegativeTest-1000400951-project] Returning 400 to user: Invalid volume: volume b622e425-4dd6-4dbb-9952-362e113ef923 is already attached to instances: 824eca5b-954f-402d-aa22-14f24ddd77ba {{(pid=116063) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 14 12:59:13.619527 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: INFO nova.api.openstack.requestlog [None req-c8223795-78ed-4031-94d7-45394ba5e6c7 tempest-AttachVolumeNegativeTest-1000400951 tempest-AttachVolumeNegativeTest-1000400951-project] 10.222.0.49 "POST /compute/v2.1/servers/6601be22-57ed-4f24-a26d-d909c51113c8/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.171403 Dec 14 12:59:13.625080 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: [pid: 116063|app: 0|req: 121/223] 10.222.0.49 () {60 vars in 1322 bytes} [Tue Dec 14 12:59:13 2021] POST /compute/v2.1/servers/6601be22-57ed-4f24-a26d-d909c51113c8/os-volume_attachments => generated 174 bytes in 177 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Dec 14 12:59:13.685228 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.api.openstack.wsgi [None req-f9b526bf-37c0-4023-a8f4-9c85fcecbcc2 tempest-VolumesActionsTest-648269150 tempest-VolumesActionsTest-648269150-project] Calling method '>' {{(pid=116064) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 12:59:13.685845 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.compute.api [None req-f9b526bf-37c0-4023-a8f4-9c85fcecbcc2 tempest-VolumesActionsTest-648269150 tempest-VolumesActionsTest-648269150-project] [instance: 7a410a38-0f6d-4e02-8db7-abd99e6a4fa1] Fetching instance by UUID {{(pid=116064) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 12:59:13.698656 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-f9b526bf-37c0-4023-a8f4-9c85fcecbcc2 tempest-VolumesActionsTest-648269150 tempest-VolumesActionsTest-648269150-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 12:59:13.699328 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-f9b526bf-37c0-4023-a8f4-9c85fcecbcc2 tempest-VolumesActionsTest-648269150 tempest-VolumesActionsTest-648269150-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 12:59:13.701226 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-f9b526bf-37c0-4023-a8f4-9c85fcecbcc2 tempest-VolumesActionsTest-648269150 tempest-VolumesActionsTest-648269150-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 12:59:13.704735 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-f9b526bf-37c0-4023-a8f4-9c85fcecbcc2 tempest-VolumesActionsTest-648269150 tempest-VolumesActionsTest-648269150-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 12:59:13.846012 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.api.openstack.wsgi [None req-b01b5bfb-b8d1-4cd5-8791-37f5e9645161 tempest-AttachVolumeNegativeTest-1000400951 tempest-AttachVolumeNegativeTest-1000400951-project] Calling method '>' {{(pid=116063) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 12:59:13.846757 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.compute.api [None req-b01b5bfb-b8d1-4cd5-8791-37f5e9645161 tempest-AttachVolumeNegativeTest-1000400951 tempest-AttachVolumeNegativeTest-1000400951-project] [instance: 824eca5b-954f-402d-aa22-14f24ddd77ba] Fetching instance by UUID {{(pid=116063) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 12:59:13.854145 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-b01b5bfb-b8d1-4cd5-8791-37f5e9645161 tempest-AttachVolumeNegativeTest-1000400951 tempest-AttachVolumeNegativeTest-1000400951-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 12:59:13.855113 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-b01b5bfb-b8d1-4cd5-8791-37f5e9645161 tempest-AttachVolumeNegativeTest-1000400951 tempest-AttachVolumeNegativeTest-1000400951-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 12:59:13.856161 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-b01b5bfb-b8d1-4cd5-8791-37f5e9645161 tempest-AttachVolumeNegativeTest-1000400951 tempest-AttachVolumeNegativeTest-1000400951-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 12:59:13.856798 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-b01b5bfb-b8d1-4cd5-8791-37f5e9645161 tempest-AttachVolumeNegativeTest-1000400951 tempest-AttachVolumeNegativeTest-1000400951-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 12:59:13.997520 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.policy [None req-f9b526bf-37c0-4023-a8f4-9c85fcecbcc2 tempest-VolumesActionsTest-648269150 tempest-VolumesActionsTest-648269150-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cc7290157ff4075b95ead815c2b332a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fa190426a6c4b9c9d6d259455a647ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116064) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 12:59:14.010331 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: INFO nova.api.openstack.requestlog [None req-f9b526bf-37c0-4023-a8f4-9c85fcecbcc2 tempest-VolumesActionsTest-648269150 tempest-VolumesActionsTest-648269150-project] 10.222.0.49 "GET /compute/v2.1/servers/7a410a38-0f6d-4e02-8db7-abd99e6a4fa1" status: 200 len: 1313 microversion: 2.1 time: 0.331089 Dec 14 12:59:14.021791 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: [pid: 116064|app: 0|req: 103/224] 10.222.0.49 () {58 vars in 1235 bytes} [Tue Dec 14 12:59:13 2021] GET /compute/v2.1/servers/7a410a38-0f6d-4e02-8db7-abd99e6a4fa1 => generated 1313 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 14 12:59:14.029667 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.api.openstack.wsgi [None req-07619bbd-b792-4896-9704-04bbf8834484 tempest-ServerRescueNegativeTestJSON-1573931620 tempest-ServerRescueNegativeTestJSON-1573931620-project] Calling method '>' {{(pid=116064) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 12:59:14.030684 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.compute.api [None req-07619bbd-b792-4896-9704-04bbf8834484 tempest-ServerRescueNegativeTestJSON-1573931620 tempest-ServerRescueNegativeTestJSON-1573931620-project] [instance: 60694e1e-d0cb-41c8-adf5-bdda49804385] Fetching instance by UUID {{(pid=116064) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 12:59:14.035269 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.objects.instance [None req-b01b5bfb-b8d1-4cd5-8791-37f5e9645161 tempest-AttachVolumeNegativeTest-1000400951 tempest-AttachVolumeNegativeTest-1000400951-project] Lazy-loading 'services' on Instance uuid 824eca5b-954f-402d-aa22-14f24ddd77ba {{(pid=116063) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Dec 14 12:59:14.038718 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-07619bbd-b792-4896-9704-04bbf8834484 tempest-ServerRescueNegativeTestJSON-1573931620 tempest-ServerRescueNegativeTestJSON-1573931620-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 12:59:14.039276 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-07619bbd-b792-4896-9704-04bbf8834484 tempest-ServerRescueNegativeTestJSON-1573931620 tempest-ServerRescueNegativeTestJSON-1573931620-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 12:59:14.040132 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-07619bbd-b792-4896-9704-04bbf8834484 tempest-ServerRescueNegativeTestJSON-1573931620 tempest-ServerRescueNegativeTestJSON-1573931620-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 12:59:14.040635 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-07619bbd-b792-4896-9704-04bbf8834484 tempest-ServerRescueNegativeTestJSON-1573931620 tempest-ServerRescueNegativeTestJSON-1573931620-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 12:59:14.157189 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: INFO nova.api.openstack.requestlog [None req-b01b5bfb-b8d1-4cd5-8791-37f5e9645161 tempest-AttachVolumeNegativeTest-1000400951 tempest-AttachVolumeNegativeTest-1000400951-project] 10.222.0.49 "DELETE /compute/v2.1/servers/824eca5b-954f-402d-aa22-14f24ddd77ba/os-volume_attachments/b622e425-4dd6-4dbb-9952-362e113ef923" status: 202 len: 0 microversion: 2.1 time: 0.314495 Dec 14 12:59:14.158388 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: [pid: 116063|app: 0|req: 122/225] 10.222.0.49 () {58 vars in 1415 bytes} [Tue Dec 14 12:59:13 2021] DELETE /compute/v2.1/servers/824eca5b-954f-402d-aa22-14f24ddd77ba/os-volume_attachments/b622e425-4dd6-4dbb-9952-362e113ef923 => generated 0 bytes in 317 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Dec 14 12:59:14.163828 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.api.openstack.wsgi [None req-643cb32e-0e5b-4a6a-bfa8-8eb93bf9d3e3 tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116063) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 14 12:59:14.165955 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.compute.api [None req-643cb32e-0e5b-4a6a-bfa8-8eb93bf9d3e3 tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] [instance: c8de7730-62f2-4a77-b1e9-cf6a74fa366d] Fetching instance by UUID {{(pid=116063) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 12:59:14.175262 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-643cb32e-0e5b-4a6a-bfa8-8eb93bf9d3e3 tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 12:59:14.176570 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-643cb32e-0e5b-4a6a-bfa8-8eb93bf9d3e3 tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 12:59:14.177769 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-643cb32e-0e5b-4a6a-bfa8-8eb93bf9d3e3 tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 12:59:14.178276 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-643cb32e-0e5b-4a6a-bfa8-8eb93bf9d3e3 tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 12:59:14.195975 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.policy [None req-07619bbd-b792-4896-9704-04bbf8834484 tempest-ServerRescueNegativeTestJSON-1573931620 tempest-ServerRescueNegativeTestJSON-1573931620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '731cbbfe17214ded8ac66299d66dfc45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '010919ea84eb4eb8b936c63153600eba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116064) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 12:59:14.206969 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: INFO nova.api.openstack.requestlog [None req-07619bbd-b792-4896-9704-04bbf8834484 tempest-ServerRescueNegativeTestJSON-1573931620 tempest-ServerRescueNegativeTestJSON-1573931620-project] 10.222.0.49 "GET /compute/v2.1/servers/60694e1e-d0cb-41c8-adf5-bdda49804385" status: 200 len: 1523 microversion: 2.1 time: 0.183221 Dec 14 12:59:14.207527 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: [pid: 116064|app: 0|req: 104/226] 10.222.0.49 () {58 vars in 1235 bytes} [Tue Dec 14 12:59:14 2021] GET /compute/v2.1/servers/60694e1e-d0cb-41c8-adf5-bdda49804385 => generated 1523 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 14 12:59:14.213326 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.api.openstack.wsgi [None req-98dfd472-e8b8-46f2-b573-b22b8194ec75 tempest-VolumesSnapshotTestJSON-1649574085 tempest-VolumesSnapshotTestJSON-1649574085-project] Calling method '>' {{(pid=116064) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 12:59:14.214782 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.compute.api [None req-98dfd472-e8b8-46f2-b573-b22b8194ec75 tempest-VolumesSnapshotTestJSON-1649574085 tempest-VolumesSnapshotTestJSON-1649574085-project] [instance: c48d3c23-3b4b-4220-8ead-d04a670ec64f] Fetching instance by UUID {{(pid=116064) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 12:59:14.221489 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-98dfd472-e8b8-46f2-b573-b22b8194ec75 tempest-VolumesSnapshotTestJSON-1649574085 tempest-VolumesSnapshotTestJSON-1649574085-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 12:59:14.222021 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-98dfd472-e8b8-46f2-b573-b22b8194ec75 tempest-VolumesSnapshotTestJSON-1649574085 tempest-VolumesSnapshotTestJSON-1649574085-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 12:59:14.222874 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-98dfd472-e8b8-46f2-b573-b22b8194ec75 tempest-VolumesSnapshotTestJSON-1649574085 tempest-VolumesSnapshotTestJSON-1649574085-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 12:59:14.223305 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-98dfd472-e8b8-46f2-b573-b22b8194ec75 tempest-VolumesSnapshotTestJSON-1649574085 tempest-VolumesSnapshotTestJSON-1649574085-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 12:59:14.282803 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.policy [None req-98dfd472-e8b8-46f2-b573-b22b8194ec75 tempest-VolumesSnapshotTestJSON-1649574085 tempest-VolumesSnapshotTestJSON-1649574085-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e18311fd2704616a778d36332f199ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1bf776f341b4721b28eb9a5c84ba866', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116064) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 12:59:14.291397 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: INFO nova.api.openstack.requestlog [None req-98dfd472-e8b8-46f2-b573-b22b8194ec75 tempest-VolumesSnapshotTestJSON-1649574085 tempest-VolumesSnapshotTestJSON-1649574085-project] 10.222.0.49 "GET /compute/v2.1/servers/c48d3c23-3b4b-4220-8ead-d04a670ec64f" status: 200 len: 1271 microversion: 2.1 time: 0.081780 Dec 14 12:59:14.291977 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: [pid: 116064|app: 0|req: 105/227] 10.222.0.49 () {58 vars in 1235 bytes} [Tue Dec 14 12:59:14 2021] GET /compute/v2.1/servers/c48d3c23-3b4b-4220-8ead-d04a670ec64f => generated 1271 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 14 12:59:14.296573 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.api.openstack.wsgi [None req-78883c2f-295e-47b1-9d8e-c77213810a22 tempest-AttachVolumeNegativeTest-1000400951 tempest-AttachVolumeNegativeTest-1000400951-project] Calling method '>' {{(pid=116064) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 12:59:14.297888 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.compute.api [None req-78883c2f-295e-47b1-9d8e-c77213810a22 tempest-AttachVolumeNegativeTest-1000400951 tempest-AttachVolumeNegativeTest-1000400951-project] [instance: 824eca5b-954f-402d-aa22-14f24ddd77ba] Fetching instance by UUID {{(pid=116064) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 12:59:14.304540 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-78883c2f-295e-47b1-9d8e-c77213810a22 tempest-AttachVolumeNegativeTest-1000400951 tempest-AttachVolumeNegativeTest-1000400951-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 12:59:14.305020 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-78883c2f-295e-47b1-9d8e-c77213810a22 tempest-AttachVolumeNegativeTest-1000400951 tempest-AttachVolumeNegativeTest-1000400951-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 12:59:14.305813 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-78883c2f-295e-47b1-9d8e-c77213810a22 tempest-AttachVolumeNegativeTest-1000400951 tempest-AttachVolumeNegativeTest-1000400951-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 12:59:14.306306 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-78883c2f-295e-47b1-9d8e-c77213810a22 tempest-AttachVolumeNegativeTest-1000400951 tempest-AttachVolumeNegativeTest-1000400951-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 12:59:14.337643 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: INFO nova.api.openstack.requestlog [None req-78883c2f-295e-47b1-9d8e-c77213810a22 tempest-AttachVolumeNegativeTest-1000400951 tempest-AttachVolumeNegativeTest-1000400951-project] 10.222.0.49 "GET /compute/v2.1/servers/824eca5b-954f-402d-aa22-14f24ddd77ba/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044402 Dec 14 12:59:14.338210 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: [pid: 116064|app: 0|req: 106/228] 10.222.0.49 () {58 vars in 1301 bytes} [Tue Dec 14 12:59:14 2021] GET /compute/v2.1/servers/824eca5b-954f-402d-aa22-14f24ddd77ba/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 14 12:59:14.345472 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: INFO nova.api.openstack.requestlog [None req-643cb32e-0e5b-4a6a-bfa8-8eb93bf9d3e3 tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] 10.222.0.49 "POST /compute/v2.1/servers/c8de7730-62f2-4a77-b1e9-cf6a74fa366d/action" status: 200 len: 24616 microversion: 2.20 time: 0.185338 Dec 14 12:59:14.346120 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: [pid: 116063|app: 0|req: 123/229] 10.222.0.49 () {62 vars in 1318 bytes} [Tue Dec 14 12:59:14 2021] POST /compute/v2.1/servers/c8de7730-62f2-4a77-b1e9-cf6a74fa366d/action => generated 24616 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 14 12:59:15.028865 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.api.openstack.wsgi [None req-8977bfd3-c661-4e61-824f-242c63fca003 tempest-VolumesActionsTest-648269150 tempest-VolumesActionsTest-648269150-project] Calling method '>' {{(pid=116064) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 12:59:15.029982 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.compute.api [None req-8977bfd3-c661-4e61-824f-242c63fca003 tempest-VolumesActionsTest-648269150 tempest-VolumesActionsTest-648269150-project] [instance: 7a410a38-0f6d-4e02-8db7-abd99e6a4fa1] Fetching instance by UUID {{(pid=116064) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 12:59:15.038309 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-8977bfd3-c661-4e61-824f-242c63fca003 tempest-VolumesActionsTest-648269150 tempest-VolumesActionsTest-648269150-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 12:59:15.039036 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-8977bfd3-c661-4e61-824f-242c63fca003 tempest-VolumesActionsTest-648269150 tempest-VolumesActionsTest-648269150-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 12:59:15.040228 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-8977bfd3-c661-4e61-824f-242c63fca003 tempest-VolumesActionsTest-648269150 tempest-VolumesActionsTest-648269150-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 12:59:15.040660 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-8977bfd3-c661-4e61-824f-242c63fca003 tempest-VolumesActionsTest-648269150 tempest-VolumesActionsTest-648269150-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 12:59:15.215381 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.policy [None req-8977bfd3-c661-4e61-824f-242c63fca003 tempest-VolumesActionsTest-648269150 tempest-VolumesActionsTest-648269150-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cc7290157ff4075b95ead815c2b332a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fa190426a6c4b9c9d6d259455a647ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116064) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 12:59:15.223979 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.api.openstack.wsgi [None req-0259bd26-8ec0-49e5-9b4b-aa3ca24a1171 tempest-ServerRescueNegativeTestJSON-1573931620 tempest-ServerRescueNegativeTestJSON-1573931620-project] Calling method '>' {{(pid=116063) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 12:59:15.226591 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.compute.api [None req-0259bd26-8ec0-49e5-9b4b-aa3ca24a1171 tempest-ServerRescueNegativeTestJSON-1573931620 tempest-ServerRescueNegativeTestJSON-1573931620-project] [instance: 60694e1e-d0cb-41c8-adf5-bdda49804385] Fetching instance by UUID {{(pid=116063) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 12:59:15.233130 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: INFO nova.api.openstack.requestlog [None req-8977bfd3-c661-4e61-824f-242c63fca003 tempest-VolumesActionsTest-648269150 tempest-VolumesActionsTest-648269150-project] 10.222.0.49 "GET /compute/v2.1/servers/7a410a38-0f6d-4e02-8db7-abd99e6a4fa1" status: 200 len: 1313 microversion: 2.1 time: 0.209435 Dec 14 12:59:15.238861 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: [pid: 116064|app: 0|req: 107/230] 10.222.0.49 () {58 vars in 1235 bytes} [Tue Dec 14 12:59:15 2021] GET /compute/v2.1/servers/7a410a38-0f6d-4e02-8db7-abd99e6a4fa1 => generated 1313 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 14 12:59:15.249598 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-0259bd26-8ec0-49e5-9b4b-aa3ca24a1171 tempest-ServerRescueNegativeTestJSON-1573931620 tempest-ServerRescueNegativeTestJSON-1573931620-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 12:59:15.250326 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-0259bd26-8ec0-49e5-9b4b-aa3ca24a1171 tempest-ServerRescueNegativeTestJSON-1573931620 tempest-ServerRescueNegativeTestJSON-1573931620-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 12:59:15.251413 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-0259bd26-8ec0-49e5-9b4b-aa3ca24a1171 tempest-ServerRescueNegativeTestJSON-1573931620 tempest-ServerRescueNegativeTestJSON-1573931620-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 12:59:15.251824 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-0259bd26-8ec0-49e5-9b4b-aa3ca24a1171 tempest-ServerRescueNegativeTestJSON-1573931620 tempest-ServerRescueNegativeTestJSON-1573931620-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 12:59:15.311830 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.api.openstack.wsgi [None req-1f26846c-db57-48b9-9ec8-42ecc4fe9e98 tempest-VolumesSnapshotTestJSON-1649574085 tempest-VolumesSnapshotTestJSON-1649574085-project] Calling method '>' {{(pid=116064) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 12:59:15.312594 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.compute.api [None req-1f26846c-db57-48b9-9ec8-42ecc4fe9e98 tempest-VolumesSnapshotTestJSON-1649574085 tempest-VolumesSnapshotTestJSON-1649574085-project] [instance: c48d3c23-3b4b-4220-8ead-d04a670ec64f] Fetching instance by UUID {{(pid=116064) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 12:59:15.321072 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-1f26846c-db57-48b9-9ec8-42ecc4fe9e98 tempest-VolumesSnapshotTestJSON-1649574085 tempest-VolumesSnapshotTestJSON-1649574085-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 12:59:15.321650 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-1f26846c-db57-48b9-9ec8-42ecc4fe9e98 tempest-VolumesSnapshotTestJSON-1649574085 tempest-VolumesSnapshotTestJSON-1649574085-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 12:59:15.322621 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-1f26846c-db57-48b9-9ec8-42ecc4fe9e98 tempest-VolumesSnapshotTestJSON-1649574085 tempest-VolumesSnapshotTestJSON-1649574085-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 12:59:15.323093 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-1f26846c-db57-48b9-9ec8-42ecc4fe9e98 tempest-VolumesSnapshotTestJSON-1649574085 tempest-VolumesSnapshotTestJSON-1649574085-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 12:59:15.550353 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.policy [None req-0259bd26-8ec0-49e5-9b4b-aa3ca24a1171 tempest-ServerRescueNegativeTestJSON-1573931620 tempest-ServerRescueNegativeTestJSON-1573931620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '731cbbfe17214ded8ac66299d66dfc45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '010919ea84eb4eb8b936c63153600eba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116063) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 12:59:15.559883 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: INFO nova.api.openstack.requestlog [None req-0259bd26-8ec0-49e5-9b4b-aa3ca24a1171 tempest-ServerRescueNegativeTestJSON-1573931620 tempest-ServerRescueNegativeTestJSON-1573931620-project] 10.222.0.49 "GET /compute/v2.1/servers/60694e1e-d0cb-41c8-adf5-bdda49804385" status: 200 len: 1523 microversion: 2.1 time: 0.340056 Dec 14 12:59:15.560737 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: [pid: 116063|app: 0|req: 124/231] 10.222.0.49 () {58 vars in 1235 bytes} [Tue Dec 14 12:59:15 2021] GET /compute/v2.1/servers/60694e1e-d0cb-41c8-adf5-bdda49804385 => generated 1523 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 14 12:59:15.565493 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.api.openstack.wsgi [None req-a8300483-ccb4-4931-8917-4327361e3d4b tempest-AttachVolumeNegativeTest-1000400951 tempest-AttachVolumeNegativeTest-1000400951-project] Calling method '>' {{(pid=116063) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 12:59:15.566717 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.compute.api [None req-a8300483-ccb4-4931-8917-4327361e3d4b tempest-AttachVolumeNegativeTest-1000400951 tempest-AttachVolumeNegativeTest-1000400951-project] [instance: 824eca5b-954f-402d-aa22-14f24ddd77ba] Fetching instance by UUID {{(pid=116063) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 12:59:15.573865 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-a8300483-ccb4-4931-8917-4327361e3d4b tempest-AttachVolumeNegativeTest-1000400951 tempest-AttachVolumeNegativeTest-1000400951-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 12:59:15.574306 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-a8300483-ccb4-4931-8917-4327361e3d4b tempest-AttachVolumeNegativeTest-1000400951 tempest-AttachVolumeNegativeTest-1000400951-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 12:59:15.575099 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-a8300483-ccb4-4931-8917-4327361e3d4b tempest-AttachVolumeNegativeTest-1000400951 tempest-AttachVolumeNegativeTest-1000400951-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 12:59:15.575528 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-a8300483-ccb4-4931-8917-4327361e3d4b tempest-AttachVolumeNegativeTest-1000400951 tempest-AttachVolumeNegativeTest-1000400951-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 12:59:15.592092 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.policy [None req-1f26846c-db57-48b9-9ec8-42ecc4fe9e98 tempest-VolumesSnapshotTestJSON-1649574085 tempest-VolumesSnapshotTestJSON-1649574085-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e18311fd2704616a778d36332f199ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1bf776f341b4721b28eb9a5c84ba866', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116064) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 12:59:15.600074 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: INFO nova.api.openstack.requestlog [None req-1f26846c-db57-48b9-9ec8-42ecc4fe9e98 tempest-VolumesSnapshotTestJSON-1649574085 tempest-VolumesSnapshotTestJSON-1649574085-project] 10.222.0.49 "GET /compute/v2.1/servers/c48d3c23-3b4b-4220-8ead-d04a670ec64f" status: 200 len: 1319 microversion: 2.1 time: 0.293626 Dec 14 12:59:15.601106 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: [pid: 116064|app: 0|req: 108/232] 10.222.0.49 () {58 vars in 1235 bytes} [Tue Dec 14 12:59:15 2021] GET /compute/v2.1/servers/c48d3c23-3b4b-4220-8ead-d04a670ec64f => generated 1319 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 14 12:59:15.607139 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.api.openstack.wsgi [None req-921285f7-66a1-4f78-b7bf-35af047c9858 tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116064) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 14 12:59:15.608318 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.compute.api [None req-921285f7-66a1-4f78-b7bf-35af047c9858 tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] [instance: c8de7730-62f2-4a77-b1e9-cf6a74fa366d] Fetching instance by UUID {{(pid=116064) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 12:59:15.615470 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-921285f7-66a1-4f78-b7bf-35af047c9858 tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 12:59:15.616058 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-921285f7-66a1-4f78-b7bf-35af047c9858 tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 12:59:15.616899 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-921285f7-66a1-4f78-b7bf-35af047c9858 tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 12:59:15.617654 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-921285f7-66a1-4f78-b7bf-35af047c9858 tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 12:59:15.625681 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: INFO nova.api.openstack.requestlog [None req-a8300483-ccb4-4931-8917-4327361e3d4b tempest-AttachVolumeNegativeTest-1000400951 tempest-AttachVolumeNegativeTest-1000400951-project] 10.222.0.49 "GET /compute/v2.1/servers/824eca5b-954f-402d-aa22-14f24ddd77ba/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.063677 Dec 14 12:59:15.626621 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: [pid: 116063|app: 0|req: 125/233] 10.222.0.49 () {58 vars in 1301 bytes} [Tue Dec 14 12:59:15 2021] GET /compute/v2.1/servers/824eca5b-954f-402d-aa22-14f24ddd77ba/os-volume_attachments => generated 25 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Dec 14 12:59:15.728542 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: INFO nova.api.openstack.requestlog [None req-921285f7-66a1-4f78-b7bf-35af047c9858 tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] 10.222.0.49 "POST /compute/v2.1/servers/c8de7730-62f2-4a77-b1e9-cf6a74fa366d/action" status: 200 len: 25290 microversion: 2.20 time: 0.125898 Dec 14 12:59:15.729845 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: [pid: 116064|app: 0|req: 109/234] 10.222.0.49 () {62 vars in 1318 bytes} [Tue Dec 14 12:59:15 2021] POST /compute/v2.1/servers/c8de7730-62f2-4a77-b1e9-cf6a74fa366d/action => generated 25290 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 14 12:59:15.792461 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.api.openstack.wsgi [None req-03c276aa-b538-4fee-a03e-a67e526209df tempest-AttachVolumeNegativeTest-1000400951 tempest-AttachVolumeNegativeTest-1000400951-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-227067648", "imageRef": "1733dcd4-5ded-44e1-8b8d-392adb05c67a", "flavorRef": "452", "networks": [{"uuid": "f9d231ae-628f-4043-969c-cf414631d868"}]}} {{(pid=116063) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 14 12:59:15.852317 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.network.neutron [None req-03c276aa-b538-4fee-a03e-a67e526209df tempest-AttachVolumeNegativeTest-1000400951 tempest-AttachVolumeNegativeTest-1000400951-project] validate_networks() for [('f9d231ae-628f-4043-969c-cf414631d868', None, None, None, None, None)] {{(pid=116063) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Dec 14 12:59:16.256083 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.api.openstack.wsgi [None req-57e952b2-ac31-4f07-a4dc-cc52cd158980 tempest-VolumesActionsTest-648269150 tempest-VolumesActionsTest-648269150-project] Calling method '>' {{(pid=116064) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 12:59:16.261478 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.compute.api [None req-57e952b2-ac31-4f07-a4dc-cc52cd158980 tempest-VolumesActionsTest-648269150 tempest-VolumesActionsTest-648269150-project] [instance: 7a410a38-0f6d-4e02-8db7-abd99e6a4fa1] Fetching instance by UUID {{(pid=116064) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 12:59:16.271733 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-57e952b2-ac31-4f07-a4dc-cc52cd158980 tempest-VolumesActionsTest-648269150 tempest-VolumesActionsTest-648269150-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 12:59:16.273038 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-57e952b2-ac31-4f07-a4dc-cc52cd158980 tempest-VolumesActionsTest-648269150 tempest-VolumesActionsTest-648269150-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 12:59:16.274508 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-57e952b2-ac31-4f07-a4dc-cc52cd158980 tempest-VolumesActionsTest-648269150 tempest-VolumesActionsTest-648269150-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 12:59:16.275494 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-57e952b2-ac31-4f07-a4dc-cc52cd158980 tempest-VolumesActionsTest-648269150 tempest-VolumesActionsTest-648269150-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 12:59:16.328234 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.virt.hardware [None req-03c276aa-b538-4fee-a03e-a67e526209df tempest-AttachVolumeNegativeTest-1000400951 tempest-AttachVolumeNegativeTest-1000400951-project] Flavor limits 0:0:0 {{(pid=116063) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Dec 14 12:59:16.328735 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.virt.hardware [None req-03c276aa-b538-4fee-a03e-a67e526209df tempest-AttachVolumeNegativeTest-1000400951 tempest-AttachVolumeNegativeTest-1000400951-project] Image limits 0:0:0 {{(pid=116063) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Dec 14 12:59:16.329138 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.virt.hardware [None req-03c276aa-b538-4fee-a03e-a67e526209df tempest-AttachVolumeNegativeTest-1000400951 tempest-AttachVolumeNegativeTest-1000400951-project] Flavor pref 0:0:0 {{(pid=116063) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Dec 14 12:59:16.329538 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.virt.hardware [None req-03c276aa-b538-4fee-a03e-a67e526209df tempest-AttachVolumeNegativeTest-1000400951 tempest-AttachVolumeNegativeTest-1000400951-project] Image pref 0:0:0 {{(pid=116063) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Dec 14 12:59:16.329946 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.virt.hardware [None req-03c276aa-b538-4fee-a03e-a67e526209df tempest-AttachVolumeNegativeTest-1000400951 tempest-AttachVolumeNegativeTest-1000400951-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=116063) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Dec 14 12:59:16.357842 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-03c276aa-b538-4fee-a03e-a67e526209df tempest-AttachVolumeNegativeTest-1000400951 tempest-AttachVolumeNegativeTest-1000400951-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 12:59:16.358286 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-03c276aa-b538-4fee-a03e-a67e526209df tempest-AttachVolumeNegativeTest-1000400951 tempest-AttachVolumeNegativeTest-1000400951-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 12:59:16.360280 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-03c276aa-b538-4fee-a03e-a67e526209df tempest-AttachVolumeNegativeTest-1000400951 tempest-AttachVolumeNegativeTest-1000400951-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 12:59:16.361872 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-03c276aa-b538-4fee-a03e-a67e526209df tempest-AttachVolumeNegativeTest-1000400951 tempest-AttachVolumeNegativeTest-1000400951-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 12:59:16.417231 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.quota [None req-03c276aa-b538-4fee-a03e-a67e526209df tempest-AttachVolumeNegativeTest-1000400951 tempest-AttachVolumeNegativeTest-1000400951-project] Getting quotas for project ad27b8951cae4eeeafa257f45217653a. Resources: {'cores', 'instances', 'ram'} {{(pid=116063) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 14 12:59:16.423441 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.quota [None req-03c276aa-b538-4fee-a03e-a67e526209df tempest-AttachVolumeNegativeTest-1000400951 tempest-AttachVolumeNegativeTest-1000400951-project] Getting quotas for user 57d0ec01f0784c8ea87d339980bed3cf and project ad27b8951cae4eeeafa257f45217653a. Resources: {'cores', 'instances', 'ram'} {{(pid=116063) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 14 12:59:16.437035 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.compute.api [None req-03c276aa-b538-4fee-a03e-a67e526209df tempest-AttachVolumeNegativeTest-1000400951 tempest-AttachVolumeNegativeTest-1000400951-project] Going to run 1 instances... {{(pid=116063) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Dec 14 12:59:16.440577 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.compute.api [None req-03c276aa-b538-4fee-a03e-a67e526209df tempest-AttachVolumeNegativeTest-1000400951 tempest-AttachVolumeNegativeTest-1000400951-project] [instance: 8d264701-aaa0-465f-a4aa-0cffa41351ef] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='1733dcd4-5ded-44e1-8b8d-392adb05c67a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=116063) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Dec 14 12:59:16.532933 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: INFO nova.api.openstack.requestlog [None req-03c276aa-b538-4fee-a03e-a67e526209df tempest-AttachVolumeNegativeTest-1000400951 tempest-AttachVolumeNegativeTest-1000400951-project] 10.222.0.49 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.744650 Dec 14 12:59:16.536231 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: [pid: 116063|app: 0|req: 126/235] 10.222.0.49 () {60 vars in 1146 bytes} [Tue Dec 14 12:59:15 2021] POST /compute/v2.1/servers => generated 380 bytes in 749 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Dec 14 12:59:16.539050 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.policy [None req-57e952b2-ac31-4f07-a4dc-cc52cd158980 tempest-VolumesActionsTest-648269150 tempest-VolumesActionsTest-648269150-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cc7290157ff4075b95ead815c2b332a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fa190426a6c4b9c9d6d259455a647ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116064) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 12:59:16.546884 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: INFO nova.api.openstack.requestlog [None req-57e952b2-ac31-4f07-a4dc-cc52cd158980 tempest-VolumesActionsTest-648269150 tempest-VolumesActionsTest-648269150-project] 10.222.0.49 "GET /compute/v2.1/servers/7a410a38-0f6d-4e02-8db7-abd99e6a4fa1" status: 200 len: 1313 microversion: 2.1 time: 0.294893 Dec 14 12:59:16.549046 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: [pid: 116064|app: 0|req: 110/236] 10.222.0.49 () {58 vars in 1235 bytes} [Tue Dec 14 12:59:16 2021] GET /compute/v2.1/servers/7a410a38-0f6d-4e02-8db7-abd99e6a4fa1 => generated 1313 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 14 12:59:16.553959 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.api.openstack.wsgi [None req-234d7fa2-c5b7-4699-a751-8ab9ae283df0 tempest-AttachVolumeNegativeTest-1000400951 tempest-AttachVolumeNegativeTest-1000400951-project] Calling method '>' {{(pid=116063) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 12:59:16.555616 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.compute.api [None req-234d7fa2-c5b7-4699-a751-8ab9ae283df0 tempest-AttachVolumeNegativeTest-1000400951 tempest-AttachVolumeNegativeTest-1000400951-project] [instance: 8d264701-aaa0-465f-a4aa-0cffa41351ef] Fetching instance by UUID {{(pid=116063) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 12:59:16.577652 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.api.openstack.wsgi [None req-ab27d2fe-bdc5-412c-9440-1253dae57805 tempest-ServerRescueNegativeTestJSON-1573931620 tempest-ServerRescueNegativeTestJSON-1573931620-project] Calling method '>' {{(pid=116064) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 12:59:16.578294 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.compute.api [None req-ab27d2fe-bdc5-412c-9440-1253dae57805 tempest-ServerRescueNegativeTestJSON-1573931620 tempest-ServerRescueNegativeTestJSON-1573931620-project] [instance: 60694e1e-d0cb-41c8-adf5-bdda49804385] Fetching instance by UUID {{(pid=116064) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 12:59:16.595027 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-ab27d2fe-bdc5-412c-9440-1253dae57805 tempest-ServerRescueNegativeTestJSON-1573931620 tempest-ServerRescueNegativeTestJSON-1573931620-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 12:59:16.603089 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-ab27d2fe-bdc5-412c-9440-1253dae57805 tempest-ServerRescueNegativeTestJSON-1573931620 tempest-ServerRescueNegativeTestJSON-1573931620-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 12:59:16.605327 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-ab27d2fe-bdc5-412c-9440-1253dae57805 tempest-ServerRescueNegativeTestJSON-1573931620 tempest-ServerRescueNegativeTestJSON-1573931620-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 12:59:16.609267 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-ab27d2fe-bdc5-412c-9440-1253dae57805 tempest-ServerRescueNegativeTestJSON-1573931620 tempest-ServerRescueNegativeTestJSON-1573931620-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 12:59:16.662273 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.policy [None req-234d7fa2-c5b7-4699-a751-8ab9ae283df0 tempest-AttachVolumeNegativeTest-1000400951 tempest-AttachVolumeNegativeTest-1000400951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57d0ec01f0784c8ea87d339980bed3cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad27b8951cae4eeeafa257f45217653a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116063) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 12:59:16.674345 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: INFO nova.api.openstack.requestlog [None req-234d7fa2-c5b7-4699-a751-8ab9ae283df0 tempest-AttachVolumeNegativeTest-1000400951 tempest-AttachVolumeNegativeTest-1000400951-project] 10.222.0.49 "GET /compute/v2.1/servers/8d264701-aaa0-465f-a4aa-0cffa41351ef" status: 200 len: 1217 microversion: 2.1 time: 0.127396 Dec 14 12:59:16.675218 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: [pid: 116063|app: 0|req: 127/237] 10.222.0.49 () {58 vars in 1235 bytes} [Tue Dec 14 12:59:16 2021] GET /compute/v2.1/servers/8d264701-aaa0-465f-a4aa-0cffa41351ef => generated 1217 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 14 12:59:16.681605 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.api.openstack.wsgi [None req-18b97862-1035-40f6-aa4f-84cb4687f38c tempest-VolumesSnapshotTestJSON-1649574085 tempest-VolumesSnapshotTestJSON-1649574085-project] Calling method '>' {{(pid=116063) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 12:59:16.682391 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.compute.api [None req-18b97862-1035-40f6-aa4f-84cb4687f38c tempest-VolumesSnapshotTestJSON-1649574085 tempest-VolumesSnapshotTestJSON-1649574085-project] [instance: c48d3c23-3b4b-4220-8ead-d04a670ec64f] Fetching instance by UUID {{(pid=116063) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 12:59:16.712352 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-18b97862-1035-40f6-aa4f-84cb4687f38c tempest-VolumesSnapshotTestJSON-1649574085 tempest-VolumesSnapshotTestJSON-1649574085-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 12:59:16.724017 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-18b97862-1035-40f6-aa4f-84cb4687f38c tempest-VolumesSnapshotTestJSON-1649574085 tempest-VolumesSnapshotTestJSON-1649574085-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 12:59:16.726132 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-18b97862-1035-40f6-aa4f-84cb4687f38c tempest-VolumesSnapshotTestJSON-1649574085 tempest-VolumesSnapshotTestJSON-1649574085-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 12:59:16.727663 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-18b97862-1035-40f6-aa4f-84cb4687f38c tempest-VolumesSnapshotTestJSON-1649574085 tempest-VolumesSnapshotTestJSON-1649574085-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 12:59:17.006935 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.policy [None req-ab27d2fe-bdc5-412c-9440-1253dae57805 tempest-ServerRescueNegativeTestJSON-1573931620 tempest-ServerRescueNegativeTestJSON-1573931620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '731cbbfe17214ded8ac66299d66dfc45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '010919ea84eb4eb8b936c63153600eba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116064) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 12:59:17.017959 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: INFO nova.api.openstack.requestlog [None req-ab27d2fe-bdc5-412c-9440-1253dae57805 tempest-ServerRescueNegativeTestJSON-1573931620 tempest-ServerRescueNegativeTestJSON-1573931620-project] 10.222.0.49 "GET /compute/v2.1/servers/60694e1e-d0cb-41c8-adf5-bdda49804385" status: 200 len: 1523 microversion: 2.1 time: 0.444188 Dec 14 12:59:17.020033 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: [pid: 116064|app: 0|req: 111/238] 10.222.0.49 () {58 vars in 1235 bytes} [Tue Dec 14 12:59:16 2021] GET /compute/v2.1/servers/60694e1e-d0cb-41c8-adf5-bdda49804385 => generated 1523 bytes in 447 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 14 12:59:17.024392 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.api.openstack.wsgi [req-635bcbcb-2a40-4e44-b1cc-fabb1fdf8f64 req-fe7301dd-c14f-49a6-84bf-0a40bf5db61c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c48d3c23-3b4b-4220-8ead-d04a670ec64f", "tag": "c342614d-9975-4aaa-a444-6e5c731f8f7a"}]} {{(pid=116064) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 14 12:59:17.026459 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 14 12:59:17.026459 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: warnings.warn(msg) Dec 14 12:59:17.035704 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [req-635bcbcb-2a40-4e44-b1cc-fabb1fdf8f64 req-fe7301dd-c14f-49a6-84bf-0a40bf5db61c service nova] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 12:59:17.036370 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [req-635bcbcb-2a40-4e44-b1cc-fabb1fdf8f64 req-fe7301dd-c14f-49a6-84bf-0a40bf5db61c service nova] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 12:59:17.056746 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: INFO nova.api.openstack.compute.server_external_events [req-635bcbcb-2a40-4e44-b1cc-fabb1fdf8f64 req-fe7301dd-c14f-49a6-84bf-0a40bf5db61c service nova] Creating event network-changed:c342614d-9975-4aaa-a444-6e5c731f8f7a for instance c48d3c23-3b4b-4220-8ead-d04a670ec64f on hv-cinder-78447 Dec 14 12:59:17.063293 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: INFO nova.api.openstack.requestlog [req-635bcbcb-2a40-4e44-b1cc-fabb1fdf8f64 req-fe7301dd-c14f-49a6-84bf-0a40bf5db61c service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042013 Dec 14 12:59:17.064471 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: [pid: 116064|app: 0|req: 112/239] 10.222.0.49 () {64 vars in 1317 bytes} [Tue Dec 14 12:59:17 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 14 12:59:17.071890 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.api.openstack.wsgi [None req-c8b45696-84ce-4ed3-98bc-317674fb1baf tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116064) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 14 12:59:17.073091 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.compute.api [None req-c8b45696-84ce-4ed3-98bc-317674fb1baf tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] [instance: c8de7730-62f2-4a77-b1e9-cf6a74fa366d] Fetching instance by UUID {{(pid=116064) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 12:59:17.084739 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-c8b45696-84ce-4ed3-98bc-317674fb1baf tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 12:59:17.085440 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-c8b45696-84ce-4ed3-98bc-317674fb1baf tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 12:59:17.086464 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-c8b45696-84ce-4ed3-98bc-317674fb1baf tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 12:59:17.087113 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-c8b45696-84ce-4ed3-98bc-317674fb1baf tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 12:59:17.123192 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.policy [None req-18b97862-1035-40f6-aa4f-84cb4687f38c tempest-VolumesSnapshotTestJSON-1649574085 tempest-VolumesSnapshotTestJSON-1649574085-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e18311fd2704616a778d36332f199ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1bf776f341b4721b28eb9a5c84ba866', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116063) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 12:59:17.131108 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: INFO nova.api.openstack.requestlog [None req-18b97862-1035-40f6-aa4f-84cb4687f38c tempest-VolumesSnapshotTestJSON-1649574085 tempest-VolumesSnapshotTestJSON-1649574085-project] 10.222.0.49 "GET /compute/v2.1/servers/c48d3c23-3b4b-4220-8ead-d04a670ec64f" status: 200 len: 1319 microversion: 2.1 time: 0.454406 Dec 14 12:59:17.133244 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: [pid: 116063|app: 0|req: 128/240] 10.222.0.49 () {58 vars in 1235 bytes} [Tue Dec 14 12:59:16 2021] GET /compute/v2.1/servers/c48d3c23-3b4b-4220-8ead-d04a670ec64f => generated 1319 bytes in 457 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 14 12:59:17.208453 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: INFO nova.api.openstack.requestlog [None req-c8b45696-84ce-4ed3-98bc-317674fb1baf tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] 10.222.0.49 "POST /compute/v2.1/servers/c8de7730-62f2-4a77-b1e9-cf6a74fa366d/action" status: 200 len: 26447 microversion: 2.20 time: 0.141881 Dec 14 12:59:17.209296 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: [pid: 116064|app: 0|req: 113/241] 10.222.0.49 () {62 vars in 1318 bytes} [Tue Dec 14 12:59:17 2021] POST /compute/v2.1/servers/c8de7730-62f2-4a77-b1e9-cf6a74fa366d/action => generated 26447 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 14 12:59:17.346523 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.api.openstack.wsgi [None req-c0903f16-feae-48c3-8203-af391b72e49b tempest-VolumesNegativeTest-1150733706 tempest-VolumesNegativeTest-1150733706-project] Action: 'create', calling method: .version_select at 0x7f2acdcbe670>, body: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-2016934709", "metadata": {"Type": "work"}}} {{(pid=116063) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 14 12:59:17.348612 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.api.openstack.wsgi [None req-c0903f16-feae-48c3-8203-af391b72e49b tempest-VolumesNegativeTest-1150733706 tempest-VolumesNegativeTest-1150733706-project] Returning 400 to user: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' {{(pid=116063) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 14 12:59:17.349467 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: INFO nova.api.openstack.requestlog [None req-c0903f16-feae-48c3-8203-af391b72e49b tempest-VolumesNegativeTest-1150733706 tempest-VolumesNegativeTest-1150733706-project] 10.222.0.49 "POST /compute/v2.1/os-volumes" status: 400 len: 127 microversion: 2.1 time: 0.214982 Dec 14 12:59:17.350005 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: [pid: 116063|app: 0|req: 129/242] 10.222.0.49 () {60 vars in 1155 bytes} [Tue Dec 14 12:59:17 2021] POST /compute/v2.1/os-volumes => generated 127 bytes in 216 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Dec 14 12:59:17.360261 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.api.openstack.wsgi [None req-d250a7d5-cbb5-411d-bafa-84b0c64ddc82 tempest-VolumesNegativeTest-1150733706 tempest-VolumesNegativeTest-1150733706-project] Action: 'create', calling method: .version_select at 0x7f2ace570ca0>, body: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-410613987", "metadata": {"Type": "work"}}} {{(pid=116064) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 14 12:59:17.361888 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.api.openstack.wsgi [None req-d250a7d5-cbb5-411d-bafa-84b0c64ddc82 tempest-VolumesNegativeTest-1150733706 tempest-VolumesNegativeTest-1150733706-project] Returning 400 to user: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 {{(pid=116064) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 14 12:59:17.362750 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: INFO nova.api.openstack.requestlog [None req-d250a7d5-cbb5-411d-bafa-84b0c64ddc82 tempest-VolumesNegativeTest-1150733706 tempest-VolumesNegativeTest-1150733706-project] 10.222.0.49 "POST /compute/v2.1/os-volumes" status: 400 len: 125 microversion: 2.1 time: 0.006842 Dec 14 12:59:17.363284 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: [pid: 116064|app: 0|req: 114/243] 10.222.0.49 () {60 vars in 1155 bytes} [Tue Dec 14 12:59:17 2021] POST /compute/v2.1/os-volumes => generated 125 bytes in 8 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Dec 14 12:59:17.372458 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.api.openstack.wsgi [None req-5cb641ff-0844-4e25-b2d6-5d742d8171b9 tempest-VolumesNegativeTest-1150733706 tempest-VolumesNegativeTest-1150733706-project] Action: 'create', calling method: .version_select at 0x7f2acdca9430>, body: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-1891040089", "metadata": {"Type": "work"}}} {{(pid=116063) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 14 12:59:17.373659 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.api.openstack.wsgi [None req-5cb641ff-0844-4e25-b2d6-5d742d8171b9 tempest-VolumesNegativeTest-1150733706 tempest-VolumesNegativeTest-1150733706-project] Returning 400 to user: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' {{(pid=116063) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 14 12:59:17.374450 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: INFO nova.api.openstack.requestlog [None req-5cb641ff-0844-4e25-b2d6-5d742d8171b9 tempest-VolumesNegativeTest-1150733706 tempest-VolumesNegativeTest-1150733706-project] 10.222.0.49 "POST /compute/v2.1/os-volumes" status: 400 len: 121 microversion: 2.1 time: 0.005822 Dec 14 12:59:17.374976 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: [pid: 116063|app: 0|req: 130/244] 10.222.0.49 () {60 vars in 1155 bytes} [Tue Dec 14 12:59:17 2021] POST /compute/v2.1/os-volumes => generated 121 bytes in 7 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Dec 14 12:59:17.384951 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.api.openstack.wsgi [None req-3332a6fd-04a2-40d9-a122-c3eef471f34b tempest-VolumesNegativeTest-1150733706 tempest-VolumesNegativeTest-1150733706-project] Calling method '.version_select at 0x7f2ace589af0>' {{(pid=116064) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 12:59:17.440376 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: INFO nova.api.openstack.wsgi [None req-3332a6fd-04a2-40d9-a122-c3eef471f34b tempest-VolumesNegativeTest-1150733706 tempest-VolumesNegativeTest-1150733706-project] HTTP exception thrown: Volume tempest-invalid-2081148977 could not be found. Dec 14 12:59:17.441224 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.api.openstack.wsgi [None req-3332a6fd-04a2-40d9-a122-c3eef471f34b tempest-VolumesNegativeTest-1150733706 tempest-VolumesNegativeTest-1150733706-project] Returning 404 to user: Volume tempest-invalid-2081148977 could not be found. {{(pid=116064) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 14 12:59:17.442195 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: INFO nova.api.openstack.requestlog [None req-3332a6fd-04a2-40d9-a122-c3eef471f34b tempest-VolumesNegativeTest-1150733706 tempest-VolumesNegativeTest-1150733706-project] 10.222.0.49 "DELETE /compute/v2.1/os-volumes/tempest-invalid-2081148977" status: 404 len: 99 microversion: 2.1 time: 0.061659 Dec 14 12:59:17.446030 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: [pid: 116064|app: 0|req: 115/245] 10.222.0.49 () {58 vars in 1217 bytes} [Tue Dec 14 12:59:17 2021] DELETE /compute/v2.1/os-volumes/tempest-invalid-2081148977 => generated 99 bytes in 66 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Dec 14 12:59:17.458488 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: INFO nova.api.openstack.requestlog [None req-0fdeeb46-4c59-4860-b451-7b68b094eccb tempest-VolumesNegativeTest-1150733706 tempest-VolumesNegativeTest-1150733706-project] 10.222.0.49 "DELETE /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.004270 Dec 14 12:59:17.459021 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: [pid: 116063|app: 0|req: 131/246] 10.222.0.49 () {58 vars in 1139 bytes} [Tue Dec 14 12:59:17 2021] DELETE /compute/v2.1/os-volumes/ => generated 112 bytes in 6 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Dec 14 12:59:17.468922 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: INFO nova.api.openstack.requestlog [None req-0cb5f5eb-7966-4b6f-84ff-4f6cfb28c0b4 tempest-VolumesNegativeTest-1150733706 tempest-VolumesNegativeTest-1150733706-project] 10.222.0.49 "GET /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.004717 Dec 14 12:59:17.478862 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.api.openstack.wsgi [None req-a3da81d3-135b-4605-bfd0-7eb93374d6da tempest-VolumesNegativeTest-1150733706 tempest-VolumesNegativeTest-1150733706-project] Calling method '.version_select at 0x7f2acf8e99d0>' {{(pid=116063) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 12:59:17.479115 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: [pid: 116064|app: 0|req: 116/247] 10.222.0.49 () {58 vars in 1136 bytes} [Tue Dec 14 12:59:17 2021] GET /compute/v2.1/os-volumes/ => generated 112 bytes in 10 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Dec 14 12:59:17.522217 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: INFO nova.api.openstack.wsgi [None req-a3da81d3-135b-4605-bfd0-7eb93374d6da tempest-VolumesNegativeTest-1150733706 tempest-VolumesNegativeTest-1150733706-project] HTTP exception thrown: Volume b870b9b4-ea67-4de8-8034-4e419fedd19a could not be found. Dec 14 12:59:17.522839 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.api.openstack.wsgi [None req-a3da81d3-135b-4605-bfd0-7eb93374d6da tempest-VolumesNegativeTest-1150733706 tempest-VolumesNegativeTest-1150733706-project] Returning 404 to user: Volume b870b9b4-ea67-4de8-8034-4e419fedd19a could not be found. {{(pid=116063) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 14 12:59:17.523677 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: INFO nova.api.openstack.requestlog [None req-a3da81d3-135b-4605-bfd0-7eb93374d6da tempest-VolumesNegativeTest-1150733706 tempest-VolumesNegativeTest-1150733706-project] 10.222.0.49 "DELETE /compute/v2.1/os-volumes/b870b9b4-ea67-4de8-8034-4e419fedd19a" status: 404 len: 109 microversion: 2.1 time: 0.048507 Dec 14 12:59:17.525719 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: [pid: 116063|app: 0|req: 132/248] 10.222.0.49 () {58 vars in 1247 bytes} [Tue Dec 14 12:59:17 2021] DELETE /compute/v2.1/os-volumes/b870b9b4-ea67-4de8-8034-4e419fedd19a => generated 109 bytes in 51 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Dec 14 12:59:17.537119 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.api.openstack.wsgi [None req-4dff24cf-7293-415a-a1e5-02928ce20294 tempest-VolumesNegativeTest-1150733706 tempest-VolumesNegativeTest-1150733706-project] Calling method '.version_select at 0x7f2ace4d05e0>' {{(pid=116064) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 12:59:17.565936 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.api.openstack.wsgi [None req-1b7c9818-7b79-4eae-a61c-183045226a20 tempest-VolumesActionsTest-648269150 tempest-VolumesActionsTest-648269150-project] Calling method '>' {{(pid=116063) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 12:59:17.566709 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.compute.api [None req-1b7c9818-7b79-4eae-a61c-183045226a20 tempest-VolumesActionsTest-648269150 tempest-VolumesActionsTest-648269150-project] [instance: 7a410a38-0f6d-4e02-8db7-abd99e6a4fa1] Fetching instance by UUID {{(pid=116063) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 12:59:17.584633 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-1b7c9818-7b79-4eae-a61c-183045226a20 tempest-VolumesActionsTest-648269150 tempest-VolumesActionsTest-648269150-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 12:59:17.587126 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-1b7c9818-7b79-4eae-a61c-183045226a20 tempest-VolumesActionsTest-648269150 tempest-VolumesActionsTest-648269150-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 12:59:17.588698 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-1b7c9818-7b79-4eae-a61c-183045226a20 tempest-VolumesActionsTest-648269150 tempest-VolumesActionsTest-648269150-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 12:59:17.588698 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-1b7c9818-7b79-4eae-a61c-183045226a20 tempest-VolumesActionsTest-648269150 tempest-VolumesActionsTest-648269150-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 12:59:17.612560 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: INFO nova.api.openstack.wsgi [None req-4dff24cf-7293-415a-a1e5-02928ce20294 tempest-VolumesNegativeTest-1150733706 tempest-VolumesNegativeTest-1150733706-project] HTTP exception thrown: Volume b2bdb70b-8777-4c93-bfcc-9ff889a02eb2 could not be found. Dec 14 12:59:17.613342 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.api.openstack.wsgi [None req-4dff24cf-7293-415a-a1e5-02928ce20294 tempest-VolumesNegativeTest-1150733706 tempest-VolumesNegativeTest-1150733706-project] Returning 404 to user: Volume b2bdb70b-8777-4c93-bfcc-9ff889a02eb2 could not be found. {{(pid=116064) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 14 12:59:17.614384 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: INFO nova.api.openstack.requestlog [None req-4dff24cf-7293-415a-a1e5-02928ce20294 tempest-VolumesNegativeTest-1150733706 tempest-VolumesNegativeTest-1150733706-project] 10.222.0.49 "GET /compute/v2.1/os-volumes/b2bdb70b-8777-4c93-bfcc-9ff889a02eb2" status: 404 len: 109 microversion: 2.1 time: 0.083164 Dec 14 12:59:17.621004 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: [pid: 116064|app: 0|req: 117/249] 10.222.0.49 () {58 vars in 1244 bytes} [Tue Dec 14 12:59:17 2021] GET /compute/v2.1/os-volumes/b2bdb70b-8777-4c93-bfcc-9ff889a02eb2 => generated 109 bytes in 91 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Dec 14 12:59:17.692127 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.api.openstack.wsgi [None req-2eb8909b-9ea3-4d4c-8654-78d4506b6f6a tempest-AttachVolumeNegativeTest-1000400951 tempest-AttachVolumeNegativeTest-1000400951-project] Calling method '>' {{(pid=116064) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 12:59:17.692836 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.compute.api [None req-2eb8909b-9ea3-4d4c-8654-78d4506b6f6a tempest-AttachVolumeNegativeTest-1000400951 tempest-AttachVolumeNegativeTest-1000400951-project] [instance: 8d264701-aaa0-465f-a4aa-0cffa41351ef] Fetching instance by UUID {{(pid=116064) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 12:59:17.700561 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-2eb8909b-9ea3-4d4c-8654-78d4506b6f6a tempest-AttachVolumeNegativeTest-1000400951 tempest-AttachVolumeNegativeTest-1000400951-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 12:59:17.701044 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-2eb8909b-9ea3-4d4c-8654-78d4506b6f6a tempest-AttachVolumeNegativeTest-1000400951 tempest-AttachVolumeNegativeTest-1000400951-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 12:59:17.702113 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-2eb8909b-9ea3-4d4c-8654-78d4506b6f6a tempest-AttachVolumeNegativeTest-1000400951 tempest-AttachVolumeNegativeTest-1000400951-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 12:59:17.702816 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-2eb8909b-9ea3-4d4c-8654-78d4506b6f6a tempest-AttachVolumeNegativeTest-1000400951 tempest-AttachVolumeNegativeTest-1000400951-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 12:59:17.783470 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.policy [None req-2eb8909b-9ea3-4d4c-8654-78d4506b6f6a tempest-AttachVolumeNegativeTest-1000400951 tempest-AttachVolumeNegativeTest-1000400951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57d0ec01f0784c8ea87d339980bed3cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad27b8951cae4eeeafa257f45217653a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116064) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 12:59:17.795807 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: INFO nova.api.openstack.requestlog [None req-2eb8909b-9ea3-4d4c-8654-78d4506b6f6a tempest-AttachVolumeNegativeTest-1000400951 tempest-AttachVolumeNegativeTest-1000400951-project] 10.222.0.49 "GET /compute/v2.1/servers/8d264701-aaa0-465f-a4aa-0cffa41351ef" status: 200 len: 1269 microversion: 2.1 time: 0.107593 Dec 14 12:59:17.809783 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: [pid: 116064|app: 0|req: 118/250] 10.222.0.49 () {58 vars in 1235 bytes} [Tue Dec 14 12:59:17 2021] GET /compute/v2.1/servers/8d264701-aaa0-465f-a4aa-0cffa41351ef => generated 1269 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 14 12:59:17.813659 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.policy [None req-1b7c9818-7b79-4eae-a61c-183045226a20 tempest-VolumesActionsTest-648269150 tempest-VolumesActionsTest-648269150-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cc7290157ff4075b95ead815c2b332a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fa190426a6c4b9c9d6d259455a647ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116063) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 12:59:17.822727 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: INFO nova.api.openstack.requestlog [None req-1b7c9818-7b79-4eae-a61c-183045226a20 tempest-VolumesActionsTest-648269150 tempest-VolumesActionsTest-648269150-project] 10.222.0.49 "GET /compute/v2.1/servers/7a410a38-0f6d-4e02-8db7-abd99e6a4fa1" status: 200 len: 1313 microversion: 2.1 time: 0.261606 Dec 14 12:59:17.823302 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: [pid: 116063|app: 0|req: 133/251] 10.222.0.49 () {58 vars in 1235 bytes} [Tue Dec 14 12:59:17 2021] GET /compute/v2.1/servers/7a410a38-0f6d-4e02-8db7-abd99e6a4fa1 => generated 1313 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 14 12:59:18.036180 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.api.openstack.wsgi [None req-2cb1d4e6-9f70-4132-9640-92ebcf5ca1d5 tempest-ServerRescueNegativeTestJSON-1573931620 tempest-ServerRescueNegativeTestJSON-1573931620-project] Calling method '>' {{(pid=116064) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 12:59:18.037183 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.compute.api [None req-2cb1d4e6-9f70-4132-9640-92ebcf5ca1d5 tempest-ServerRescueNegativeTestJSON-1573931620 tempest-ServerRescueNegativeTestJSON-1573931620-project] [instance: 60694e1e-d0cb-41c8-adf5-bdda49804385] Fetching instance by UUID {{(pid=116064) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 12:59:18.045331 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-2cb1d4e6-9f70-4132-9640-92ebcf5ca1d5 tempest-ServerRescueNegativeTestJSON-1573931620 tempest-ServerRescueNegativeTestJSON-1573931620-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 12:59:18.045981 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-2cb1d4e6-9f70-4132-9640-92ebcf5ca1d5 tempest-ServerRescueNegativeTestJSON-1573931620 tempest-ServerRescueNegativeTestJSON-1573931620-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 12:59:18.062002 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-2cb1d4e6-9f70-4132-9640-92ebcf5ca1d5 tempest-ServerRescueNegativeTestJSON-1573931620 tempest-ServerRescueNegativeTestJSON-1573931620-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 12:59:18.062957 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-2cb1d4e6-9f70-4132-9640-92ebcf5ca1d5 tempest-ServerRescueNegativeTestJSON-1573931620 tempest-ServerRescueNegativeTestJSON-1573931620-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 12:59:18.150453 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.api.openstack.wsgi [None req-685de348-c8fb-4728-8da5-0e9ac4e2a1b2 tempest-VolumesSnapshotTestJSON-1649574085 tempest-VolumesSnapshotTestJSON-1649574085-project] Calling method '>' {{(pid=116063) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 12:59:18.151149 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.compute.api [None req-685de348-c8fb-4728-8da5-0e9ac4e2a1b2 tempest-VolumesSnapshotTestJSON-1649574085 tempest-VolumesSnapshotTestJSON-1649574085-project] [instance: c48d3c23-3b4b-4220-8ead-d04a670ec64f] Fetching instance by UUID {{(pid=116063) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 12:59:18.160019 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-685de348-c8fb-4728-8da5-0e9ac4e2a1b2 tempest-VolumesSnapshotTestJSON-1649574085 tempest-VolumesSnapshotTestJSON-1649574085-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 12:59:18.162133 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-685de348-c8fb-4728-8da5-0e9ac4e2a1b2 tempest-VolumesSnapshotTestJSON-1649574085 tempest-VolumesSnapshotTestJSON-1649574085-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 12:59:18.164117 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-685de348-c8fb-4728-8da5-0e9ac4e2a1b2 tempest-VolumesSnapshotTestJSON-1649574085 tempest-VolumesSnapshotTestJSON-1649574085-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 12:59:18.171304 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-685de348-c8fb-4728-8da5-0e9ac4e2a1b2 tempest-VolumesSnapshotTestJSON-1649574085 tempest-VolumesSnapshotTestJSON-1649574085-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 12:59:18.477850 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.policy [None req-2cb1d4e6-9f70-4132-9640-92ebcf5ca1d5 tempest-ServerRescueNegativeTestJSON-1573931620 tempest-ServerRescueNegativeTestJSON-1573931620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '731cbbfe17214ded8ac66299d66dfc45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '010919ea84eb4eb8b936c63153600eba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116064) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 12:59:18.486803 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: INFO nova.api.openstack.requestlog [None req-2cb1d4e6-9f70-4132-9640-92ebcf5ca1d5 tempest-ServerRescueNegativeTestJSON-1573931620 tempest-ServerRescueNegativeTestJSON-1573931620-project] 10.222.0.49 "GET /compute/v2.1/servers/60694e1e-d0cb-41c8-adf5-bdda49804385" status: 200 len: 1523 microversion: 2.1 time: 0.455263 Dec 14 12:59:18.487349 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: [pid: 116064|app: 0|req: 119/252] 10.222.0.49 () {58 vars in 1235 bytes} [Tue Dec 14 12:59:18 2021] GET /compute/v2.1/servers/60694e1e-d0cb-41c8-adf5-bdda49804385 => generated 1523 bytes in 457 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 14 12:59:18.492600 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.api.openstack.wsgi [None req-6ad16275-17ce-467d-b91d-18fda21d3b96 tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116064) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 14 12:59:18.493768 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.compute.api [None req-6ad16275-17ce-467d-b91d-18fda21d3b96 tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] [instance: c8de7730-62f2-4a77-b1e9-cf6a74fa366d] Fetching instance by UUID {{(pid=116064) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 12:59:18.500071 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-6ad16275-17ce-467d-b91d-18fda21d3b96 tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 12:59:18.500744 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-6ad16275-17ce-467d-b91d-18fda21d3b96 tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 12:59:18.501771 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-6ad16275-17ce-467d-b91d-18fda21d3b96 tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 12:59:18.502357 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-6ad16275-17ce-467d-b91d-18fda21d3b96 tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 12:59:18.582931 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.policy [None req-685de348-c8fb-4728-8da5-0e9ac4e2a1b2 tempest-VolumesSnapshotTestJSON-1649574085 tempest-VolumesSnapshotTestJSON-1649574085-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e18311fd2704616a778d36332f199ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1bf776f341b4721b28eb9a5c84ba866', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116063) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 12:59:18.596192 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: INFO nova.api.openstack.requestlog [None req-685de348-c8fb-4728-8da5-0e9ac4e2a1b2 tempest-VolumesSnapshotTestJSON-1649574085 tempest-VolumesSnapshotTestJSON-1649574085-project] 10.222.0.49 "GET /compute/v2.1/servers/c48d3c23-3b4b-4220-8ead-d04a670ec64f" status: 200 len: 1319 microversion: 2.1 time: 0.448088 Dec 14 12:59:18.599022 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: [pid: 116063|app: 0|req: 134/253] 10.222.0.49 () {58 vars in 1235 bytes} [Tue Dec 14 12:59:18 2021] GET /compute/v2.1/servers/c48d3c23-3b4b-4220-8ead-d04a670ec64f => generated 1319 bytes in 454 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 14 12:59:18.615651 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: INFO nova.api.openstack.requestlog [None req-6ad16275-17ce-467d-b91d-18fda21d3b96 tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] 10.222.0.49 "POST /compute/v2.1/servers/c8de7730-62f2-4a77-b1e9-cf6a74fa366d/action" status: 200 len: 27065 microversion: 2.20 time: 0.126318 Dec 14 12:59:18.616753 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: [pid: 116064|app: 0|req: 120/254] 10.222.0.49 () {62 vars in 1318 bytes} [Tue Dec 14 12:59:18 2021] POST /compute/v2.1/servers/c8de7730-62f2-4a77-b1e9-cf6a74fa366d/action => generated 27065 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 14 12:59:18.816952 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.api.openstack.wsgi [None req-df52fc55-9d12-4559-b5c6-62f7aea7949e tempest-AttachVolumeNegativeTest-1000400951 tempest-AttachVolumeNegativeTest-1000400951-project] Calling method '>' {{(pid=116063) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 12:59:18.819498 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.compute.api [None req-df52fc55-9d12-4559-b5c6-62f7aea7949e tempest-AttachVolumeNegativeTest-1000400951 tempest-AttachVolumeNegativeTest-1000400951-project] [instance: 8d264701-aaa0-465f-a4aa-0cffa41351ef] Fetching instance by UUID {{(pid=116063) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 12:59:18.837881 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-df52fc55-9d12-4559-b5c6-62f7aea7949e tempest-AttachVolumeNegativeTest-1000400951 tempest-AttachVolumeNegativeTest-1000400951-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 12:59:18.843658 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-df52fc55-9d12-4559-b5c6-62f7aea7949e tempest-AttachVolumeNegativeTest-1000400951 tempest-AttachVolumeNegativeTest-1000400951-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 12:59:18.847824 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-df52fc55-9d12-4559-b5c6-62f7aea7949e tempest-AttachVolumeNegativeTest-1000400951 tempest-AttachVolumeNegativeTest-1000400951-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 12:59:18.848279 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-df52fc55-9d12-4559-b5c6-62f7aea7949e tempest-AttachVolumeNegativeTest-1000400951 tempest-AttachVolumeNegativeTest-1000400951-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 12:59:18.850467 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.api.openstack.wsgi [None req-9a11cb0c-810d-4e02-a1e0-ad160e9c86a5 tempest-VolumesActionsTest-648269150 tempest-VolumesActionsTest-648269150-project] Calling method '>' {{(pid=116064) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 12:59:18.851274 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.compute.api [None req-9a11cb0c-810d-4e02-a1e0-ad160e9c86a5 tempest-VolumesActionsTest-648269150 tempest-VolumesActionsTest-648269150-project] [instance: 7a410a38-0f6d-4e02-8db7-abd99e6a4fa1] Fetching instance by UUID {{(pid=116064) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 12:59:18.878423 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-9a11cb0c-810d-4e02-a1e0-ad160e9c86a5 tempest-VolumesActionsTest-648269150 tempest-VolumesActionsTest-648269150-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 12:59:18.880120 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-9a11cb0c-810d-4e02-a1e0-ad160e9c86a5 tempest-VolumesActionsTest-648269150 tempest-VolumesActionsTest-648269150-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 12:59:18.883258 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-9a11cb0c-810d-4e02-a1e0-ad160e9c86a5 tempest-VolumesActionsTest-648269150 tempest-VolumesActionsTest-648269150-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 12:59:18.884574 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-9a11cb0c-810d-4e02-a1e0-ad160e9c86a5 tempest-VolumesActionsTest-648269150 tempest-VolumesActionsTest-648269150-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 12:59:19.201362 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.policy [None req-df52fc55-9d12-4559-b5c6-62f7aea7949e tempest-AttachVolumeNegativeTest-1000400951 tempest-AttachVolumeNegativeTest-1000400951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57d0ec01f0784c8ea87d339980bed3cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad27b8951cae4eeeafa257f45217653a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116063) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 12:59:19.216019 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: INFO nova.api.openstack.requestlog [None req-df52fc55-9d12-4559-b5c6-62f7aea7949e tempest-AttachVolumeNegativeTest-1000400951 tempest-AttachVolumeNegativeTest-1000400951-project] 10.222.0.49 "GET /compute/v2.1/servers/8d264701-aaa0-465f-a4aa-0cffa41351ef" status: 200 len: 1317 microversion: 2.1 time: 0.401368 Dec 14 12:59:19.217838 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: [pid: 116063|app: 0|req: 135/255] 10.222.0.49 () {58 vars in 1235 bytes} [Tue Dec 14 12:59:18 2021] GET /compute/v2.1/servers/8d264701-aaa0-465f-a4aa-0cffa41351ef => generated 1317 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 14 12:59:19.219371 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.policy [None req-9a11cb0c-810d-4e02-a1e0-ad160e9c86a5 tempest-VolumesActionsTest-648269150 tempest-VolumesActionsTest-648269150-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cc7290157ff4075b95ead815c2b332a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fa190426a6c4b9c9d6d259455a647ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116064) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 12:59:19.222830 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.api.openstack.wsgi [req-6d8f00e5-e7ea-4222-b3dc-8c8baab6fece req-0dc5f80e-4086-4b68-96fe-221e51edb389 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7a410a38-0f6d-4e02-8db7-abd99e6a4fa1", "name": "network-vif-plugged", "status": "completed", "tag": "7d1aa989-c06a-4f16-bb14-af862f53bf9b"}]} {{(pid=116063) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 14 12:59:19.225361 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 14 12:59:19.225361 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: warnings.warn(msg) Dec 14 12:59:19.230835 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: INFO nova.api.openstack.requestlog [None req-9a11cb0c-810d-4e02-a1e0-ad160e9c86a5 tempest-VolumesActionsTest-648269150 tempest-VolumesActionsTest-648269150-project] 10.222.0.49 "GET /compute/v2.1/servers/7a410a38-0f6d-4e02-8db7-abd99e6a4fa1" status: 200 len: 1313 microversion: 2.1 time: 0.394693 Dec 14 12:59:19.235031 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: [pid: 116064|app: 0|req: 121/256] 10.222.0.49 () {58 vars in 1235 bytes} [Tue Dec 14 12:59:18 2021] GET /compute/v2.1/servers/7a410a38-0f6d-4e02-8db7-abd99e6a4fa1 => generated 1313 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 14 12:59:19.248825 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [req-6d8f00e5-e7ea-4222-b3dc-8c8baab6fece req-0dc5f80e-4086-4b68-96fe-221e51edb389 service nova] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 12:59:19.249294 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [req-6d8f00e5-e7ea-4222-b3dc-8c8baab6fece req-0dc5f80e-4086-4b68-96fe-221e51edb389 service nova] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 12:59:19.286752 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: INFO nova.api.openstack.compute.server_external_events [req-6d8f00e5-e7ea-4222-b3dc-8c8baab6fece req-0dc5f80e-4086-4b68-96fe-221e51edb389 service nova] Creating event network-vif-plugged:7d1aa989-c06a-4f16-bb14-af862f53bf9b for instance 7a410a38-0f6d-4e02-8db7-abd99e6a4fa1 on hv-cinder-78447 Dec 14 12:59:19.307581 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: INFO nova.api.openstack.requestlog [req-6d8f00e5-e7ea-4222-b3dc-8c8baab6fece req-0dc5f80e-4086-4b68-96fe-221e51edb389 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.088241 Dec 14 12:59:19.308253 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: [pid: 116063|app: 0|req: 136/257] 10.222.0.49 () {64 vars in 1317 bytes} [Tue Dec 14 12:59:19 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 14 12:59:19.503662 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.api.openstack.wsgi [None req-5bae34d8-81cc-4640-b119-7000f22cdb33 tempest-ServerRescueNegativeTestJSON-1573931620 tempest-ServerRescueNegativeTestJSON-1573931620-project] Calling method '>' {{(pid=116064) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 12:59:19.504341 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.compute.api [None req-5bae34d8-81cc-4640-b119-7000f22cdb33 tempest-ServerRescueNegativeTestJSON-1573931620 tempest-ServerRescueNegativeTestJSON-1573931620-project] [instance: 60694e1e-d0cb-41c8-adf5-bdda49804385] Fetching instance by UUID {{(pid=116064) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 12:59:19.515466 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-5bae34d8-81cc-4640-b119-7000f22cdb33 tempest-ServerRescueNegativeTestJSON-1573931620 tempest-ServerRescueNegativeTestJSON-1573931620-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 12:59:19.515913 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-5bae34d8-81cc-4640-b119-7000f22cdb33 tempest-ServerRescueNegativeTestJSON-1573931620 tempest-ServerRescueNegativeTestJSON-1573931620-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 12:59:19.516704 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-5bae34d8-81cc-4640-b119-7000f22cdb33 tempest-ServerRescueNegativeTestJSON-1573931620 tempest-ServerRescueNegativeTestJSON-1573931620-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 12:59:19.517158 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-5bae34d8-81cc-4640-b119-7000f22cdb33 tempest-ServerRescueNegativeTestJSON-1573931620 tempest-ServerRescueNegativeTestJSON-1573931620-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 12:59:19.616212 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.api.openstack.wsgi [None req-19c41a1e-4b35-41e9-a49e-a5a19d83ffa6 tempest-VolumesSnapshotTestJSON-1649574085 tempest-VolumesSnapshotTestJSON-1649574085-project] Calling method '>' {{(pid=116063) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 12:59:19.616915 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.compute.api [None req-19c41a1e-4b35-41e9-a49e-a5a19d83ffa6 tempest-VolumesSnapshotTestJSON-1649574085 tempest-VolumesSnapshotTestJSON-1649574085-project] [instance: c48d3c23-3b4b-4220-8ead-d04a670ec64f] Fetching instance by UUID {{(pid=116063) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 12:59:19.623777 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-19c41a1e-4b35-41e9-a49e-a5a19d83ffa6 tempest-VolumesSnapshotTestJSON-1649574085 tempest-VolumesSnapshotTestJSON-1649574085-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 12:59:19.624361 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-19c41a1e-4b35-41e9-a49e-a5a19d83ffa6 tempest-VolumesSnapshotTestJSON-1649574085 tempest-VolumesSnapshotTestJSON-1649574085-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 12:59:19.625453 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-19c41a1e-4b35-41e9-a49e-a5a19d83ffa6 tempest-VolumesSnapshotTestJSON-1649574085 tempest-VolumesSnapshotTestJSON-1649574085-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 12:59:19.626230 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-19c41a1e-4b35-41e9-a49e-a5a19d83ffa6 tempest-VolumesSnapshotTestJSON-1649574085 tempest-VolumesSnapshotTestJSON-1649574085-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 12:59:19.809111 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.policy [None req-5bae34d8-81cc-4640-b119-7000f22cdb33 tempest-ServerRescueNegativeTestJSON-1573931620 tempest-ServerRescueNegativeTestJSON-1573931620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '731cbbfe17214ded8ac66299d66dfc45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '010919ea84eb4eb8b936c63153600eba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116064) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 12:59:19.825800 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: INFO nova.api.openstack.requestlog [None req-5bae34d8-81cc-4640-b119-7000f22cdb33 tempest-ServerRescueNegativeTestJSON-1573931620 tempest-ServerRescueNegativeTestJSON-1573931620-project] 10.222.0.49 "GET /compute/v2.1/servers/60694e1e-d0cb-41c8-adf5-bdda49804385" status: 200 len: 1523 microversion: 2.1 time: 0.326094 Dec 14 12:59:19.827273 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: [pid: 116064|app: 0|req: 122/258] 10.222.0.49 () {58 vars in 1235 bytes} [Tue Dec 14 12:59:19 2021] GET /compute/v2.1/servers/60694e1e-d0cb-41c8-adf5-bdda49804385 => generated 1523 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 14 12:59:19.841298 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.api.openstack.wsgi [None req-8c512705-805b-4b1a-8bca-0689b7891b1a tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116064) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 14 12:59:19.846872 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.compute.api [None req-8c512705-805b-4b1a-8bca-0689b7891b1a tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] [instance: c8de7730-62f2-4a77-b1e9-cf6a74fa366d] Fetching instance by UUID {{(pid=116064) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 12:59:19.859082 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-8c512705-805b-4b1a-8bca-0689b7891b1a tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 12:59:19.861074 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-8c512705-805b-4b1a-8bca-0689b7891b1a tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 12:59:19.862839 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-8c512705-805b-4b1a-8bca-0689b7891b1a tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 12:59:19.863439 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-8c512705-805b-4b1a-8bca-0689b7891b1a tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 12:59:19.965784 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.policy [None req-19c41a1e-4b35-41e9-a49e-a5a19d83ffa6 tempest-VolumesSnapshotTestJSON-1649574085 tempest-VolumesSnapshotTestJSON-1649574085-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e18311fd2704616a778d36332f199ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1bf776f341b4721b28eb9a5c84ba866', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116063) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 12:59:19.987482 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: INFO nova.api.openstack.requestlog [None req-19c41a1e-4b35-41e9-a49e-a5a19d83ffa6 tempest-VolumesSnapshotTestJSON-1649574085 tempest-VolumesSnapshotTestJSON-1649574085-project] 10.222.0.49 "GET /compute/v2.1/servers/c48d3c23-3b4b-4220-8ead-d04a670ec64f" status: 200 len: 1319 microversion: 2.1 time: 0.375008 Dec 14 12:59:19.988484 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: [pid: 116063|app: 0|req: 137/259] 10.222.0.49 () {58 vars in 1235 bytes} [Tue Dec 14 12:59:19 2021] GET /compute/v2.1/servers/c48d3c23-3b4b-4220-8ead-d04a670ec64f => generated 1319 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 14 12:59:20.097873 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: INFO nova.api.openstack.requestlog [None req-8c512705-805b-4b1a-8bca-0689b7891b1a tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] 10.222.0.49 "POST /compute/v2.1/servers/c8de7730-62f2-4a77-b1e9-cf6a74fa366d/action" status: 200 len: 27650 microversion: 2.20 time: 0.268195 Dec 14 12:59:20.098618 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: [pid: 116064|app: 0|req: 123/260] 10.222.0.49 () {62 vars in 1318 bytes} [Tue Dec 14 12:59:19 2021] POST /compute/v2.1/servers/c8de7730-62f2-4a77-b1e9-cf6a74fa366d/action => generated 27650 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 14 12:59:20.129892 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.api.openstack.wsgi [req-544ec15e-5b2f-477a-9c2b-04ca51ce07d2 req-7101bf0a-1f75-49df-8bbf-f9456c59ba54 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8d264701-aaa0-465f-a4aa-0cffa41351ef", "tag": "3c4c685c-25bf-4592-b1c9-40dc336ec707"}]} {{(pid=116063) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 14 12:59:20.131507 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 14 12:59:20.131507 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: warnings.warn(msg) Dec 14 12:59:20.168304 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [req-544ec15e-5b2f-477a-9c2b-04ca51ce07d2 req-7101bf0a-1f75-49df-8bbf-f9456c59ba54 service nova] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 12:59:20.169295 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [req-544ec15e-5b2f-477a-9c2b-04ca51ce07d2 req-7101bf0a-1f75-49df-8bbf-f9456c59ba54 service nova] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 12:59:20.192753 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: INFO nova.api.openstack.compute.server_external_events [req-544ec15e-5b2f-477a-9c2b-04ca51ce07d2 req-7101bf0a-1f75-49df-8bbf-f9456c59ba54 service nova] Creating event network-changed:3c4c685c-25bf-4592-b1c9-40dc336ec707 for instance 8d264701-aaa0-465f-a4aa-0cffa41351ef on hv-cinder-78447 Dec 14 12:59:20.199847 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: INFO nova.api.openstack.requestlog [req-544ec15e-5b2f-477a-9c2b-04ca51ce07d2 req-7101bf0a-1f75-49df-8bbf-f9456c59ba54 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.073837 Dec 14 12:59:20.201997 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: [pid: 116063|app: 0|req: 138/261] 10.222.0.49 () {64 vars in 1317 bytes} [Tue Dec 14 12:59:20 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 14 12:59:20.237645 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.api.openstack.wsgi [None req-290bca9a-9b1c-49b1-80f4-e9658e7903c6 tempest-AttachVolumeNegativeTest-1000400951 tempest-AttachVolumeNegativeTest-1000400951-project] Calling method '>' {{(pid=116064) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 12:59:20.238688 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.compute.api [None req-290bca9a-9b1c-49b1-80f4-e9658e7903c6 tempest-AttachVolumeNegativeTest-1000400951 tempest-AttachVolumeNegativeTest-1000400951-project] [instance: 8d264701-aaa0-465f-a4aa-0cffa41351ef] Fetching instance by UUID {{(pid=116064) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 12:59:20.246954 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-290bca9a-9b1c-49b1-80f4-e9658e7903c6 tempest-AttachVolumeNegativeTest-1000400951 tempest-AttachVolumeNegativeTest-1000400951-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 12:59:20.250343 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.api.openstack.wsgi [None req-4faeeddf-2fed-4c1f-a2de-5ffaf6878227 tempest-VolumesActionsTest-648269150 tempest-VolumesActionsTest-648269150-project] Calling method '>' {{(pid=116063) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 12:59:20.251775 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.compute.api [None req-4faeeddf-2fed-4c1f-a2de-5ffaf6878227 tempest-VolumesActionsTest-648269150 tempest-VolumesActionsTest-648269150-project] [instance: 7a410a38-0f6d-4e02-8db7-abd99e6a4fa1] Fetching instance by UUID {{(pid=116063) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 12:59:20.255279 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-290bca9a-9b1c-49b1-80f4-e9658e7903c6 tempest-AttachVolumeNegativeTest-1000400951 tempest-AttachVolumeNegativeTest-1000400951-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 12:59:20.258149 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-290bca9a-9b1c-49b1-80f4-e9658e7903c6 tempest-AttachVolumeNegativeTest-1000400951 tempest-AttachVolumeNegativeTest-1000400951-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 12:59:20.260990 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-290bca9a-9b1c-49b1-80f4-e9658e7903c6 tempest-AttachVolumeNegativeTest-1000400951 tempest-AttachVolumeNegativeTest-1000400951-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 12:59:20.261129 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-4faeeddf-2fed-4c1f-a2de-5ffaf6878227 tempest-VolumesActionsTest-648269150 tempest-VolumesActionsTest-648269150-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 12:59:20.261553 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-4faeeddf-2fed-4c1f-a2de-5ffaf6878227 tempest-VolumesActionsTest-648269150 tempest-VolumesActionsTest-648269150-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 12:59:20.262462 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-4faeeddf-2fed-4c1f-a2de-5ffaf6878227 tempest-VolumesActionsTest-648269150 tempest-VolumesActionsTest-648269150-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 12:59:20.262890 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-4faeeddf-2fed-4c1f-a2de-5ffaf6878227 tempest-VolumesActionsTest-648269150 tempest-VolumesActionsTest-648269150-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 12:59:20.573345 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.policy [None req-4faeeddf-2fed-4c1f-a2de-5ffaf6878227 tempest-VolumesActionsTest-648269150 tempest-VolumesActionsTest-648269150-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cc7290157ff4075b95ead815c2b332a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fa190426a6c4b9c9d6d259455a647ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116063) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 12:59:20.592155 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: INFO nova.api.openstack.requestlog [None req-4faeeddf-2fed-4c1f-a2de-5ffaf6878227 tempest-VolumesActionsTest-648269150 tempest-VolumesActionsTest-648269150-project] 10.222.0.49 "GET /compute/v2.1/servers/7a410a38-0f6d-4e02-8db7-abd99e6a4fa1" status: 200 len: 1313 microversion: 2.1 time: 0.347196 Dec 14 12:59:20.603552 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: [pid: 116063|app: 0|req: 139/262] 10.222.0.49 () {58 vars in 1235 bytes} [Tue Dec 14 12:59:20 2021] GET /compute/v2.1/servers/7a410a38-0f6d-4e02-8db7-abd99e6a4fa1 => generated 1313 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 14 12:59:20.658142 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.policy [None req-290bca9a-9b1c-49b1-80f4-e9658e7903c6 tempest-AttachVolumeNegativeTest-1000400951 tempest-AttachVolumeNegativeTest-1000400951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57d0ec01f0784c8ea87d339980bed3cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad27b8951cae4eeeafa257f45217653a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116064) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 12:59:20.666026 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: INFO nova.api.openstack.requestlog [None req-290bca9a-9b1c-49b1-80f4-e9658e7903c6 tempest-AttachVolumeNegativeTest-1000400951 tempest-AttachVolumeNegativeTest-1000400951-project] 10.222.0.49 "GET /compute/v2.1/servers/8d264701-aaa0-465f-a4aa-0cffa41351ef" status: 200 len: 1317 microversion: 2.1 time: 0.436157 Dec 14 12:59:20.666596 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: [pid: 116064|app: 0|req: 124/263] 10.222.0.49 () {58 vars in 1235 bytes} [Tue Dec 14 12:59:20 2021] GET /compute/v2.1/servers/8d264701-aaa0-465f-a4aa-0cffa41351ef => generated 1317 bytes in 438 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 14 12:59:20.842954 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.api.openstack.wsgi [None req-0947914e-24f8-406f-8c4c-317bf6c037f6 tempest-ServerRescueNegativeTestJSON-1573931620 tempest-ServerRescueNegativeTestJSON-1573931620-project] Calling method '>' {{(pid=116063) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 12:59:20.843709 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.compute.api [None req-0947914e-24f8-406f-8c4c-317bf6c037f6 tempest-ServerRescueNegativeTestJSON-1573931620 tempest-ServerRescueNegativeTestJSON-1573931620-project] [instance: 60694e1e-d0cb-41c8-adf5-bdda49804385] Fetching instance by UUID {{(pid=116063) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 12:59:20.858446 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-0947914e-24f8-406f-8c4c-317bf6c037f6 tempest-ServerRescueNegativeTestJSON-1573931620 tempest-ServerRescueNegativeTestJSON-1573931620-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 12:59:20.859109 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-0947914e-24f8-406f-8c4c-317bf6c037f6 tempest-ServerRescueNegativeTestJSON-1573931620 tempest-ServerRescueNegativeTestJSON-1573931620-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 12:59:20.860893 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-0947914e-24f8-406f-8c4c-317bf6c037f6 tempest-ServerRescueNegativeTestJSON-1573931620 tempest-ServerRescueNegativeTestJSON-1573931620-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 12:59:20.862808 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-0947914e-24f8-406f-8c4c-317bf6c037f6 tempest-ServerRescueNegativeTestJSON-1573931620 tempest-ServerRescueNegativeTestJSON-1573931620-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 12:59:21.007332 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.api.openstack.wsgi [None req-cf13496e-e903-4684-9839-bc16081581de tempest-VolumesSnapshotTestJSON-1649574085 tempest-VolumesSnapshotTestJSON-1649574085-project] Calling method '>' {{(pid=116064) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 12:59:21.009392 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.compute.api [None req-cf13496e-e903-4684-9839-bc16081581de tempest-VolumesSnapshotTestJSON-1649574085 tempest-VolumesSnapshotTestJSON-1649574085-project] [instance: c48d3c23-3b4b-4220-8ead-d04a670ec64f] Fetching instance by UUID {{(pid=116064) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 12:59:21.036744 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-cf13496e-e903-4684-9839-bc16081581de tempest-VolumesSnapshotTestJSON-1649574085 tempest-VolumesSnapshotTestJSON-1649574085-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 12:59:21.037445 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-cf13496e-e903-4684-9839-bc16081581de tempest-VolumesSnapshotTestJSON-1649574085 tempest-VolumesSnapshotTestJSON-1649574085-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 12:59:21.044025 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-cf13496e-e903-4684-9839-bc16081581de tempest-VolumesSnapshotTestJSON-1649574085 tempest-VolumesSnapshotTestJSON-1649574085-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 12:59:21.044690 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-cf13496e-e903-4684-9839-bc16081581de tempest-VolumesSnapshotTestJSON-1649574085 tempest-VolumesSnapshotTestJSON-1649574085-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 12:59:21.055667 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.policy [None req-0947914e-24f8-406f-8c4c-317bf6c037f6 tempest-ServerRescueNegativeTestJSON-1573931620 tempest-ServerRescueNegativeTestJSON-1573931620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '731cbbfe17214ded8ac66299d66dfc45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '010919ea84eb4eb8b936c63153600eba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116063) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 12:59:21.069431 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: INFO nova.api.openstack.requestlog [None req-0947914e-24f8-406f-8c4c-317bf6c037f6 tempest-ServerRescueNegativeTestJSON-1573931620 tempest-ServerRescueNegativeTestJSON-1573931620-project] 10.222.0.49 "GET /compute/v2.1/servers/60694e1e-d0cb-41c8-adf5-bdda49804385" status: 200 len: 1523 microversion: 2.1 time: 0.224890 Dec 14 12:59:21.069431 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: [pid: 116063|app: 0|req: 140/264] 10.222.0.49 () {58 vars in 1235 bytes} [Tue Dec 14 12:59:20 2021] GET /compute/v2.1/servers/60694e1e-d0cb-41c8-adf5-bdda49804385 => generated 1523 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 14 12:59:21.109110 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.api.openstack.wsgi [None req-816ae77f-17f1-4c28-abe7-9628ebb85518 tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116063) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 14 12:59:21.113213 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.compute.api [None req-816ae77f-17f1-4c28-abe7-9628ebb85518 tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] [instance: c8de7730-62f2-4a77-b1e9-cf6a74fa366d] Fetching instance by UUID {{(pid=116063) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 12:59:21.122995 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-816ae77f-17f1-4c28-abe7-9628ebb85518 tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 12:59:21.125033 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-816ae77f-17f1-4c28-abe7-9628ebb85518 tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 12:59:21.127111 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-816ae77f-17f1-4c28-abe7-9628ebb85518 tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 12:59:21.127996 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-816ae77f-17f1-4c28-abe7-9628ebb85518 tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 12:59:21.326239 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.policy [None req-cf13496e-e903-4684-9839-bc16081581de tempest-VolumesSnapshotTestJSON-1649574085 tempest-VolumesSnapshotTestJSON-1649574085-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e18311fd2704616a778d36332f199ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1bf776f341b4721b28eb9a5c84ba866', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116064) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 12:59:21.337605 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: INFO nova.api.openstack.requestlog [None req-cf13496e-e903-4684-9839-bc16081581de tempest-VolumesSnapshotTestJSON-1649574085 tempest-VolumesSnapshotTestJSON-1649574085-project] 10.222.0.49 "GET /compute/v2.1/servers/c48d3c23-3b4b-4220-8ead-d04a670ec64f" status: 200 len: 1319 microversion: 2.1 time: 0.334210 Dec 14 12:59:21.339553 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: INFO nova.api.openstack.requestlog [None req-816ae77f-17f1-4c28-abe7-9628ebb85518 tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] 10.222.0.49 "POST /compute/v2.1/servers/c8de7730-62f2-4a77-b1e9-cf6a74fa366d/action" status: 200 len: 27935 microversion: 2.20 time: 0.234137 Dec 14 12:59:21.339849 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: [pid: 116064|app: 0|req: 125/265] 10.222.0.49 () {58 vars in 1235 bytes} [Tue Dec 14 12:59:20 2021] GET /compute/v2.1/servers/c48d3c23-3b4b-4220-8ead-d04a670ec64f => generated 1319 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 14 12:59:21.354795 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: [pid: 116063|app: 0|req: 141/266] 10.222.0.49 () {62 vars in 1318 bytes} [Tue Dec 14 12:59:21 2021] POST /compute/v2.1/servers/c8de7730-62f2-4a77-b1e9-cf6a74fa366d/action => generated 27935 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 14 12:59:21.613435 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.api.openstack.wsgi [None req-b7abdad5-6573-4a9a-b5c2-8a2e9e73658a tempest-VolumesActionsTest-648269150 tempest-VolumesActionsTest-648269150-project] Calling method '>' {{(pid=116064) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 12:59:21.614121 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.compute.api [None req-b7abdad5-6573-4a9a-b5c2-8a2e9e73658a tempest-VolumesActionsTest-648269150 tempest-VolumesActionsTest-648269150-project] [instance: 7a410a38-0f6d-4e02-8db7-abd99e6a4fa1] Fetching instance by UUID {{(pid=116064) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 12:59:21.639944 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-b7abdad5-6573-4a9a-b5c2-8a2e9e73658a tempest-VolumesActionsTest-648269150 tempest-VolumesActionsTest-648269150-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 12:59:21.640464 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-b7abdad5-6573-4a9a-b5c2-8a2e9e73658a tempest-VolumesActionsTest-648269150 tempest-VolumesActionsTest-648269150-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 12:59:21.641477 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-b7abdad5-6573-4a9a-b5c2-8a2e9e73658a tempest-VolumesActionsTest-648269150 tempest-VolumesActionsTest-648269150-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 12:59:21.641862 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-b7abdad5-6573-4a9a-b5c2-8a2e9e73658a tempest-VolumesActionsTest-648269150 tempest-VolumesActionsTest-648269150-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 12:59:21.685647 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.api.openstack.wsgi [None req-770d06ff-52f5-4131-aded-c0fc56488994 tempest-AttachVolumeNegativeTest-1000400951 tempest-AttachVolumeNegativeTest-1000400951-project] Calling method '>' {{(pid=116063) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 12:59:21.686460 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.compute.api [None req-770d06ff-52f5-4131-aded-c0fc56488994 tempest-AttachVolumeNegativeTest-1000400951 tempest-AttachVolumeNegativeTest-1000400951-project] [instance: 8d264701-aaa0-465f-a4aa-0cffa41351ef] Fetching instance by UUID {{(pid=116063) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 12:59:21.700210 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-770d06ff-52f5-4131-aded-c0fc56488994 tempest-AttachVolumeNegativeTest-1000400951 tempest-AttachVolumeNegativeTest-1000400951-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 12:59:21.701420 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-770d06ff-52f5-4131-aded-c0fc56488994 tempest-AttachVolumeNegativeTest-1000400951 tempest-AttachVolumeNegativeTest-1000400951-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 12:59:21.703188 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-770d06ff-52f5-4131-aded-c0fc56488994 tempest-AttachVolumeNegativeTest-1000400951 tempest-AttachVolumeNegativeTest-1000400951-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 12:59:21.705281 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-770d06ff-52f5-4131-aded-c0fc56488994 tempest-AttachVolumeNegativeTest-1000400951 tempest-AttachVolumeNegativeTest-1000400951-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 12:59:21.819902 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.policy [None req-b7abdad5-6573-4a9a-b5c2-8a2e9e73658a tempest-VolumesActionsTest-648269150 tempest-VolumesActionsTest-648269150-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cc7290157ff4075b95ead815c2b332a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fa190426a6c4b9c9d6d259455a647ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116064) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 12:59:21.827983 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: INFO nova.api.openstack.requestlog [None req-b7abdad5-6573-4a9a-b5c2-8a2e9e73658a tempest-VolumesActionsTest-648269150 tempest-VolumesActionsTest-648269150-project] 10.222.0.49 "GET /compute/v2.1/servers/7a410a38-0f6d-4e02-8db7-abd99e6a4fa1" status: 200 len: 1498 microversion: 2.1 time: 0.221404 Dec 14 12:59:21.840608 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: [pid: 116064|app: 0|req: 126/267] 10.222.0.49 () {58 vars in 1235 bytes} [Tue Dec 14 12:59:21 2021] GET /compute/v2.1/servers/7a410a38-0f6d-4e02-8db7-abd99e6a4fa1 => generated 1498 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 14 12:59:21.912493 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.policy [None req-770d06ff-52f5-4131-aded-c0fc56488994 tempest-AttachVolumeNegativeTest-1000400951 tempest-AttachVolumeNegativeTest-1000400951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57d0ec01f0784c8ea87d339980bed3cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad27b8951cae4eeeafa257f45217653a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116063) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 12:59:21.919878 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: INFO nova.api.openstack.requestlog [None req-770d06ff-52f5-4131-aded-c0fc56488994 tempest-AttachVolumeNegativeTest-1000400951 tempest-AttachVolumeNegativeTest-1000400951-project] 10.222.0.49 "GET /compute/v2.1/servers/8d264701-aaa0-465f-a4aa-0cffa41351ef" status: 200 len: 1317 microversion: 2.1 time: 0.239594 Dec 14 12:59:21.920565 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: [pid: 116063|app: 0|req: 142/268] 10.222.0.49 () {58 vars in 1235 bytes} [Tue Dec 14 12:59:21 2021] GET /compute/v2.1/servers/8d264701-aaa0-465f-a4aa-0cffa41351ef => generated 1317 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 14 12:59:22.081972 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.api.openstack.wsgi [None req-83f8fc30-1dab-4f72-b13d-34099b20f09e tempest-ServerRescueNegativeTestJSON-1573931620 tempest-ServerRescueNegativeTestJSON-1573931620-project] Calling method '>' {{(pid=116064) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 12:59:22.082583 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.compute.api [None req-83f8fc30-1dab-4f72-b13d-34099b20f09e tempest-ServerRescueNegativeTestJSON-1573931620 tempest-ServerRescueNegativeTestJSON-1573931620-project] [instance: 60694e1e-d0cb-41c8-adf5-bdda49804385] Fetching instance by UUID {{(pid=116064) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 12:59:22.088610 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-83f8fc30-1dab-4f72-b13d-34099b20f09e tempest-ServerRescueNegativeTestJSON-1573931620 tempest-ServerRescueNegativeTestJSON-1573931620-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 12:59:22.089139 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-83f8fc30-1dab-4f72-b13d-34099b20f09e tempest-ServerRescueNegativeTestJSON-1573931620 tempest-ServerRescueNegativeTestJSON-1573931620-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 12:59:22.089919 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-83f8fc30-1dab-4f72-b13d-34099b20f09e tempest-ServerRescueNegativeTestJSON-1573931620 tempest-ServerRescueNegativeTestJSON-1573931620-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 12:59:22.090355 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-83f8fc30-1dab-4f72-b13d-34099b20f09e tempest-ServerRescueNegativeTestJSON-1573931620 tempest-ServerRescueNegativeTestJSON-1573931620-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 12:59:22.244597 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.policy [None req-83f8fc30-1dab-4f72-b13d-34099b20f09e tempest-ServerRescueNegativeTestJSON-1573931620 tempest-ServerRescueNegativeTestJSON-1573931620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '731cbbfe17214ded8ac66299d66dfc45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '010919ea84eb4eb8b936c63153600eba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116064) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 12:59:22.252219 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: INFO nova.api.openstack.requestlog [None req-83f8fc30-1dab-4f72-b13d-34099b20f09e tempest-ServerRescueNegativeTestJSON-1573931620 tempest-ServerRescueNegativeTestJSON-1573931620-project] 10.222.0.49 "GET /compute/v2.1/servers/60694e1e-d0cb-41c8-adf5-bdda49804385" status: 200 len: 1523 microversion: 2.1 time: 0.174064 Dec 14 12:59:22.252796 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: [pid: 116064|app: 0|req: 127/269] 10.222.0.49 () {58 vars in 1235 bytes} [Tue Dec 14 12:59:22 2021] GET /compute/v2.1/servers/60694e1e-d0cb-41c8-adf5-bdda49804385 => generated 1523 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 14 12:59:22.356978 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.api.openstack.wsgi [None req-fa8014d3-8abd-4f11-b47d-24b78e1627fd tempest-VolumesSnapshotTestJSON-1649574085 tempest-VolumesSnapshotTestJSON-1649574085-project] Calling method '>' {{(pid=116063) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 12:59:22.357616 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.compute.api [None req-fa8014d3-8abd-4f11-b47d-24b78e1627fd tempest-VolumesSnapshotTestJSON-1649574085 tempest-VolumesSnapshotTestJSON-1649574085-project] [instance: c48d3c23-3b4b-4220-8ead-d04a670ec64f] Fetching instance by UUID {{(pid=116063) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 12:59:22.364101 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-fa8014d3-8abd-4f11-b47d-24b78e1627fd tempest-VolumesSnapshotTestJSON-1649574085 tempest-VolumesSnapshotTestJSON-1649574085-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 12:59:22.364723 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-fa8014d3-8abd-4f11-b47d-24b78e1627fd tempest-VolumesSnapshotTestJSON-1649574085 tempest-VolumesSnapshotTestJSON-1649574085-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 12:59:22.366125 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-fa8014d3-8abd-4f11-b47d-24b78e1627fd tempest-VolumesSnapshotTestJSON-1649574085 tempest-VolumesSnapshotTestJSON-1649574085-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 12:59:22.366233 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.api.openstack.wsgi [None req-d768afba-688a-41fc-9347-6ae3f17e4f55 tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116064) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 14 12:59:22.366563 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-fa8014d3-8abd-4f11-b47d-24b78e1627fd tempest-VolumesSnapshotTestJSON-1649574085 tempest-VolumesSnapshotTestJSON-1649574085-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 12:59:22.367527 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.compute.api [None req-d768afba-688a-41fc-9347-6ae3f17e4f55 tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] [instance: c8de7730-62f2-4a77-b1e9-cf6a74fa366d] Fetching instance by UUID {{(pid=116064) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 12:59:22.374363 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-d768afba-688a-41fc-9347-6ae3f17e4f55 tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 12:59:22.375005 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-d768afba-688a-41fc-9347-6ae3f17e4f55 tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 12:59:22.375966 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-d768afba-688a-41fc-9347-6ae3f17e4f55 tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 12:59:22.376757 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-d768afba-688a-41fc-9347-6ae3f17e4f55 tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 12:59:22.483033 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: INFO nova.api.openstack.requestlog [None req-d768afba-688a-41fc-9347-6ae3f17e4f55 tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] 10.222.0.49 "POST /compute/v2.1/servers/c8de7730-62f2-4a77-b1e9-cf6a74fa366d/action" status: 200 len: 28120 microversion: 2.20 time: 0.121345 Dec 14 12:59:22.483713 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: [pid: 116064|app: 0|req: 128/270] 10.222.0.49 () {62 vars in 1318 bytes} [Tue Dec 14 12:59:22 2021] POST /compute/v2.1/servers/c8de7730-62f2-4a77-b1e9-cf6a74fa366d/action => generated 28120 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 14 12:59:22.508703 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.policy [None req-fa8014d3-8abd-4f11-b47d-24b78e1627fd tempest-VolumesSnapshotTestJSON-1649574085 tempest-VolumesSnapshotTestJSON-1649574085-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e18311fd2704616a778d36332f199ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1bf776f341b4721b28eb9a5c84ba866', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116063) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 12:59:22.527143 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: INFO nova.api.openstack.requestlog [None req-fa8014d3-8abd-4f11-b47d-24b78e1627fd tempest-VolumesSnapshotTestJSON-1649574085 tempest-VolumesSnapshotTestJSON-1649574085-project] 10.222.0.49 "GET /compute/v2.1/servers/c48d3c23-3b4b-4220-8ead-d04a670ec64f" status: 200 len: 1319 microversion: 2.1 time: 0.174713 Dec 14 12:59:22.533032 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: [pid: 116063|app: 0|req: 143/271] 10.222.0.49 () {58 vars in 1235 bytes} [Tue Dec 14 12:59:22 2021] GET /compute/v2.1/servers/c48d3c23-3b4b-4220-8ead-d04a670ec64f => generated 1319 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 14 12:59:22.533205 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.api.openstack.wsgi [None req-cf75f43b-b9e5-44ff-aa41-c3e32e172384 tempest-VolumesActionsTest-648269150 tempest-VolumesActionsTest-648269150-project] Calling method '>' {{(pid=116064) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 12:59:22.533205 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.compute.api [None req-cf75f43b-b9e5-44ff-aa41-c3e32e172384 tempest-VolumesActionsTest-648269150 tempest-VolumesActionsTest-648269150-project] [instance: 7a410a38-0f6d-4e02-8db7-abd99e6a4fa1] Fetching instance by UUID {{(pid=116064) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 12:59:22.538750 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-cf75f43b-b9e5-44ff-aa41-c3e32e172384 tempest-VolumesActionsTest-648269150 tempest-VolumesActionsTest-648269150-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 12:59:22.539350 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-cf75f43b-b9e5-44ff-aa41-c3e32e172384 tempest-VolumesActionsTest-648269150 tempest-VolumesActionsTest-648269150-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 12:59:22.540169 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-cf75f43b-b9e5-44ff-aa41-c3e32e172384 tempest-VolumesActionsTest-648269150 tempest-VolumesActionsTest-648269150-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 12:59:22.540985 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-cf75f43b-b9e5-44ff-aa41-c3e32e172384 tempest-VolumesActionsTest-648269150 tempest-VolumesActionsTest-648269150-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 12:59:22.568988 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.compute.api [None req-cf75f43b-b9e5-44ff-aa41-c3e32e172384 tempest-VolumesActionsTest-648269150 tempest-VolumesActionsTest-648269150-project] [instance: 7a410a38-0f6d-4e02-8db7-abd99e6a4fa1] Going to try to terminate instance {{(pid=116064) delete /opt/stack/nova/nova/compute/api.py:2614}} Dec 14 12:59:22.652983 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: INFO nova.api.openstack.requestlog [None req-cf75f43b-b9e5-44ff-aa41-c3e32e172384 tempest-VolumesActionsTest-648269150 tempest-VolumesActionsTest-648269150-project] 10.222.0.49 "DELETE /compute/v2.1/servers/7a410a38-0f6d-4e02-8db7-abd99e6a4fa1" status: 204 len: 0 microversion: 2.1 time: 0.125886 Dec 14 12:59:22.653737 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: [pid: 116064|app: 0|req: 129/272] 10.222.0.49 () {58 vars in 1238 bytes} [Tue Dec 14 12:59:22 2021] DELETE /compute/v2.1/servers/7a410a38-0f6d-4e02-8db7-abd99e6a4fa1 => generated 0 bytes in 128 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Dec 14 12:59:22.662423 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.api.openstack.wsgi [None req-81a7a105-66b7-4ab4-a947-ef0ef5888d7d tempest-VolumesActionsTest-648269150 tempest-VolumesActionsTest-648269150-project] Calling method '>' {{(pid=116063) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 12:59:22.663047 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.compute.api [None req-81a7a105-66b7-4ab4-a947-ef0ef5888d7d tempest-VolumesActionsTest-648269150 tempest-VolumesActionsTest-648269150-project] [instance: 7a410a38-0f6d-4e02-8db7-abd99e6a4fa1] Fetching instance by UUID {{(pid=116063) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 12:59:22.674596 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-81a7a105-66b7-4ab4-a947-ef0ef5888d7d tempest-VolumesActionsTest-648269150 tempest-VolumesActionsTest-648269150-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 12:59:22.675121 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-81a7a105-66b7-4ab4-a947-ef0ef5888d7d tempest-VolumesActionsTest-648269150 tempest-VolumesActionsTest-648269150-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 12:59:22.675867 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-81a7a105-66b7-4ab4-a947-ef0ef5888d7d tempest-VolumesActionsTest-648269150 tempest-VolumesActionsTest-648269150-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 12:59:22.676352 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-81a7a105-66b7-4ab4-a947-ef0ef5888d7d tempest-VolumesActionsTest-648269150 tempest-VolumesActionsTest-648269150-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 12:59:22.837794 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.api.openstack.wsgi [req-59b22f07-d516-4df6-8c35-d27a61964826 req-9a7839c9-68d6-4c1c-9f14-87a43243380b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c48d3c23-3b4b-4220-8ead-d04a670ec64f", "name": "network-vif-plugged", "status": "completed", "tag": "c342614d-9975-4aaa-a444-6e5c731f8f7a"}]} {{(pid=116064) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 14 12:59:22.839388 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 14 12:59:22.839388 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: warnings.warn(msg) Dec 14 12:59:22.847057 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [req-59b22f07-d516-4df6-8c35-d27a61964826 req-9a7839c9-68d6-4c1c-9f14-87a43243380b service nova] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 12:59:22.847496 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [req-59b22f07-d516-4df6-8c35-d27a61964826 req-9a7839c9-68d6-4c1c-9f14-87a43243380b service nova] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 12:59:22.864575 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.policy [None req-81a7a105-66b7-4ab4-a947-ef0ef5888d7d tempest-VolumesActionsTest-648269150 tempest-VolumesActionsTest-648269150-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cc7290157ff4075b95ead815c2b332a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fa190426a6c4b9c9d6d259455a647ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116063) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 12:59:22.875263 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: INFO nova.api.openstack.requestlog [None req-81a7a105-66b7-4ab4-a947-ef0ef5888d7d tempest-VolumesActionsTest-648269150 tempest-VolumesActionsTest-648269150-project] 10.222.0.49 "GET /compute/v2.1/servers/7a410a38-0f6d-4e02-8db7-abd99e6a4fa1" status: 200 len: 1504 microversion: 2.1 time: 0.216623 Dec 14 12:59:22.876862 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: [pid: 116063|app: 0|req: 144/273] 10.222.0.49 () {58 vars in 1235 bytes} [Tue Dec 14 12:59:22 2021] GET /compute/v2.1/servers/7a410a38-0f6d-4e02-8db7-abd99e6a4fa1 => generated 1504 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 14 12:59:22.883534 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: INFO nova.api.openstack.compute.server_external_events [req-59b22f07-d516-4df6-8c35-d27a61964826 req-9a7839c9-68d6-4c1c-9f14-87a43243380b service nova] Creating event network-vif-plugged:c342614d-9975-4aaa-a444-6e5c731f8f7a for instance c48d3c23-3b4b-4220-8ead-d04a670ec64f on hv-cinder-78447 Dec 14 12:59:22.895489 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: INFO nova.api.openstack.requestlog [req-59b22f07-d516-4df6-8c35-d27a61964826 req-9a7839c9-68d6-4c1c-9f14-87a43243380b service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.062011 Dec 14 12:59:22.896582 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: [pid: 116064|app: 0|req: 130/274] 10.222.0.49 () {64 vars in 1317 bytes} [Tue Dec 14 12:59:22 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Dec 14 12:59:22.939328 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.api.openstack.wsgi [None req-5cdfd4a5-7ac5-472a-b016-1be159977e81 tempest-AttachVolumeNegativeTest-1000400951 tempest-AttachVolumeNegativeTest-1000400951-project] Calling method '>' {{(pid=116063) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 12:59:22.940129 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.compute.api [None req-5cdfd4a5-7ac5-472a-b016-1be159977e81 tempest-AttachVolumeNegativeTest-1000400951 tempest-AttachVolumeNegativeTest-1000400951-project] [instance: 8d264701-aaa0-465f-a4aa-0cffa41351ef] Fetching instance by UUID {{(pid=116063) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 12:59:22.948874 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-5cdfd4a5-7ac5-472a-b016-1be159977e81 tempest-AttachVolumeNegativeTest-1000400951 tempest-AttachVolumeNegativeTest-1000400951-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 12:59:22.949888 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-5cdfd4a5-7ac5-472a-b016-1be159977e81 tempest-AttachVolumeNegativeTest-1000400951 tempest-AttachVolumeNegativeTest-1000400951-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 12:59:22.951491 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-5cdfd4a5-7ac5-472a-b016-1be159977e81 tempest-AttachVolumeNegativeTest-1000400951 tempest-AttachVolumeNegativeTest-1000400951-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 12:59:22.952378 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-5cdfd4a5-7ac5-472a-b016-1be159977e81 tempest-AttachVolumeNegativeTest-1000400951 tempest-AttachVolumeNegativeTest-1000400951-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 12:59:23.155767 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.policy [None req-5cdfd4a5-7ac5-472a-b016-1be159977e81 tempest-AttachVolumeNegativeTest-1000400951 tempest-AttachVolumeNegativeTest-1000400951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57d0ec01f0784c8ea87d339980bed3cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad27b8951cae4eeeafa257f45217653a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116063) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 12:59:23.165460 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: INFO nova.api.openstack.requestlog [None req-5cdfd4a5-7ac5-472a-b016-1be159977e81 tempest-AttachVolumeNegativeTest-1000400951 tempest-AttachVolumeNegativeTest-1000400951-project] 10.222.0.49 "GET /compute/v2.1/servers/8d264701-aaa0-465f-a4aa-0cffa41351ef" status: 200 len: 1317 microversion: 2.1 time: 0.230506 Dec 14 12:59:23.166781 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: [pid: 116063|app: 0|req: 145/275] 10.222.0.49 () {58 vars in 1235 bytes} [Tue Dec 14 12:59:22 2021] GET /compute/v2.1/servers/8d264701-aaa0-465f-a4aa-0cffa41351ef => generated 1317 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 14 12:59:23.255905 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.api.openstack.wsgi [None req-e191cfc8-d684-4020-8d96-fa5082e92226 tempest-VolumesNegativeTest-1177368279 tempest-VolumesNegativeTest-1177368279-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesNegativeTest-instance-754077226", "imageRef": "1733dcd4-5ded-44e1-8b8d-392adb05c67a", "flavorRef": "452"}} {{(pid=116064) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 14 12:59:23.270080 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.api.openstack.wsgi [None req-1e399953-1309-4903-bdd1-954619f079f0 tempest-ServerRescueNegativeTestJSON-1573931620 tempest-ServerRescueNegativeTestJSON-1573931620-project] Calling method '>' {{(pid=116063) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 12:59:23.270691 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.compute.api [None req-1e399953-1309-4903-bdd1-954619f079f0 tempest-ServerRescueNegativeTestJSON-1573931620 tempest-ServerRescueNegativeTestJSON-1573931620-project] [instance: 60694e1e-d0cb-41c8-adf5-bdda49804385] Fetching instance by UUID {{(pid=116063) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 12:59:23.277405 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-1e399953-1309-4903-bdd1-954619f079f0 tempest-ServerRescueNegativeTestJSON-1573931620 tempest-ServerRescueNegativeTestJSON-1573931620-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 12:59:23.278117 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-1e399953-1309-4903-bdd1-954619f079f0 tempest-ServerRescueNegativeTestJSON-1573931620 tempest-ServerRescueNegativeTestJSON-1573931620-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 12:59:23.285944 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-1e399953-1309-4903-bdd1-954619f079f0 tempest-ServerRescueNegativeTestJSON-1573931620 tempest-ServerRescueNegativeTestJSON-1573931620-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 12:59:23.286943 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-1e399953-1309-4903-bdd1-954619f079f0 tempest-ServerRescueNegativeTestJSON-1573931620 tempest-ServerRescueNegativeTestJSON-1573931620-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 12:59:23.318111 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.network.neutron [None req-e191cfc8-d684-4020-8d96-fa5082e92226 tempest-VolumesNegativeTest-1177368279 tempest-VolumesNegativeTest-1177368279-project] validate_networks() for None {{(pid=116064) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Dec 14 12:59:23.897476 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.policy [None req-1e399953-1309-4903-bdd1-954619f079f0 tempest-ServerRescueNegativeTestJSON-1573931620 tempest-ServerRescueNegativeTestJSON-1573931620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '731cbbfe17214ded8ac66299d66dfc45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '010919ea84eb4eb8b936c63153600eba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116063) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 12:59:23.905423 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: INFO nova.api.openstack.requestlog [None req-1e399953-1309-4903-bdd1-954619f079f0 tempest-ServerRescueNegativeTestJSON-1573931620 tempest-ServerRescueNegativeTestJSON-1573931620-project] 10.222.0.49 "GET /compute/v2.1/servers/60694e1e-d0cb-41c8-adf5-bdda49804385" status: 200 len: 1523 microversion: 2.1 time: 0.639847 Dec 14 12:59:23.906000 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: [pid: 116063|app: 0|req: 146/276] 10.222.0.49 () {58 vars in 1235 bytes} [Tue Dec 14 12:59:23 2021] GET /compute/v2.1/servers/60694e1e-d0cb-41c8-adf5-bdda49804385 => generated 1523 bytes in 641 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 14 12:59:23.910691 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.api.openstack.wsgi [None req-4931b6b0-a489-4efe-b791-7e49020ce778 tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116063) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 14 12:59:23.911647 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.compute.api [None req-4931b6b0-a489-4efe-b791-7e49020ce778 tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] [instance: c8de7730-62f2-4a77-b1e9-cf6a74fa366d] Fetching instance by UUID {{(pid=116063) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 12:59:23.917842 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-4931b6b0-a489-4efe-b791-7e49020ce778 tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 12:59:23.918289 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-4931b6b0-a489-4efe-b791-7e49020ce778 tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 12:59:23.919101 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-4931b6b0-a489-4efe-b791-7e49020ce778 tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 12:59:23.919531 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-4931b6b0-a489-4efe-b791-7e49020ce778 tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 12:59:23.966654 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.virt.hardware [None req-e191cfc8-d684-4020-8d96-fa5082e92226 tempest-VolumesNegativeTest-1177368279 tempest-VolumesNegativeTest-1177368279-project] Flavor limits 0:0:0 {{(pid=116064) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Dec 14 12:59:23.967088 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.virt.hardware [None req-e191cfc8-d684-4020-8d96-fa5082e92226 tempest-VolumesNegativeTest-1177368279 tempest-VolumesNegativeTest-1177368279-project] Image limits 0:0:0 {{(pid=116064) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Dec 14 12:59:23.967657 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.virt.hardware [None req-e191cfc8-d684-4020-8d96-fa5082e92226 tempest-VolumesNegativeTest-1177368279 tempest-VolumesNegativeTest-1177368279-project] Flavor pref 0:0:0 {{(pid=116064) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Dec 14 12:59:23.968131 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.virt.hardware [None req-e191cfc8-d684-4020-8d96-fa5082e92226 tempest-VolumesNegativeTest-1177368279 tempest-VolumesNegativeTest-1177368279-project] Image pref 0:0:0 {{(pid=116064) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Dec 14 12:59:23.968604 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.virt.hardware [None req-e191cfc8-d684-4020-8d96-fa5082e92226 tempest-VolumesNegativeTest-1177368279 tempest-VolumesNegativeTest-1177368279-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=116064) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Dec 14 12:59:23.977490 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-e191cfc8-d684-4020-8d96-fa5082e92226 tempest-VolumesNegativeTest-1177368279 tempest-VolumesNegativeTest-1177368279-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 12:59:23.978012 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-e191cfc8-d684-4020-8d96-fa5082e92226 tempest-VolumesNegativeTest-1177368279 tempest-VolumesNegativeTest-1177368279-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 12:59:23.978886 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-e191cfc8-d684-4020-8d96-fa5082e92226 tempest-VolumesNegativeTest-1177368279 tempest-VolumesNegativeTest-1177368279-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 12:59:23.979390 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-e191cfc8-d684-4020-8d96-fa5082e92226 tempest-VolumesNegativeTest-1177368279 tempest-VolumesNegativeTest-1177368279-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 12:59:23.995804 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: INFO nova.api.openstack.requestlog [None req-4931b6b0-a489-4efe-b791-7e49020ce778 tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] 10.222.0.49 "POST /compute/v2.1/servers/c8de7730-62f2-4a77-b1e9-cf6a74fa366d/action" status: 200 len: 28120 microversion: 2.20 time: 0.088289 Dec 14 12:59:23.996334 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.quota [None req-e191cfc8-d684-4020-8d96-fa5082e92226 tempest-VolumesNegativeTest-1177368279 tempest-VolumesNegativeTest-1177368279-project] Getting quotas for project 1fe74d6e6bd748d4a6f320530dffe300. Resources: {'cores', 'instances', 'ram'} {{(pid=116064) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 14 12:59:23.999888 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: [pid: 116063|app: 0|req: 147/277] 10.222.0.49 () {62 vars in 1318 bytes} [Tue Dec 14 12:59:23 2021] POST /compute/v2.1/servers/c8de7730-62f2-4a77-b1e9-cf6a74fa366d/action => generated 28120 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 14 12:59:24.000589 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.quota [None req-e191cfc8-d684-4020-8d96-fa5082e92226 tempest-VolumesNegativeTest-1177368279 tempest-VolumesNegativeTest-1177368279-project] Getting quotas for user 68514732cd1d4c9d8181796d4573303f and project 1fe74d6e6bd748d4a6f320530dffe300. Resources: {'cores', 'instances', 'ram'} {{(pid=116064) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 14 12:59:24.002550 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.api.openstack.wsgi [None req-1fb5cc41-3413-4d60-8589-5795d2451e7e tempest-VolumesSnapshotTestJSON-1649574085 tempest-VolumesSnapshotTestJSON-1649574085-project] Calling method '>' {{(pid=116063) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 12:59:24.003245 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.compute.api [None req-1fb5cc41-3413-4d60-8589-5795d2451e7e tempest-VolumesSnapshotTestJSON-1649574085 tempest-VolumesSnapshotTestJSON-1649574085-project] [instance: c48d3c23-3b4b-4220-8ead-d04a670ec64f] Fetching instance by UUID {{(pid=116063) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 12:59:24.010445 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-1fb5cc41-3413-4d60-8589-5795d2451e7e tempest-VolumesSnapshotTestJSON-1649574085 tempest-VolumesSnapshotTestJSON-1649574085-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 12:59:24.010932 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-1fb5cc41-3413-4d60-8589-5795d2451e7e tempest-VolumesSnapshotTestJSON-1649574085 tempest-VolumesSnapshotTestJSON-1649574085-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 12:59:24.011732 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-1fb5cc41-3413-4d60-8589-5795d2451e7e tempest-VolumesSnapshotTestJSON-1649574085 tempest-VolumesSnapshotTestJSON-1649574085-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 12:59:24.012164 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-1fb5cc41-3413-4d60-8589-5795d2451e7e tempest-VolumesSnapshotTestJSON-1649574085 tempest-VolumesSnapshotTestJSON-1649574085-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 12:59:24.012550 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.compute.api [None req-e191cfc8-d684-4020-8d96-fa5082e92226 tempest-VolumesNegativeTest-1177368279 tempest-VolumesNegativeTest-1177368279-project] Going to run 1 instances... {{(pid=116064) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Dec 14 12:59:24.015073 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.compute.api [None req-e191cfc8-d684-4020-8d96-fa5082e92226 tempest-VolumesNegativeTest-1177368279 tempest-VolumesNegativeTest-1177368279-project] [instance: 64bca4a7-c923-443e-a304-580fcbd76c14] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='1733dcd4-5ded-44e1-8b8d-392adb05c67a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=116064) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Dec 14 12:59:24.061685 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: INFO nova.api.openstack.requestlog [None req-e191cfc8-d684-4020-8d96-fa5082e92226 tempest-VolumesNegativeTest-1177368279 tempest-VolumesNegativeTest-1177368279-project] 10.222.0.49 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.811114 Dec 14 12:59:24.062629 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: [pid: 116064|app: 0|req: 131/278] 10.222.0.49 () {60 vars in 1146 bytes} [Tue Dec 14 12:59:23 2021] POST /compute/v2.1/servers => generated 380 bytes in 813 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Dec 14 12:59:24.072825 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.api.openstack.wsgi [None req-65c32be6-1d6a-4b57-9509-cb21f4d92a0c tempest-VolumesActionsTest-648269150 tempest-VolumesActionsTest-648269150-project] Calling method '>' {{(pid=116064) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 12:59:24.073593 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.compute.api [None req-65c32be6-1d6a-4b57-9509-cb21f4d92a0c tempest-VolumesActionsTest-648269150 tempest-VolumesActionsTest-648269150-project] [instance: 7a410a38-0f6d-4e02-8db7-abd99e6a4fa1] Fetching instance by UUID {{(pid=116064) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 12:59:24.083679 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-65c32be6-1d6a-4b57-9509-cb21f4d92a0c tempest-VolumesActionsTest-648269150 tempest-VolumesActionsTest-648269150-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 12:59:24.083679 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-65c32be6-1d6a-4b57-9509-cb21f4d92a0c tempest-VolumesActionsTest-648269150 tempest-VolumesActionsTest-648269150-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 12:59:24.084450 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-65c32be6-1d6a-4b57-9509-cb21f4d92a0c tempest-VolumesActionsTest-648269150 tempest-VolumesActionsTest-648269150-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 12:59:24.084667 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-65c32be6-1d6a-4b57-9509-cb21f4d92a0c tempest-VolumesActionsTest-648269150 tempest-VolumesActionsTest-648269150-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 12:59:24.209194 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.policy [None req-1fb5cc41-3413-4d60-8589-5795d2451e7e tempest-VolumesSnapshotTestJSON-1649574085 tempest-VolumesSnapshotTestJSON-1649574085-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e18311fd2704616a778d36332f199ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1bf776f341b4721b28eb9a5c84ba866', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116063) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 12:59:24.216829 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: INFO nova.api.openstack.requestlog [None req-1fb5cc41-3413-4d60-8589-5795d2451e7e tempest-VolumesSnapshotTestJSON-1649574085 tempest-VolumesSnapshotTestJSON-1649574085-project] 10.222.0.49 "GET /compute/v2.1/servers/c48d3c23-3b4b-4220-8ead-d04a670ec64f" status: 200 len: 1319 microversion: 2.1 time: 0.218371 Dec 14 12:59:24.217425 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: [pid: 116063|app: 0|req: 148/279] 10.222.0.49 () {58 vars in 1235 bytes} [Tue Dec 14 12:59:23 2021] GET /compute/v2.1/servers/c48d3c23-3b4b-4220-8ead-d04a670ec64f => generated 1319 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 14 12:59:24.225881 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.api.openstack.wsgi [None req-e37733f5-0a26-49b7-adae-e6c9325c2e8b tempest-VolumesNegativeTest-1177368279 tempest-VolumesNegativeTest-1177368279-project] Calling method '>' {{(pid=116063) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 12:59:24.226651 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.compute.api [None req-e37733f5-0a26-49b7-adae-e6c9325c2e8b tempest-VolumesNegativeTest-1177368279 tempest-VolumesNegativeTest-1177368279-project] [instance: 64bca4a7-c923-443e-a304-580fcbd76c14] Fetching instance by UUID {{(pid=116063) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 12:59:24.298334 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.policy [None req-e37733f5-0a26-49b7-adae-e6c9325c2e8b tempest-VolumesNegativeTest-1177368279 tempest-VolumesNegativeTest-1177368279-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68514732cd1d4c9d8181796d4573303f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fe74d6e6bd748d4a6f320530dffe300', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116063) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 12:59:24.309370 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: INFO nova.api.openstack.requestlog [None req-e37733f5-0a26-49b7-adae-e6c9325c2e8b tempest-VolumesNegativeTest-1177368279 tempest-VolumesNegativeTest-1177368279-project] 10.222.0.49 "GET /compute/v2.1/servers/64bca4a7-c923-443e-a304-580fcbd76c14" status: 200 len: 1214 microversion: 2.1 time: 0.090664 Dec 14 12:59:24.322211 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: [pid: 116063|app: 0|req: 149/280] 10.222.0.49 () {58 vars in 1235 bytes} [Tue Dec 14 12:59:24 2021] GET /compute/v2.1/servers/64bca4a7-c923-443e-a304-580fcbd76c14 => generated 1214 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 14 12:59:24.322211 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.api.openstack.wsgi [None req-4b24e56e-9ade-4f90-b054-a3f30614f7d9 tempest-AttachVolumeNegativeTest-1000400951 tempest-AttachVolumeNegativeTest-1000400951-project] Calling method '>' {{(pid=116063) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 12:59:24.325479 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.compute.api [None req-4b24e56e-9ade-4f90-b054-a3f30614f7d9 tempest-AttachVolumeNegativeTest-1000400951 tempest-AttachVolumeNegativeTest-1000400951-project] [instance: 8d264701-aaa0-465f-a4aa-0cffa41351ef] Fetching instance by UUID {{(pid=116063) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 12:59:24.332594 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-4b24e56e-9ade-4f90-b054-a3f30614f7d9 tempest-AttachVolumeNegativeTest-1000400951 tempest-AttachVolumeNegativeTest-1000400951-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 12:59:24.333338 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-4b24e56e-9ade-4f90-b054-a3f30614f7d9 tempest-AttachVolumeNegativeTest-1000400951 tempest-AttachVolumeNegativeTest-1000400951-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 12:59:24.335034 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-4b24e56e-9ade-4f90-b054-a3f30614f7d9 tempest-AttachVolumeNegativeTest-1000400951 tempest-AttachVolumeNegativeTest-1000400951-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 12:59:24.335528 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-4b24e56e-9ade-4f90-b054-a3f30614f7d9 tempest-AttachVolumeNegativeTest-1000400951 tempest-AttachVolumeNegativeTest-1000400951-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 12:59:24.340632 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.policy [None req-65c32be6-1d6a-4b57-9509-cb21f4d92a0c tempest-VolumesActionsTest-648269150 tempest-VolumesActionsTest-648269150-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cc7290157ff4075b95ead815c2b332a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fa190426a6c4b9c9d6d259455a647ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116064) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 12:59:24.349226 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: INFO nova.api.openstack.requestlog [None req-65c32be6-1d6a-4b57-9509-cb21f4d92a0c tempest-VolumesActionsTest-648269150 tempest-VolumesActionsTest-648269150-project] 10.222.0.49 "GET /compute/v2.1/servers/7a410a38-0f6d-4e02-8db7-abd99e6a4fa1" status: 200 len: 1504 microversion: 2.1 time: 0.279992 Dec 14 12:59:24.350687 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: [pid: 116064|app: 0|req: 132/281] 10.222.0.49 () {58 vars in 1235 bytes} [Tue Dec 14 12:59:24 2021] GET /compute/v2.1/servers/7a410a38-0f6d-4e02-8db7-abd99e6a4fa1 => generated 1504 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 14 12:59:24.508157 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.policy [None req-4b24e56e-9ade-4f90-b054-a3f30614f7d9 tempest-AttachVolumeNegativeTest-1000400951 tempest-AttachVolumeNegativeTest-1000400951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57d0ec01f0784c8ea87d339980bed3cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad27b8951cae4eeeafa257f45217653a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116063) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 12:59:24.518014 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: INFO nova.api.openstack.requestlog [None req-4b24e56e-9ade-4f90-b054-a3f30614f7d9 tempest-AttachVolumeNegativeTest-1000400951 tempest-AttachVolumeNegativeTest-1000400951-project] 10.222.0.49 "GET /compute/v2.1/servers/8d264701-aaa0-465f-a4aa-0cffa41351ef" status: 200 len: 1317 microversion: 2.1 time: 0.202145 Dec 14 12:59:24.518741 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: [pid: 116063|app: 0|req: 150/282] 10.222.0.49 () {58 vars in 1235 bytes} [Tue Dec 14 12:59:24 2021] GET /compute/v2.1/servers/8d264701-aaa0-465f-a4aa-0cffa41351ef => generated 1317 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 14 12:59:24.924907 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.api.openstack.wsgi [None req-529b9720-6585-4648-98ac-cd06398997d3 tempest-ServerRescueNegativeTestJSON-1573931620 tempest-ServerRescueNegativeTestJSON-1573931620-project] Calling method '>' {{(pid=116064) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 12:59:24.925527 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.compute.api [None req-529b9720-6585-4648-98ac-cd06398997d3 tempest-ServerRescueNegativeTestJSON-1573931620 tempest-ServerRescueNegativeTestJSON-1573931620-project] [instance: 60694e1e-d0cb-41c8-adf5-bdda49804385] Fetching instance by UUID {{(pid=116064) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 12:59:24.935835 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-529b9720-6585-4648-98ac-cd06398997d3 tempest-ServerRescueNegativeTestJSON-1573931620 tempest-ServerRescueNegativeTestJSON-1573931620-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 12:59:24.936550 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-529b9720-6585-4648-98ac-cd06398997d3 tempest-ServerRescueNegativeTestJSON-1573931620 tempest-ServerRescueNegativeTestJSON-1573931620-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 12:59:24.937542 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-529b9720-6585-4648-98ac-cd06398997d3 tempest-ServerRescueNegativeTestJSON-1573931620 tempest-ServerRescueNegativeTestJSON-1573931620-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 12:59:24.938156 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-529b9720-6585-4648-98ac-cd06398997d3 tempest-ServerRescueNegativeTestJSON-1573931620 tempest-ServerRescueNegativeTestJSON-1573931620-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 12:59:25.008780 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.api.openstack.wsgi [None req-e9c2f122-0720-4d4c-8110-3aa0360120e4 tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116063) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 14 12:59:25.010429 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.compute.api [None req-e9c2f122-0720-4d4c-8110-3aa0360120e4 tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] [instance: c8de7730-62f2-4a77-b1e9-cf6a74fa366d] Fetching instance by UUID {{(pid=116063) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 12:59:25.019572 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-e9c2f122-0720-4d4c-8110-3aa0360120e4 tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 12:59:25.020417 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-e9c2f122-0720-4d4c-8110-3aa0360120e4 tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 12:59:25.021422 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-e9c2f122-0720-4d4c-8110-3aa0360120e4 tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 12:59:25.022002 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-e9c2f122-0720-4d4c-8110-3aa0360120e4 tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 12:59:25.116241 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: INFO nova.api.openstack.requestlog [None req-e9c2f122-0720-4d4c-8110-3aa0360120e4 tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] 10.222.0.49 "POST /compute/v2.1/servers/c8de7730-62f2-4a77-b1e9-cf6a74fa366d/action" status: 200 len: 28120 microversion: 2.20 time: 0.111497 Dec 14 12:59:25.120287 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: [pid: 116063|app: 0|req: 151/283] 10.222.0.49 () {62 vars in 1318 bytes} [Tue Dec 14 12:59:25 2021] POST /compute/v2.1/servers/c8de7730-62f2-4a77-b1e9-cf6a74fa366d/action => generated 28120 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 14 12:59:25.179105 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.policy [None req-529b9720-6585-4648-98ac-cd06398997d3 tempest-ServerRescueNegativeTestJSON-1573931620 tempest-ServerRescueNegativeTestJSON-1573931620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '731cbbfe17214ded8ac66299d66dfc45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '010919ea84eb4eb8b936c63153600eba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116064) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 12:59:25.188805 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: INFO nova.api.openstack.requestlog [None req-529b9720-6585-4648-98ac-cd06398997d3 tempest-ServerRescueNegativeTestJSON-1573931620 tempest-ServerRescueNegativeTestJSON-1573931620-project] 10.222.0.49 "GET /compute/v2.1/servers/60694e1e-d0cb-41c8-adf5-bdda49804385" status: 200 len: 1523 microversion: 2.1 time: 0.270026 Dec 14 12:59:25.198976 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: [pid: 116064|app: 0|req: 133/284] 10.222.0.49 () {58 vars in 1235 bytes} [Tue Dec 14 12:59:24 2021] GET /compute/v2.1/servers/60694e1e-d0cb-41c8-adf5-bdda49804385 => generated 1523 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 14 12:59:25.236085 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.api.openstack.wsgi [None req-385383fc-568a-4d89-a94d-80013ea2aa67 tempest-VolumesSnapshotTestJSON-1649574085 tempest-VolumesSnapshotTestJSON-1649574085-project] Calling method '>' {{(pid=116063) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 12:59:25.236939 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.compute.api [None req-385383fc-568a-4d89-a94d-80013ea2aa67 tempest-VolumesSnapshotTestJSON-1649574085 tempest-VolumesSnapshotTestJSON-1649574085-project] [instance: c48d3c23-3b4b-4220-8ead-d04a670ec64f] Fetching instance by UUID {{(pid=116063) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 12:59:25.245020 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-385383fc-568a-4d89-a94d-80013ea2aa67 tempest-VolumesSnapshotTestJSON-1649574085 tempest-VolumesSnapshotTestJSON-1649574085-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 12:59:25.246620 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-385383fc-568a-4d89-a94d-80013ea2aa67 tempest-VolumesSnapshotTestJSON-1649574085 tempest-VolumesSnapshotTestJSON-1649574085-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 12:59:25.247579 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-385383fc-568a-4d89-a94d-80013ea2aa67 tempest-VolumesSnapshotTestJSON-1649574085 tempest-VolumesSnapshotTestJSON-1649574085-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 12:59:25.248023 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-385383fc-568a-4d89-a94d-80013ea2aa67 tempest-VolumesSnapshotTestJSON-1649574085 tempest-VolumesSnapshotTestJSON-1649574085-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 12:59:25.330013 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.api.openstack.wsgi [None req-ff4c3c13-021c-4b99-aaae-2b80391206d0 tempest-VolumesNegativeTest-1177368279 tempest-VolumesNegativeTest-1177368279-project] Calling method '>' {{(pid=116064) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 12:59:25.330630 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.compute.api [None req-ff4c3c13-021c-4b99-aaae-2b80391206d0 tempest-VolumesNegativeTest-1177368279 tempest-VolumesNegativeTest-1177368279-project] [instance: 64bca4a7-c923-443e-a304-580fcbd76c14] Fetching instance by UUID {{(pid=116064) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 12:59:25.337258 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-ff4c3c13-021c-4b99-aaae-2b80391206d0 tempest-VolumesNegativeTest-1177368279 tempest-VolumesNegativeTest-1177368279-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 12:59:25.349743 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-ff4c3c13-021c-4b99-aaae-2b80391206d0 tempest-VolumesNegativeTest-1177368279 tempest-VolumesNegativeTest-1177368279-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 12:59:25.350594 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-ff4c3c13-021c-4b99-aaae-2b80391206d0 tempest-VolumesNegativeTest-1177368279 tempest-VolumesNegativeTest-1177368279-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 12:59:25.351035 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-ff4c3c13-021c-4b99-aaae-2b80391206d0 tempest-VolumesNegativeTest-1177368279 tempest-VolumesNegativeTest-1177368279-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 12:59:25.521899 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.policy [None req-ff4c3c13-021c-4b99-aaae-2b80391206d0 tempest-VolumesNegativeTest-1177368279 tempest-VolumesNegativeTest-1177368279-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68514732cd1d4c9d8181796d4573303f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fe74d6e6bd748d4a6f320530dffe300', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116064) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 12:59:25.523086 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: INFO nova.api.openstack.requestlog [None req-ff4c3c13-021c-4b99-aaae-2b80391206d0 tempest-VolumesNegativeTest-1177368279 tempest-VolumesNegativeTest-1177368279-project] 10.222.0.49 "GET /compute/v2.1/servers/64bca4a7-c923-443e-a304-580fcbd76c14" status: 200 len: 1266 microversion: 2.1 time: 0.196810 Dec 14 12:59:25.523086 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: [pid: 116064|app: 0|req: 134/285] 10.222.0.49 () {58 vars in 1235 bytes} [Tue Dec 14 12:59:25 2021] GET /compute/v2.1/servers/64bca4a7-c923-443e-a304-580fcbd76c14 => generated 1266 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 14 12:59:25.534772 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.api.openstack.wsgi [None req-012c5b13-fb4d-43b7-8374-7e5d64b2ad07 tempest-VolumesActionsTest-648269150 tempest-VolumesActionsTest-648269150-project] Calling method '>' {{(pid=116064) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 12:59:25.534772 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.compute.api [None req-012c5b13-fb4d-43b7-8374-7e5d64b2ad07 tempest-VolumesActionsTest-648269150 tempest-VolumesActionsTest-648269150-project] [instance: 7a410a38-0f6d-4e02-8db7-abd99e6a4fa1] Fetching instance by UUID {{(pid=116064) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 12:59:25.540465 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.policy [None req-385383fc-568a-4d89-a94d-80013ea2aa67 tempest-VolumesSnapshotTestJSON-1649574085 tempest-VolumesSnapshotTestJSON-1649574085-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e18311fd2704616a778d36332f199ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1bf776f341b4721b28eb9a5c84ba866', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116063) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 12:59:25.553118 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-012c5b13-fb4d-43b7-8374-7e5d64b2ad07 tempest-VolumesActionsTest-648269150 tempest-VolumesActionsTest-648269150-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 12:59:25.553601 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-012c5b13-fb4d-43b7-8374-7e5d64b2ad07 tempest-VolumesActionsTest-648269150 tempest-VolumesActionsTest-648269150-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 12:59:25.554255 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: INFO nova.api.openstack.requestlog [None req-385383fc-568a-4d89-a94d-80013ea2aa67 tempest-VolumesSnapshotTestJSON-1649574085 tempest-VolumesSnapshotTestJSON-1649574085-project] 10.222.0.49 "GET /compute/v2.1/servers/c48d3c23-3b4b-4220-8ead-d04a670ec64f" status: 200 len: 1508 microversion: 2.1 time: 0.323081 Dec 14 12:59:25.554441 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-012c5b13-fb4d-43b7-8374-7e5d64b2ad07 tempest-VolumesActionsTest-648269150 tempest-VolumesActionsTest-648269150-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 12:59:25.554876 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-012c5b13-fb4d-43b7-8374-7e5d64b2ad07 tempest-VolumesActionsTest-648269150 tempest-VolumesActionsTest-648269150-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 12:59:25.556552 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: [pid: 116063|app: 0|req: 152/286] 10.222.0.49 () {58 vars in 1235 bytes} [Tue Dec 14 12:59:25 2021] GET /compute/v2.1/servers/c48d3c23-3b4b-4220-8ead-d04a670ec64f => generated 1508 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 14 12:59:25.567592 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.api.openstack.wsgi [None req-5d162e75-54dc-4198-a5c0-cd10435f8e84 tempest-AttachVolumeNegativeTest-1000400951 tempest-AttachVolumeNegativeTest-1000400951-project] Calling method '>' {{(pid=116063) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 12:59:25.568501 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.compute.api [None req-5d162e75-54dc-4198-a5c0-cd10435f8e84 tempest-AttachVolumeNegativeTest-1000400951 tempest-AttachVolumeNegativeTest-1000400951-project] [instance: 8d264701-aaa0-465f-a4aa-0cffa41351ef] Fetching instance by UUID {{(pid=116063) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 12:59:25.579441 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-5d162e75-54dc-4198-a5c0-cd10435f8e84 tempest-AttachVolumeNegativeTest-1000400951 tempest-AttachVolumeNegativeTest-1000400951-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 12:59:25.580929 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-5d162e75-54dc-4198-a5c0-cd10435f8e84 tempest-AttachVolumeNegativeTest-1000400951 tempest-AttachVolumeNegativeTest-1000400951-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 12:59:25.581726 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-5d162e75-54dc-4198-a5c0-cd10435f8e84 tempest-AttachVolumeNegativeTest-1000400951 tempest-AttachVolumeNegativeTest-1000400951-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 12:59:25.582154 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-5d162e75-54dc-4198-a5c0-cd10435f8e84 tempest-AttachVolumeNegativeTest-1000400951 tempest-AttachVolumeNegativeTest-1000400951-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 12:59:25.848288 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.policy [None req-012c5b13-fb4d-43b7-8374-7e5d64b2ad07 tempest-VolumesActionsTest-648269150 tempest-VolumesActionsTest-648269150-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cc7290157ff4075b95ead815c2b332a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fa190426a6c4b9c9d6d259455a647ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116064) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 12:59:25.864969 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: INFO nova.api.openstack.requestlog [None req-012c5b13-fb4d-43b7-8374-7e5d64b2ad07 tempest-VolumesActionsTest-648269150 tempest-VolumesActionsTest-648269150-project] 10.222.0.49 "GET /compute/v2.1/servers/7a410a38-0f6d-4e02-8db7-abd99e6a4fa1" status: 200 len: 1504 microversion: 2.1 time: 0.341356 Dec 14 12:59:25.866781 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: [pid: 116064|app: 0|req: 135/287] 10.222.0.49 () {58 vars in 1235 bytes} [Tue Dec 14 12:59:25 2021] GET /compute/v2.1/servers/7a410a38-0f6d-4e02-8db7-abd99e6a4fa1 => generated 1504 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 14 12:59:25.946813 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.policy [None req-5d162e75-54dc-4198-a5c0-cd10435f8e84 tempest-AttachVolumeNegativeTest-1000400951 tempest-AttachVolumeNegativeTest-1000400951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57d0ec01f0784c8ea87d339980bed3cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad27b8951cae4eeeafa257f45217653a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116063) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 12:59:25.958734 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: INFO nova.api.openstack.requestlog [None req-5d162e75-54dc-4198-a5c0-cd10435f8e84 tempest-AttachVolumeNegativeTest-1000400951 tempest-AttachVolumeNegativeTest-1000400951-project] 10.222.0.49 "GET /compute/v2.1/servers/8d264701-aaa0-465f-a4aa-0cffa41351ef" status: 200 len: 1317 microversion: 2.1 time: 0.400899 Dec 14 12:59:25.962416 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: [pid: 116063|app: 0|req: 153/288] 10.222.0.49 () {58 vars in 1235 bytes} [Tue Dec 14 12:59:25 2021] GET /compute/v2.1/servers/8d264701-aaa0-465f-a4aa-0cffa41351ef => generated 1317 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 14 12:59:26.147671 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.api.openstack.wsgi [None req-87c4f5e2-b93c-44b5-aa7d-995aaec311ca tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116064) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 14 12:59:26.156873 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.compute.api [None req-87c4f5e2-b93c-44b5-aa7d-995aaec311ca tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] [instance: c8de7730-62f2-4a77-b1e9-cf6a74fa366d] Fetching instance by UUID {{(pid=116064) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 12:59:26.170122 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-87c4f5e2-b93c-44b5-aa7d-995aaec311ca tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 12:59:26.174034 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-87c4f5e2-b93c-44b5-aa7d-995aaec311ca tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 12:59:26.175210 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-87c4f5e2-b93c-44b5-aa7d-995aaec311ca tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 12:59:26.175866 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-87c4f5e2-b93c-44b5-aa7d-995aaec311ca tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 12:59:26.207677 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.api.openstack.wsgi [None req-de63b460-4ca7-4095-b60a-3d8066058324 tempest-ServerRescueNegativeTestJSON-1573931620 tempest-ServerRescueNegativeTestJSON-1573931620-project] Calling method '>' {{(pid=116063) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 12:59:26.208785 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.compute.api [None req-de63b460-4ca7-4095-b60a-3d8066058324 tempest-ServerRescueNegativeTestJSON-1573931620 tempest-ServerRescueNegativeTestJSON-1573931620-project] [instance: 60694e1e-d0cb-41c8-adf5-bdda49804385] Fetching instance by UUID {{(pid=116063) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 12:59:26.217988 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-de63b460-4ca7-4095-b60a-3d8066058324 tempest-ServerRescueNegativeTestJSON-1573931620 tempest-ServerRescueNegativeTestJSON-1573931620-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 12:59:26.220152 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-de63b460-4ca7-4095-b60a-3d8066058324 tempest-ServerRescueNegativeTestJSON-1573931620 tempest-ServerRescueNegativeTestJSON-1573931620-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 12:59:26.222325 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-de63b460-4ca7-4095-b60a-3d8066058324 tempest-ServerRescueNegativeTestJSON-1573931620 tempest-ServerRescueNegativeTestJSON-1573931620-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 12:59:26.223112 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-de63b460-4ca7-4095-b60a-3d8066058324 tempest-ServerRescueNegativeTestJSON-1573931620 tempest-ServerRescueNegativeTestJSON-1573931620-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 12:59:26.334551 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: INFO nova.api.openstack.requestlog [None req-87c4f5e2-b93c-44b5-aa7d-995aaec311ca tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] 10.222.0.49 "POST /compute/v2.1/servers/c8de7730-62f2-4a77-b1e9-cf6a74fa366d/action" status: 200 len: 28411 microversion: 2.20 time: 0.206353 Dec 14 12:59:26.335856 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: [pid: 116064|app: 0|req: 136/289] 10.222.0.49 () {62 vars in 1318 bytes} [Tue Dec 14 12:59:26 2021] POST /compute/v2.1/servers/c8de7730-62f2-4a77-b1e9-cf6a74fa366d/action => generated 28411 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 14 12:59:26.342109 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.api.openstack.wsgi [req-b499a8c2-9155-4d8f-8aea-0ff878e123fd req-85367adb-e651-4a62-805b-4000e7483fd1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7a410a38-0f6d-4e02-8db7-abd99e6a4fa1", "name": "network-vif-deleted", "tag": "7d1aa989-c06a-4f16-bb14-af862f53bf9b"}]} {{(pid=116064) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 14 12:59:26.344925 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 14 12:59:26.344925 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: warnings.warn(msg) Dec 14 12:59:26.354399 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [req-b499a8c2-9155-4d8f-8aea-0ff878e123fd req-85367adb-e651-4a62-805b-4000e7483fd1 service nova] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 12:59:26.355074 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [req-b499a8c2-9155-4d8f-8aea-0ff878e123fd req-85367adb-e651-4a62-805b-4000e7483fd1 service nova] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 12:59:26.367602 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: INFO nova.api.openstack.compute.server_external_events [req-b499a8c2-9155-4d8f-8aea-0ff878e123fd req-85367adb-e651-4a62-805b-4000e7483fd1 service nova] Creating event network-vif-deleted:7d1aa989-c06a-4f16-bb14-af862f53bf9b for instance 7a410a38-0f6d-4e02-8db7-abd99e6a4fa1 on hv-cinder-78447 Dec 14 12:59:26.373258 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: INFO nova.api.openstack.requestlog [req-b499a8c2-9155-4d8f-8aea-0ff878e123fd req-85367adb-e651-4a62-805b-4000e7483fd1 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035810 Dec 14 12:59:26.374175 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: [pid: 116064|app: 0|req: 137/290] 10.222.0.49 () {64 vars in 1317 bytes} [Tue Dec 14 12:59:26 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 14 12:59:26.492749 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.policy [None req-de63b460-4ca7-4095-b60a-3d8066058324 tempest-ServerRescueNegativeTestJSON-1573931620 tempest-ServerRescueNegativeTestJSON-1573931620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '731cbbfe17214ded8ac66299d66dfc45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '010919ea84eb4eb8b936c63153600eba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116063) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 12:59:26.501066 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: INFO nova.api.openstack.requestlog [None req-de63b460-4ca7-4095-b60a-3d8066058324 tempest-ServerRescueNegativeTestJSON-1573931620 tempest-ServerRescueNegativeTestJSON-1573931620-project] 10.222.0.49 "GET /compute/v2.1/servers/60694e1e-d0cb-41c8-adf5-bdda49804385" status: 200 len: 1523 microversion: 2.1 time: 0.298550 Dec 14 12:59:26.501814 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: [pid: 116063|app: 0|req: 154/291] 10.222.0.49 () {58 vars in 1235 bytes} [Tue Dec 14 12:59:26 2021] GET /compute/v2.1/servers/60694e1e-d0cb-41c8-adf5-bdda49804385 => generated 1523 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 14 12:59:26.542933 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.api.openstack.wsgi [None req-31093a03-6849-4e32-a6f7-3fd84dffed7c tempest-VolumesNegativeTest-1177368279 tempest-VolumesNegativeTest-1177368279-project] Calling method '>' {{(pid=116064) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 12:59:26.544106 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.compute.api [None req-31093a03-6849-4e32-a6f7-3fd84dffed7c tempest-VolumesNegativeTest-1177368279 tempest-VolumesNegativeTest-1177368279-project] [instance: 64bca4a7-c923-443e-a304-580fcbd76c14] Fetching instance by UUID {{(pid=116064) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 12:59:26.558280 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-31093a03-6849-4e32-a6f7-3fd84dffed7c tempest-VolumesNegativeTest-1177368279 tempest-VolumesNegativeTest-1177368279-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 12:59:26.558562 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-31093a03-6849-4e32-a6f7-3fd84dffed7c tempest-VolumesNegativeTest-1177368279 tempest-VolumesNegativeTest-1177368279-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 12:59:26.559348 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-31093a03-6849-4e32-a6f7-3fd84dffed7c tempest-VolumesNegativeTest-1177368279 tempest-VolumesNegativeTest-1177368279-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 12:59:26.559772 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-31093a03-6849-4e32-a6f7-3fd84dffed7c tempest-VolumesNegativeTest-1177368279 tempest-VolumesNegativeTest-1177368279-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 12:59:26.660467 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.policy [None req-31093a03-6849-4e32-a6f7-3fd84dffed7c tempest-VolumesNegativeTest-1177368279 tempest-VolumesNegativeTest-1177368279-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68514732cd1d4c9d8181796d4573303f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fe74d6e6bd748d4a6f320530dffe300', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116064) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 12:59:26.669611 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: INFO nova.api.openstack.requestlog [None req-31093a03-6849-4e32-a6f7-3fd84dffed7c tempest-VolumesNegativeTest-1177368279 tempest-VolumesNegativeTest-1177368279-project] 10.222.0.49 "GET /compute/v2.1/servers/64bca4a7-c923-443e-a304-580fcbd76c14" status: 200 len: 1272 microversion: 2.1 time: 0.130906 Dec 14 12:59:26.670894 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: [pid: 116064|app: 0|req: 138/292] 10.222.0.49 () {58 vars in 1235 bytes} [Tue Dec 14 12:59:26 2021] GET /compute/v2.1/servers/64bca4a7-c923-443e-a304-580fcbd76c14 => generated 1272 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 14 12:59:26.884311 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.api.openstack.wsgi [None req-15650ed4-9918-4c99-926d-7560557cd8ba tempest-VolumesActionsTest-648269150 tempest-VolumesActionsTest-648269150-project] Calling method '>' {{(pid=116063) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 12:59:26.885306 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.compute.api [None req-15650ed4-9918-4c99-926d-7560557cd8ba tempest-VolumesActionsTest-648269150 tempest-VolumesActionsTest-648269150-project] [instance: 7a410a38-0f6d-4e02-8db7-abd99e6a4fa1] Fetching instance by UUID {{(pid=116063) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 12:59:26.892166 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-15650ed4-9918-4c99-926d-7560557cd8ba tempest-VolumesActionsTest-648269150 tempest-VolumesActionsTest-648269150-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 12:59:26.893071 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-15650ed4-9918-4c99-926d-7560557cd8ba tempest-VolumesActionsTest-648269150 tempest-VolumesActionsTest-648269150-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 12:59:26.895864 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-15650ed4-9918-4c99-926d-7560557cd8ba tempest-VolumesActionsTest-648269150 tempest-VolumesActionsTest-648269150-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 12:59:26.896480 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-15650ed4-9918-4c99-926d-7560557cd8ba tempest-VolumesActionsTest-648269150 tempest-VolumesActionsTest-648269150-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 12:59:26.931502 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-15650ed4-9918-4c99-926d-7560557cd8ba tempest-VolumesActionsTest-648269150 tempest-VolumesActionsTest-648269150-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 12:59:26.932395 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-15650ed4-9918-4c99-926d-7560557cd8ba tempest-VolumesActionsTest-648269150 tempest-VolumesActionsTest-648269150-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 12:59:26.933256 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.objects.instance [None req-15650ed4-9918-4c99-926d-7560557cd8ba tempest-VolumesActionsTest-648269150 tempest-VolumesActionsTest-648269150-project] Lazy-loading 'fault' on Instance uuid 7a410a38-0f6d-4e02-8db7-abd99e6a4fa1 {{(pid=116063) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Dec 14 12:59:26.980723 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.api.openstack.wsgi [None req-786d4931-e8e3-4886-bcfe-eb913283d109 tempest-AttachVolumeNegativeTest-1000400951 tempest-AttachVolumeNegativeTest-1000400951-project] Calling method '>' {{(pid=116064) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 12:59:26.981374 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.compute.api [None req-786d4931-e8e3-4886-bcfe-eb913283d109 tempest-AttachVolumeNegativeTest-1000400951 tempest-AttachVolumeNegativeTest-1000400951-project] [instance: 8d264701-aaa0-465f-a4aa-0cffa41351ef] Fetching instance by UUID {{(pid=116064) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 12:59:26.992972 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-786d4931-e8e3-4886-bcfe-eb913283d109 tempest-AttachVolumeNegativeTest-1000400951 tempest-AttachVolumeNegativeTest-1000400951-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 12:59:26.993462 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-786d4931-e8e3-4886-bcfe-eb913283d109 tempest-AttachVolumeNegativeTest-1000400951 tempest-AttachVolumeNegativeTest-1000400951-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 12:59:26.994311 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-786d4931-e8e3-4886-bcfe-eb913283d109 tempest-AttachVolumeNegativeTest-1000400951 tempest-AttachVolumeNegativeTest-1000400951-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 12:59:26.994936 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-786d4931-e8e3-4886-bcfe-eb913283d109 tempest-AttachVolumeNegativeTest-1000400951 tempest-AttachVolumeNegativeTest-1000400951-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 12:59:27.015414 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.policy [None req-15650ed4-9918-4c99-926d-7560557cd8ba tempest-VolumesActionsTest-648269150 tempest-VolumesActionsTest-648269150-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cc7290157ff4075b95ead815c2b332a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fa190426a6c4b9c9d6d259455a647ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116063) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 12:59:27.025491 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: INFO nova.api.openstack.requestlog [None req-15650ed4-9918-4c99-926d-7560557cd8ba tempest-VolumesActionsTest-648269150 tempest-VolumesActionsTest-648269150-project] 10.222.0.49 "GET /compute/v2.1/servers/7a410a38-0f6d-4e02-8db7-abd99e6a4fa1" status: 200 len: 1303 microversion: 2.1 time: 0.144815 Dec 14 12:59:27.032504 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: [pid: 116063|app: 0|req: 155/293] 10.222.0.49 () {58 vars in 1235 bytes} [Tue Dec 14 12:59:26 2021] GET /compute/v2.1/servers/7a410a38-0f6d-4e02-8db7-abd99e6a4fa1 => generated 1303 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 14 12:59:27.067357 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.api.openstack.wsgi [req-de24da32-908d-4e41-908b-2da517125285 req-be3feafb-7a89-49b3-ac18-33211531030f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8d264701-aaa0-465f-a4aa-0cffa41351ef", "name": "network-vif-plugged", "status": "completed", "tag": "3c4c685c-25bf-4592-b1c9-40dc336ec707"}]} {{(pid=116063) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 14 12:59:27.069324 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 14 12:59:27.069324 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: warnings.warn(msg) Dec 14 12:59:27.085999 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [req-de24da32-908d-4e41-908b-2da517125285 req-be3feafb-7a89-49b3-ac18-33211531030f service nova] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 12:59:27.086795 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [req-de24da32-908d-4e41-908b-2da517125285 req-be3feafb-7a89-49b3-ac18-33211531030f service nova] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 12:59:27.118275 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: INFO nova.api.openstack.compute.server_external_events [req-de24da32-908d-4e41-908b-2da517125285 req-be3feafb-7a89-49b3-ac18-33211531030f service nova] Creating event network-vif-plugged:3c4c685c-25bf-4592-b1c9-40dc336ec707 for instance 8d264701-aaa0-465f-a4aa-0cffa41351ef on hv-cinder-78447 Dec 14 12:59:27.127302 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: INFO nova.api.openstack.requestlog [req-de24da32-908d-4e41-908b-2da517125285 req-be3feafb-7a89-49b3-ac18-33211531030f service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.063728 Dec 14 12:59:27.128323 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: [pid: 116063|app: 0|req: 156/294] 10.222.0.49 () {64 vars in 1317 bytes} [Tue Dec 14 12:59:27 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 14 12:59:27.212160 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.policy [None req-786d4931-e8e3-4886-bcfe-eb913283d109 tempest-AttachVolumeNegativeTest-1000400951 tempest-AttachVolumeNegativeTest-1000400951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57d0ec01f0784c8ea87d339980bed3cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad27b8951cae4eeeafa257f45217653a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116064) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 12:59:27.219962 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: INFO nova.api.openstack.requestlog [None req-786d4931-e8e3-4886-bcfe-eb913283d109 tempest-AttachVolumeNegativeTest-1000400951 tempest-AttachVolumeNegativeTest-1000400951-project] 10.222.0.49 "GET /compute/v2.1/servers/8d264701-aaa0-465f-a4aa-0cffa41351ef" status: 200 len: 1317 microversion: 2.1 time: 0.243067 Dec 14 12:59:27.220544 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: [pid: 116064|app: 0|req: 139/295] 10.222.0.49 () {58 vars in 1235 bytes} [Tue Dec 14 12:59:26 2021] GET /compute/v2.1/servers/8d264701-aaa0-465f-a4aa-0cffa41351ef => generated 1317 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 14 12:59:27.348807 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.api.openstack.wsgi [None req-dc172c32-02fa-4290-82cd-6efa6da9e98d tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116063) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 14 12:59:27.350581 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.compute.api [None req-dc172c32-02fa-4290-82cd-6efa6da9e98d tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] [instance: c8de7730-62f2-4a77-b1e9-cf6a74fa366d] Fetching instance by UUID {{(pid=116063) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 12:59:27.383540 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-dc172c32-02fa-4290-82cd-6efa6da9e98d tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 12:59:27.383965 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-dc172c32-02fa-4290-82cd-6efa6da9e98d tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 12:59:27.384782 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-dc172c32-02fa-4290-82cd-6efa6da9e98d tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 12:59:27.385239 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-dc172c32-02fa-4290-82cd-6efa6da9e98d tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 12:59:27.508587 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: INFO nova.api.openstack.requestlog [None req-dc172c32-02fa-4290-82cd-6efa6da9e98d tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] 10.222.0.49 "POST /compute/v2.1/servers/c8de7730-62f2-4a77-b1e9-cf6a74fa366d/action" status: 200 len: 28471 microversion: 2.20 time: 0.163622 Dec 14 12:59:27.509206 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: [pid: 116063|app: 0|req: 157/296] 10.222.0.49 () {62 vars in 1318 bytes} [Tue Dec 14 12:59:27 2021] POST /compute/v2.1/servers/c8de7730-62f2-4a77-b1e9-cf6a74fa366d/action => generated 28471 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 14 12:59:27.519733 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.api.openstack.wsgi [None req-8801e343-4047-4fb6-af9f-6420410aa66c tempest-ServerRescueNegativeTestJSON-1573931620 tempest-ServerRescueNegativeTestJSON-1573931620-project] Calling method '>' {{(pid=116064) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 12:59:27.520670 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.compute.api [None req-8801e343-4047-4fb6-af9f-6420410aa66c tempest-ServerRescueNegativeTestJSON-1573931620 tempest-ServerRescueNegativeTestJSON-1573931620-project] [instance: 60694e1e-d0cb-41c8-adf5-bdda49804385] Fetching instance by UUID {{(pid=116064) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 12:59:27.533502 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-8801e343-4047-4fb6-af9f-6420410aa66c tempest-ServerRescueNegativeTestJSON-1573931620 tempest-ServerRescueNegativeTestJSON-1573931620-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 12:59:27.535063 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-8801e343-4047-4fb6-af9f-6420410aa66c tempest-ServerRescueNegativeTestJSON-1573931620 tempest-ServerRescueNegativeTestJSON-1573931620-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 12:59:27.537636 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-8801e343-4047-4fb6-af9f-6420410aa66c tempest-ServerRescueNegativeTestJSON-1573931620 tempest-ServerRescueNegativeTestJSON-1573931620-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 12:59:27.537760 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-8801e343-4047-4fb6-af9f-6420410aa66c tempest-ServerRescueNegativeTestJSON-1573931620 tempest-ServerRescueNegativeTestJSON-1573931620-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 12:59:27.691757 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.api.openstack.wsgi [None req-70030d91-9526-4956-8e23-bcd4a235cff6 tempest-VolumesNegativeTest-1177368279 tempest-VolumesNegativeTest-1177368279-project] Calling method '>' {{(pid=116063) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 12:59:27.692634 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.compute.api [None req-70030d91-9526-4956-8e23-bcd4a235cff6 tempest-VolumesNegativeTest-1177368279 tempest-VolumesNegativeTest-1177368279-project] [instance: 64bca4a7-c923-443e-a304-580fcbd76c14] Fetching instance by UUID {{(pid=116063) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 12:59:27.704318 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-70030d91-9526-4956-8e23-bcd4a235cff6 tempest-VolumesNegativeTest-1177368279 tempest-VolumesNegativeTest-1177368279-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 12:59:27.704951 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-70030d91-9526-4956-8e23-bcd4a235cff6 tempest-VolumesNegativeTest-1177368279 tempest-VolumesNegativeTest-1177368279-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 12:59:27.705992 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-70030d91-9526-4956-8e23-bcd4a235cff6 tempest-VolumesNegativeTest-1177368279 tempest-VolumesNegativeTest-1177368279-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 12:59:27.706611 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-70030d91-9526-4956-8e23-bcd4a235cff6 tempest-VolumesNegativeTest-1177368279 tempest-VolumesNegativeTest-1177368279-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 12:59:27.727070 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.policy [None req-8801e343-4047-4fb6-af9f-6420410aa66c tempest-ServerRescueNegativeTestJSON-1573931620 tempest-ServerRescueNegativeTestJSON-1573931620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '731cbbfe17214ded8ac66299d66dfc45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '010919ea84eb4eb8b936c63153600eba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116064) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 12:59:27.737401 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: INFO nova.api.openstack.requestlog [None req-8801e343-4047-4fb6-af9f-6420410aa66c tempest-ServerRescueNegativeTestJSON-1573931620 tempest-ServerRescueNegativeTestJSON-1573931620-project] 10.222.0.49 "GET /compute/v2.1/servers/60694e1e-d0cb-41c8-adf5-bdda49804385" status: 200 len: 1523 microversion: 2.1 time: 0.222837 Dec 14 12:59:27.738619 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: [pid: 116064|app: 0|req: 140/297] 10.222.0.49 () {58 vars in 1235 bytes} [Tue Dec 14 12:59:27 2021] GET /compute/v2.1/servers/60694e1e-d0cb-41c8-adf5-bdda49804385 => generated 1523 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 14 12:59:27.892983 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.policy [None req-70030d91-9526-4956-8e23-bcd4a235cff6 tempest-VolumesNegativeTest-1177368279 tempest-VolumesNegativeTest-1177368279-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68514732cd1d4c9d8181796d4573303f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fe74d6e6bd748d4a6f320530dffe300', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116063) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 12:59:27.900618 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: INFO nova.api.openstack.requestlog [None req-70030d91-9526-4956-8e23-bcd4a235cff6 tempest-VolumesNegativeTest-1177368279 tempest-VolumesNegativeTest-1177368279-project] 10.222.0.49 "GET /compute/v2.1/servers/64bca4a7-c923-443e-a304-580fcbd76c14" status: 200 len: 1314 microversion: 2.1 time: 0.215195 Dec 14 12:59:27.901377 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: [pid: 116063|app: 0|req: 158/298] 10.222.0.49 () {58 vars in 1235 bytes} [Tue Dec 14 12:59:27 2021] GET /compute/v2.1/servers/64bca4a7-c923-443e-a304-580fcbd76c14 => generated 1314 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 14 12:59:28.047596 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.api.openstack.wsgi [None req-ecf3fdf9-03f3-4636-8ea5-92c5d5c5fe5d tempest-VolumesActionsTest-648269150 tempest-VolumesActionsTest-648269150-project] Calling method '>' {{(pid=116064) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 12:59:28.048217 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.compute.api [None req-ecf3fdf9-03f3-4636-8ea5-92c5d5c5fe5d tempest-VolumesActionsTest-648269150 tempest-VolumesActionsTest-648269150-project] [instance: 7a410a38-0f6d-4e02-8db7-abd99e6a4fa1] Fetching instance by UUID {{(pid=116064) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 12:59:28.054432 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-ecf3fdf9-03f3-4636-8ea5-92c5d5c5fe5d tempest-VolumesActionsTest-648269150 tempest-VolumesActionsTest-648269150-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 12:59:28.054886 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-ecf3fdf9-03f3-4636-8ea5-92c5d5c5fe5d tempest-VolumesActionsTest-648269150 tempest-VolumesActionsTest-648269150-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 12:59:28.055686 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-ecf3fdf9-03f3-4636-8ea5-92c5d5c5fe5d tempest-VolumesActionsTest-648269150 tempest-VolumesActionsTest-648269150-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 12:59:28.056118 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-ecf3fdf9-03f3-4636-8ea5-92c5d5c5fe5d tempest-VolumesActionsTest-648269150 tempest-VolumesActionsTest-648269150-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 12:59:28.078117 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: INFO nova.api.openstack.wsgi [None req-ecf3fdf9-03f3-4636-8ea5-92c5d5c5fe5d tempest-VolumesActionsTest-648269150 tempest-VolumesActionsTest-648269150-project] HTTP exception thrown: Instance 7a410a38-0f6d-4e02-8db7-abd99e6a4fa1 could not be found. Dec 14 12:59:28.078990 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.api.openstack.wsgi [None req-ecf3fdf9-03f3-4636-8ea5-92c5d5c5fe5d tempest-VolumesActionsTest-648269150 tempest-VolumesActionsTest-648269150-project] Returning 404 to user: Instance 7a410a38-0f6d-4e02-8db7-abd99e6a4fa1 could not be found. {{(pid=116064) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 14 12:59:28.080678 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: INFO nova.api.openstack.requestlog [None req-ecf3fdf9-03f3-4636-8ea5-92c5d5c5fe5d tempest-VolumesActionsTest-648269150 tempest-VolumesActionsTest-648269150-project] 10.222.0.49 "GET /compute/v2.1/servers/7a410a38-0f6d-4e02-8db7-abd99e6a4fa1" status: 404 len: 111 microversion: 2.1 time: 0.037167 Dec 14 12:59:28.081703 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: [pid: 116064|app: 0|req: 141/299] 10.222.0.49 () {58 vars in 1235 bytes} [Tue Dec 14 12:59:28 2021] GET /compute/v2.1/servers/7a410a38-0f6d-4e02-8db7-abd99e6a4fa1 => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Dec 14 12:59:28.237374 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.api.openstack.wsgi [None req-16d16be4-8709-4434-a5d5-e70378f7f7bf tempest-AttachVolumeNegativeTest-1000400951 tempest-AttachVolumeNegativeTest-1000400951-project] Calling method '>' {{(pid=116063) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 12:59:28.238044 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.compute.api [None req-16d16be4-8709-4434-a5d5-e70378f7f7bf tempest-AttachVolumeNegativeTest-1000400951 tempest-AttachVolumeNegativeTest-1000400951-project] [instance: 8d264701-aaa0-465f-a4aa-0cffa41351ef] Fetching instance by UUID {{(pid=116063) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 12:59:28.250689 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-16d16be4-8709-4434-a5d5-e70378f7f7bf tempest-AttachVolumeNegativeTest-1000400951 tempest-AttachVolumeNegativeTest-1000400951-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 12:59:28.251927 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-16d16be4-8709-4434-a5d5-e70378f7f7bf tempest-AttachVolumeNegativeTest-1000400951 tempest-AttachVolumeNegativeTest-1000400951-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 12:59:28.253296 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-16d16be4-8709-4434-a5d5-e70378f7f7bf tempest-AttachVolumeNegativeTest-1000400951 tempest-AttachVolumeNegativeTest-1000400951-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 12:59:28.253899 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-16d16be4-8709-4434-a5d5-e70378f7f7bf tempest-AttachVolumeNegativeTest-1000400951 tempest-AttachVolumeNegativeTest-1000400951-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 12:59:28.400220 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.api.openstack.wsgi [req-02fb48c6-1231-4028-964c-f5f3cbbeeb7f req-cd75ba68-9095-4a58-8c93-3e8f534e70f0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "64bca4a7-c923-443e-a304-580fcbd76c14", "tag": "f3c25b41-d22f-41fb-921e-52e0ff1be2a4"}]} {{(pid=116064) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 14 12:59:28.405319 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 14 12:59:28.405319 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: warnings.warn(msg) Dec 14 12:59:28.418699 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [req-02fb48c6-1231-4028-964c-f5f3cbbeeb7f req-cd75ba68-9095-4a58-8c93-3e8f534e70f0 service nova] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 12:59:28.419315 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [req-02fb48c6-1231-4028-964c-f5f3cbbeeb7f req-cd75ba68-9095-4a58-8c93-3e8f534e70f0 service nova] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 12:59:28.444781 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: INFO nova.api.openstack.compute.server_external_events [req-02fb48c6-1231-4028-964c-f5f3cbbeeb7f req-cd75ba68-9095-4a58-8c93-3e8f534e70f0 service nova] Creating event network-changed:f3c25b41-d22f-41fb-921e-52e0ff1be2a4 for instance 64bca4a7-c923-443e-a304-580fcbd76c14 on hv-cinder-78447 Dec 14 12:59:28.451783 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: INFO nova.api.openstack.requestlog [req-02fb48c6-1231-4028-964c-f5f3cbbeeb7f req-cd75ba68-9095-4a58-8c93-3e8f534e70f0 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.055670 Dec 14 12:59:28.452339 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: [pid: 116064|app: 0|req: 142/300] 10.222.0.49 () {64 vars in 1317 bytes} [Tue Dec 14 12:59:28 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 14 12:59:28.504939 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.policy [None req-16d16be4-8709-4434-a5d5-e70378f7f7bf tempest-AttachVolumeNegativeTest-1000400951 tempest-AttachVolumeNegativeTest-1000400951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57d0ec01f0784c8ea87d339980bed3cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad27b8951cae4eeeafa257f45217653a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116063) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 12:59:28.518405 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: INFO nova.api.openstack.requestlog [None req-16d16be4-8709-4434-a5d5-e70378f7f7bf tempest-AttachVolumeNegativeTest-1000400951 tempest-AttachVolumeNegativeTest-1000400951-project] 10.222.0.49 "GET /compute/v2.1/servers/8d264701-aaa0-465f-a4aa-0cffa41351ef" status: 200 len: 1317 microversion: 2.1 time: 0.286121 Dec 14 12:59:28.522530 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: [pid: 116063|app: 0|req: 159/301] 10.222.0.49 () {58 vars in 1235 bytes} [Tue Dec 14 12:59:28 2021] GET /compute/v2.1/servers/8d264701-aaa0-465f-a4aa-0cffa41351ef => generated 1317 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 14 12:59:28.523042 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.api.openstack.wsgi [None req-8535c120-a425-4db7-bb1c-d5b52bff9b10 tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116064) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 14 12:59:28.524668 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.compute.api [None req-8535c120-a425-4db7-bb1c-d5b52bff9b10 tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] [instance: c8de7730-62f2-4a77-b1e9-cf6a74fa366d] Fetching instance by UUID {{(pid=116064) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 12:59:28.538776 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-8535c120-a425-4db7-bb1c-d5b52bff9b10 tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 12:59:28.541379 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-8535c120-a425-4db7-bb1c-d5b52bff9b10 tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 12:59:28.543129 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-8535c120-a425-4db7-bb1c-d5b52bff9b10 tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 12:59:28.544064 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-8535c120-a425-4db7-bb1c-d5b52bff9b10 tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 12:59:28.687694 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: INFO nova.api.openstack.requestlog [None req-8535c120-a425-4db7-bb1c-d5b52bff9b10 tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] 10.222.0.49 "POST /compute/v2.1/servers/c8de7730-62f2-4a77-b1e9-cf6a74fa366d/action" status: 200 len: 28576 microversion: 2.20 time: 0.171151 Dec 14 12:59:28.689667 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: [pid: 116064|app: 0|req: 143/302] 10.222.0.49 () {62 vars in 1318 bytes} [Tue Dec 14 12:59:28 2021] POST /compute/v2.1/servers/c8de7730-62f2-4a77-b1e9-cf6a74fa366d/action => generated 28576 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Dec 14 12:59:28.756819 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.api.openstack.wsgi [None req-0fa59114-72fd-4bc1-8181-743929f1ff6a tempest-ServerRescueNegativeTestJSON-1573931620 tempest-ServerRescueNegativeTestJSON-1573931620-project] Calling method '>' {{(pid=116063) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 12:59:28.757618 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.compute.api [None req-0fa59114-72fd-4bc1-8181-743929f1ff6a tempest-ServerRescueNegativeTestJSON-1573931620 tempest-ServerRescueNegativeTestJSON-1573931620-project] [instance: 60694e1e-d0cb-41c8-adf5-bdda49804385] Fetching instance by UUID {{(pid=116063) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 12:59:28.764871 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-0fa59114-72fd-4bc1-8181-743929f1ff6a tempest-ServerRescueNegativeTestJSON-1573931620 tempest-ServerRescueNegativeTestJSON-1573931620-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 12:59:28.765367 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-0fa59114-72fd-4bc1-8181-743929f1ff6a tempest-ServerRescueNegativeTestJSON-1573931620 tempest-ServerRescueNegativeTestJSON-1573931620-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 12:59:28.766176 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-0fa59114-72fd-4bc1-8181-743929f1ff6a tempest-ServerRescueNegativeTestJSON-1573931620 tempest-ServerRescueNegativeTestJSON-1573931620-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 12:59:28.766789 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-0fa59114-72fd-4bc1-8181-743929f1ff6a tempest-ServerRescueNegativeTestJSON-1573931620 tempest-ServerRescueNegativeTestJSON-1573931620-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 12:59:28.941286 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.api.openstack.wsgi [None req-5dc27792-c687-4f80-a60a-284c9f3ce67f tempest-VolumesNegativeTest-1177368279 tempest-VolumesNegativeTest-1177368279-project] Calling method '>' {{(pid=116064) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 12:59:28.941286 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.compute.api [None req-5dc27792-c687-4f80-a60a-284c9f3ce67f tempest-VolumesNegativeTest-1177368279 tempest-VolumesNegativeTest-1177368279-project] [instance: 64bca4a7-c923-443e-a304-580fcbd76c14] Fetching instance by UUID {{(pid=116064) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 12:59:28.944466 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-5dc27792-c687-4f80-a60a-284c9f3ce67f tempest-VolumesNegativeTest-1177368279 tempest-VolumesNegativeTest-1177368279-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 12:59:28.945073 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-5dc27792-c687-4f80-a60a-284c9f3ce67f tempest-VolumesNegativeTest-1177368279 tempest-VolumesNegativeTest-1177368279-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 12:59:28.945792 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-5dc27792-c687-4f80-a60a-284c9f3ce67f tempest-VolumesNegativeTest-1177368279 tempest-VolumesNegativeTest-1177368279-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 12:59:28.952293 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-5dc27792-c687-4f80-a60a-284c9f3ce67f tempest-VolumesNegativeTest-1177368279 tempest-VolumesNegativeTest-1177368279-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 12:59:28.952452 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.policy [None req-0fa59114-72fd-4bc1-8181-743929f1ff6a tempest-ServerRescueNegativeTestJSON-1573931620 tempest-ServerRescueNegativeTestJSON-1573931620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '731cbbfe17214ded8ac66299d66dfc45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '010919ea84eb4eb8b936c63153600eba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116063) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 12:59:28.961575 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: INFO nova.api.openstack.requestlog [None req-0fa59114-72fd-4bc1-8181-743929f1ff6a tempest-ServerRescueNegativeTestJSON-1573931620 tempest-ServerRescueNegativeTestJSON-1573931620-project] 10.222.0.49 "GET /compute/v2.1/servers/60694e1e-d0cb-41c8-adf5-bdda49804385" status: 200 len: 1503 microversion: 2.1 time: 0.210243 Dec 14 12:59:28.962228 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: [pid: 116063|app: 0|req: 160/303] 10.222.0.49 () {58 vars in 1235 bytes} [Tue Dec 14 12:59:28 2021] GET /compute/v2.1/servers/60694e1e-d0cb-41c8-adf5-bdda49804385 => generated 1503 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 14 12:59:28.983730 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.api.openstack.wsgi [None req-49816608-fb5f-4c12-bfad-4c2b41f11a5a tempest-ServerRescueNegativeTestJSON-1573931620 tempest-ServerRescueNegativeTestJSON-1573931620-project] Calling method '>' {{(pid=116063) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 12:59:28.984643 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.compute.api [None req-49816608-fb5f-4c12-bfad-4c2b41f11a5a tempest-ServerRescueNegativeTestJSON-1573931620 tempest-ServerRescueNegativeTestJSON-1573931620-project] [instance: eb6e04a4-8901-47df-9b51-7c1664bd3f6c] Fetching instance by UUID {{(pid=116063) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 12:59:28.997396 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-49816608-fb5f-4c12-bfad-4c2b41f11a5a tempest-ServerRescueNegativeTestJSON-1573931620 tempest-ServerRescueNegativeTestJSON-1573931620-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 12:59:28.997941 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-49816608-fb5f-4c12-bfad-4c2b41f11a5a tempest-ServerRescueNegativeTestJSON-1573931620 tempest-ServerRescueNegativeTestJSON-1573931620-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 12:59:28.999217 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-49816608-fb5f-4c12-bfad-4c2b41f11a5a tempest-ServerRescueNegativeTestJSON-1573931620 tempest-ServerRescueNegativeTestJSON-1573931620-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 12:59:29.000743 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-49816608-fb5f-4c12-bfad-4c2b41f11a5a tempest-ServerRescueNegativeTestJSON-1573931620 tempest-ServerRescueNegativeTestJSON-1573931620-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 12:59:29.275709 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.policy [None req-5dc27792-c687-4f80-a60a-284c9f3ce67f tempest-VolumesNegativeTest-1177368279 tempest-VolumesNegativeTest-1177368279-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68514732cd1d4c9d8181796d4573303f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fe74d6e6bd748d4a6f320530dffe300', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116064) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 12:59:29.284475 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: INFO nova.api.openstack.requestlog [None req-5dc27792-c687-4f80-a60a-284c9f3ce67f tempest-VolumesNegativeTest-1177368279 tempest-VolumesNegativeTest-1177368279-project] 10.222.0.49 "GET /compute/v2.1/servers/64bca4a7-c923-443e-a304-580fcbd76c14" status: 200 len: 1314 microversion: 2.1 time: 0.357036 Dec 14 12:59:29.285376 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: [pid: 116064|app: 0|req: 144/304] 10.222.0.49 () {58 vars in 1235 bytes} [Tue Dec 14 12:59:28 2021] GET /compute/v2.1/servers/64bca4a7-c923-443e-a304-580fcbd76c14 => generated 1314 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 14 12:59:29.308909 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.policy [None req-49816608-fb5f-4c12-bfad-4c2b41f11a5a tempest-ServerRescueNegativeTestJSON-1573931620 tempest-ServerRescueNegativeTestJSON-1573931620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '731cbbfe17214ded8ac66299d66dfc45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '010919ea84eb4eb8b936c63153600eba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116063) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 12:59:29.316390 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: INFO nova.api.openstack.requestlog [None req-49816608-fb5f-4c12-bfad-4c2b41f11a5a tempest-ServerRescueNegativeTestJSON-1573931620 tempest-ServerRescueNegativeTestJSON-1573931620-project] 10.222.0.49 "GET /compute/v2.1/servers/eb6e04a4-8901-47df-9b51-7c1664bd3f6c" status: 200 len: 1517 microversion: 2.1 time: 0.336842 Dec 14 12:59:29.321021 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: [pid: 116063|app: 0|req: 161/305] 10.222.0.49 () {58 vars in 1235 bytes} [Tue Dec 14 12:59:28 2021] GET /compute/v2.1/servers/eb6e04a4-8901-47df-9b51-7c1664bd3f6c => generated 1517 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 14 12:59:29.536237 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.api.openstack.wsgi [None req-4378ff5f-4ec5-47ae-beea-c6724756c26f tempest-AttachVolumeNegativeTest-1000400951 tempest-AttachVolumeNegativeTest-1000400951-project] Calling method '>' {{(pid=116064) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 12:59:29.537498 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.compute.api [None req-4378ff5f-4ec5-47ae-beea-c6724756c26f tempest-AttachVolumeNegativeTest-1000400951 tempest-AttachVolumeNegativeTest-1000400951-project] [instance: 8d264701-aaa0-465f-a4aa-0cffa41351ef] Fetching instance by UUID {{(pid=116064) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 12:59:29.548392 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-4378ff5f-4ec5-47ae-beea-c6724756c26f tempest-AttachVolumeNegativeTest-1000400951 tempest-AttachVolumeNegativeTest-1000400951-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 12:59:29.548807 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-4378ff5f-4ec5-47ae-beea-c6724756c26f tempest-AttachVolumeNegativeTest-1000400951 tempest-AttachVolumeNegativeTest-1000400951-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 12:59:29.549642 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-4378ff5f-4ec5-47ae-beea-c6724756c26f tempest-AttachVolumeNegativeTest-1000400951 tempest-AttachVolumeNegativeTest-1000400951-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 12:59:29.550073 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-4378ff5f-4ec5-47ae-beea-c6724756c26f tempest-AttachVolumeNegativeTest-1000400951 tempest-AttachVolumeNegativeTest-1000400951-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 12:59:29.700118 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.api.openstack.wsgi [None req-979197a3-883d-43b6-8ce1-3fa9ebe639c3 tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116063) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 14 12:59:29.701268 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.compute.api [None req-979197a3-883d-43b6-8ce1-3fa9ebe639c3 tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] [instance: c8de7730-62f2-4a77-b1e9-cf6a74fa366d] Fetching instance by UUID {{(pid=116063) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 12:59:29.708483 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-979197a3-883d-43b6-8ce1-3fa9ebe639c3 tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 12:59:29.709228 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-979197a3-883d-43b6-8ce1-3fa9ebe639c3 tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 12:59:29.710231 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-979197a3-883d-43b6-8ce1-3fa9ebe639c3 tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 12:59:29.711158 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-979197a3-883d-43b6-8ce1-3fa9ebe639c3 tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 12:59:29.772508 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.policy [None req-4378ff5f-4ec5-47ae-beea-c6724756c26f tempest-AttachVolumeNegativeTest-1000400951 tempest-AttachVolumeNegativeTest-1000400951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57d0ec01f0784c8ea87d339980bed3cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad27b8951cae4eeeafa257f45217653a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116064) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 12:59:29.785636 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: INFO nova.api.openstack.requestlog [None req-4378ff5f-4ec5-47ae-beea-c6724756c26f tempest-AttachVolumeNegativeTest-1000400951 tempest-AttachVolumeNegativeTest-1000400951-project] 10.222.0.49 "GET /compute/v2.1/servers/8d264701-aaa0-465f-a4aa-0cffa41351ef" status: 200 len: 1507 microversion: 2.1 time: 0.248793 Dec 14 12:59:29.785636 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: [pid: 116064|app: 0|req: 145/306] 10.222.0.49 () {58 vars in 1235 bytes} [Tue Dec 14 12:59:29 2021] GET /compute/v2.1/servers/8d264701-aaa0-465f-a4aa-0cffa41351ef => generated 1507 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 14 12:59:30.303116 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.api.openstack.wsgi [None req-784e8804-dae5-4987-9dc3-fa380ddd9c57 tempest-VolumesNegativeTest-1177368279 tempest-VolumesNegativeTest-1177368279-project] Calling method '>' {{(pid=116064) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 12:59:30.303729 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.compute.api [None req-784e8804-dae5-4987-9dc3-fa380ddd9c57 tempest-VolumesNegativeTest-1177368279 tempest-VolumesNegativeTest-1177368279-project] [instance: 64bca4a7-c923-443e-a304-580fcbd76c14] Fetching instance by UUID {{(pid=116064) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 12:59:30.310435 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-784e8804-dae5-4987-9dc3-fa380ddd9c57 tempest-VolumesNegativeTest-1177368279 tempest-VolumesNegativeTest-1177368279-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 12:59:30.310890 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-784e8804-dae5-4987-9dc3-fa380ddd9c57 tempest-VolumesNegativeTest-1177368279 tempest-VolumesNegativeTest-1177368279-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 12:59:30.311681 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-784e8804-dae5-4987-9dc3-fa380ddd9c57 tempest-VolumesNegativeTest-1177368279 tempest-VolumesNegativeTest-1177368279-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 12:59:30.312120 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-784e8804-dae5-4987-9dc3-fa380ddd9c57 tempest-VolumesNegativeTest-1177368279 tempest-VolumesNegativeTest-1177368279-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 12:59:30.466240 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.policy [None req-784e8804-dae5-4987-9dc3-fa380ddd9c57 tempest-VolumesNegativeTest-1177368279 tempest-VolumesNegativeTest-1177368279-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68514732cd1d4c9d8181796d4573303f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fe74d6e6bd748d4a6f320530dffe300', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116064) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 12:59:30.474026 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: INFO nova.api.openstack.requestlog [None req-784e8804-dae5-4987-9dc3-fa380ddd9c57 tempest-VolumesNegativeTest-1177368279 tempest-VolumesNegativeTest-1177368279-project] 10.222.0.49 "GET /compute/v2.1/servers/64bca4a7-c923-443e-a304-580fcbd76c14" status: 200 len: 1314 microversion: 2.1 time: 0.174677 Dec 14 12:59:30.474644 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: [pid: 116064|app: 0|req: 146/307] 10.222.0.49 () {58 vars in 1235 bytes} [Tue Dec 14 12:59:30 2021] GET /compute/v2.1/servers/64bca4a7-c923-443e-a304-580fcbd76c14 => generated 1314 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 14 12:59:31.492216 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.api.openstack.wsgi [None req-3c076200-3df9-4cbf-bc49-e02058b65b8f tempest-VolumesNegativeTest-1177368279 tempest-VolumesNegativeTest-1177368279-project] Calling method '>' {{(pid=116064) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 12:59:31.492874 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.compute.api [None req-3c076200-3df9-4cbf-bc49-e02058b65b8f tempest-VolumesNegativeTest-1177368279 tempest-VolumesNegativeTest-1177368279-project] [instance: 64bca4a7-c923-443e-a304-580fcbd76c14] Fetching instance by UUID {{(pid=116064) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 12:59:31.499663 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-3c076200-3df9-4cbf-bc49-e02058b65b8f tempest-VolumesNegativeTest-1177368279 tempest-VolumesNegativeTest-1177368279-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 12:59:31.500198 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-3c076200-3df9-4cbf-bc49-e02058b65b8f tempest-VolumesNegativeTest-1177368279 tempest-VolumesNegativeTest-1177368279-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 12:59:31.501035 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-3c076200-3df9-4cbf-bc49-e02058b65b8f tempest-VolumesNegativeTest-1177368279 tempest-VolumesNegativeTest-1177368279-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 12:59:31.501472 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-3c076200-3df9-4cbf-bc49-e02058b65b8f tempest-VolumesNegativeTest-1177368279 tempest-VolumesNegativeTest-1177368279-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 12:59:31.644834 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.policy [None req-3c076200-3df9-4cbf-bc49-e02058b65b8f tempest-VolumesNegativeTest-1177368279 tempest-VolumesNegativeTest-1177368279-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68514732cd1d4c9d8181796d4573303f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fe74d6e6bd748d4a6f320530dffe300', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116064) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 12:59:31.652511 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: INFO nova.api.openstack.requestlog [None req-3c076200-3df9-4cbf-bc49-e02058b65b8f tempest-VolumesNegativeTest-1177368279 tempest-VolumesNegativeTest-1177368279-project] 10.222.0.49 "GET /compute/v2.1/servers/64bca4a7-c923-443e-a304-580fcbd76c14" status: 200 len: 1314 microversion: 2.1 time: 0.164155 Dec 14 12:59:31.653115 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: [pid: 116064|app: 0|req: 147/308] 10.222.0.49 () {58 vars in 1235 bytes} [Tue Dec 14 12:59:31 2021] GET /compute/v2.1/servers/64bca4a7-c923-443e-a304-580fcbd76c14 => generated 1314 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 14 12:59:32.598635 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: INFO nova.api.openstack.requestlog [None req-979197a3-883d-43b6-8ce1-3fa9ebe639c3 tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] 10.222.0.49 "POST /compute/v2.1/servers/c8de7730-62f2-4a77-b1e9-cf6a74fa366d/action" status: 200 len: 28576 microversion: 2.20 time: 2.902498 Dec 14 12:59:32.599316 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: [pid: 116063|app: 0|req: 162/309] 10.222.0.49 () {62 vars in 1318 bytes} [Tue Dec 14 12:59:29 2021] POST /compute/v2.1/servers/c8de7730-62f2-4a77-b1e9-cf6a74fa366d/action => generated 28576 bytes in 2904 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Dec 14 12:59:32.670342 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.api.openstack.wsgi [None req-e2fb6434-9739-4032-bae8-f6834eeda2c1 tempest-VolumesNegativeTest-1177368279 tempest-VolumesNegativeTest-1177368279-project] Calling method '>' {{(pid=116064) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 12:59:32.670816 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.compute.api [None req-e2fb6434-9739-4032-bae8-f6834eeda2c1 tempest-VolumesNegativeTest-1177368279 tempest-VolumesNegativeTest-1177368279-project] [instance: 64bca4a7-c923-443e-a304-580fcbd76c14] Fetching instance by UUID {{(pid=116064) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 12:59:32.685188 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-e2fb6434-9739-4032-bae8-f6834eeda2c1 tempest-VolumesNegativeTest-1177368279 tempest-VolumesNegativeTest-1177368279-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 12:59:32.685600 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-e2fb6434-9739-4032-bae8-f6834eeda2c1 tempest-VolumesNegativeTest-1177368279 tempest-VolumesNegativeTest-1177368279-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 12:59:32.686771 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-e2fb6434-9739-4032-bae8-f6834eeda2c1 tempest-VolumesNegativeTest-1177368279 tempest-VolumesNegativeTest-1177368279-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 12:59:32.687219 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-e2fb6434-9739-4032-bae8-f6834eeda2c1 tempest-VolumesNegativeTest-1177368279 tempest-VolumesNegativeTest-1177368279-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 12:59:32.841115 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.policy [None req-e2fb6434-9739-4032-bae8-f6834eeda2c1 tempest-VolumesNegativeTest-1177368279 tempest-VolumesNegativeTest-1177368279-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68514732cd1d4c9d8181796d4573303f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fe74d6e6bd748d4a6f320530dffe300', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116064) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 12:59:32.848771 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: INFO nova.api.openstack.requestlog [None req-e2fb6434-9739-4032-bae8-f6834eeda2c1 tempest-VolumesNegativeTest-1177368279 tempest-VolumesNegativeTest-1177368279-project] 10.222.0.49 "GET /compute/v2.1/servers/64bca4a7-c923-443e-a304-580fcbd76c14" status: 200 len: 1314 microversion: 2.1 time: 0.182767 Dec 14 12:59:32.849438 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: [pid: 116064|app: 0|req: 148/310] 10.222.0.49 () {58 vars in 1235 bytes} [Tue Dec 14 12:59:32 2021] GET /compute/v2.1/servers/64bca4a7-c923-443e-a304-580fcbd76c14 => generated 1314 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 14 12:59:33.611224 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.api.openstack.wsgi [None req-bc80c946-1833-4471-96e1-7b8b248eb504 tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116063) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 14 12:59:33.616612 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.compute.api [None req-bc80c946-1833-4471-96e1-7b8b248eb504 tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] [instance: c8de7730-62f2-4a77-b1e9-cf6a74fa366d] Fetching instance by UUID {{(pid=116063) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 12:59:33.623697 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-bc80c946-1833-4471-96e1-7b8b248eb504 tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 12:59:33.624142 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-bc80c946-1833-4471-96e1-7b8b248eb504 tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 12:59:33.624970 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-bc80c946-1833-4471-96e1-7b8b248eb504 tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 12:59:33.625408 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-bc80c946-1833-4471-96e1-7b8b248eb504 tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 12:59:33.709336 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: INFO nova.api.openstack.requestlog [None req-bc80c946-1833-4471-96e1-7b8b248eb504 tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] 10.222.0.49 "POST /compute/v2.1/servers/c8de7730-62f2-4a77-b1e9-cf6a74fa366d/action" status: 200 len: 28576 microversion: 2.20 time: 0.102396 Dec 14 12:59:33.710024 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: [pid: 116063|app: 0|req: 163/311] 10.222.0.49 () {62 vars in 1318 bytes} [Tue Dec 14 12:59:33 2021] POST /compute/v2.1/servers/c8de7730-62f2-4a77-b1e9-cf6a74fa366d/action => generated 28576 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 14 12:59:33.868247 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.api.openstack.wsgi [None req-fa18963f-805c-4100-950f-e049f5e3b5ad tempest-VolumesNegativeTest-1177368279 tempest-VolumesNegativeTest-1177368279-project] Calling method '>' {{(pid=116064) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 12:59:33.869490 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.compute.api [None req-fa18963f-805c-4100-950f-e049f5e3b5ad tempest-VolumesNegativeTest-1177368279 tempest-VolumesNegativeTest-1177368279-project] [instance: 64bca4a7-c923-443e-a304-580fcbd76c14] Fetching instance by UUID {{(pid=116064) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 12:59:33.876913 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-fa18963f-805c-4100-950f-e049f5e3b5ad tempest-VolumesNegativeTest-1177368279 tempest-VolumesNegativeTest-1177368279-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 12:59:33.877464 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-fa18963f-805c-4100-950f-e049f5e3b5ad tempest-VolumesNegativeTest-1177368279 tempest-VolumesNegativeTest-1177368279-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 12:59:33.878487 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-fa18963f-805c-4100-950f-e049f5e3b5ad tempest-VolumesNegativeTest-1177368279 tempest-VolumesNegativeTest-1177368279-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 12:59:33.878928 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-fa18963f-805c-4100-950f-e049f5e3b5ad tempest-VolumesNegativeTest-1177368279 tempest-VolumesNegativeTest-1177368279-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 12:59:33.980714 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.api.openstack.wsgi [None req-91146aae-6b5d-4593-8e54-3f297ab3424e tempest-ServerRescueNegativeTestJSON-1573931620 tempest-ServerRescueNegativeTestJSON-1573931620-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=116063) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 14 12:59:33.982363 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.compute.api [None req-91146aae-6b5d-4593-8e54-3f297ab3424e tempest-ServerRescueNegativeTestJSON-1573931620 tempest-ServerRescueNegativeTestJSON-1573931620-project] [instance: eb6e04a4-8901-47df-9b51-7c1664bd3f6c] Fetching instance by UUID {{(pid=116063) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 12:59:33.989864 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-91146aae-6b5d-4593-8e54-3f297ab3424e tempest-ServerRescueNegativeTestJSON-1573931620 tempest-ServerRescueNegativeTestJSON-1573931620-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 12:59:33.990309 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-91146aae-6b5d-4593-8e54-3f297ab3424e tempest-ServerRescueNegativeTestJSON-1573931620 tempest-ServerRescueNegativeTestJSON-1573931620-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 12:59:33.991121 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-91146aae-6b5d-4593-8e54-3f297ab3424e tempest-ServerRescueNegativeTestJSON-1573931620 tempest-ServerRescueNegativeTestJSON-1573931620-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 12:59:33.991543 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-91146aae-6b5d-4593-8e54-3f297ab3424e tempest-ServerRescueNegativeTestJSON-1573931620 tempest-ServerRescueNegativeTestJSON-1573931620-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 12:59:34.014244 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.objects.instance [None req-91146aae-6b5d-4593-8e54-3f297ab3424e tempest-ServerRescueNegativeTestJSON-1573931620 tempest-ServerRescueNegativeTestJSON-1573931620-project] Lazy-loading 'flavor' on Instance uuid eb6e04a4-8901-47df-9b51-7c1664bd3f6c {{(pid=116063) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Dec 14 12:59:34.014374 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.policy [None req-fa18963f-805c-4100-950f-e049f5e3b5ad tempest-VolumesNegativeTest-1177368279 tempest-VolumesNegativeTest-1177368279-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68514732cd1d4c9d8181796d4573303f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fe74d6e6bd748d4a6f320530dffe300', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116064) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 12:59:34.022286 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: INFO nova.api.openstack.requestlog [None req-fa18963f-805c-4100-950f-e049f5e3b5ad tempest-VolumesNegativeTest-1177368279 tempest-VolumesNegativeTest-1177368279-project] 10.222.0.49 "GET /compute/v2.1/servers/64bca4a7-c923-443e-a304-580fcbd76c14" status: 200 len: 1314 microversion: 2.1 time: 0.158225 Dec 14 12:59:34.022840 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: [pid: 116064|app: 0|req: 149/312] 10.222.0.49 () {58 vars in 1235 bytes} [Tue Dec 14 12:59:33 2021] GET /compute/v2.1/servers/64bca4a7-c923-443e-a304-580fcbd76c14 => generated 1314 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 14 12:59:34.093018 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: INFO nova.api.openstack.requestlog [None req-91146aae-6b5d-4593-8e54-3f297ab3424e tempest-ServerRescueNegativeTestJSON-1573931620 tempest-ServerRescueNegativeTestJSON-1573931620-project] 10.222.0.49 "POST /compute/v2.1/servers/eb6e04a4-8901-47df-9b51-7c1664bd3f6c/action" status: 200 len: 32 microversion: 2.1 time: 0.116213 Dec 14 12:59:34.093443 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: [pid: 116063|app: 0|req: 164/313] 10.222.0.49 () {60 vars in 1277 bytes} [Tue Dec 14 12:59:33 2021] POST /compute/v2.1/servers/eb6e04a4-8901-47df-9b51-7c1664bd3f6c/action => generated 32 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Dec 14 12:59:34.108681 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.api.openstack.wsgi [None req-70eebf2f-0fd3-41f1-96a6-6125dcf0f40c tempest-ServerRescueNegativeTestJSON-1573931620 tempest-ServerRescueNegativeTestJSON-1573931620-project] Calling method '>' {{(pid=116064) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 12:59:34.109584 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.compute.api [None req-70eebf2f-0fd3-41f1-96a6-6125dcf0f40c tempest-ServerRescueNegativeTestJSON-1573931620 tempest-ServerRescueNegativeTestJSON-1573931620-project] [instance: eb6e04a4-8901-47df-9b51-7c1664bd3f6c] Fetching instance by UUID {{(pid=116064) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 12:59:34.120762 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-70eebf2f-0fd3-41f1-96a6-6125dcf0f40c tempest-ServerRescueNegativeTestJSON-1573931620 tempest-ServerRescueNegativeTestJSON-1573931620-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 12:59:34.121667 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-70eebf2f-0fd3-41f1-96a6-6125dcf0f40c tempest-ServerRescueNegativeTestJSON-1573931620 tempest-ServerRescueNegativeTestJSON-1573931620-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 12:59:34.122438 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-70eebf2f-0fd3-41f1-96a6-6125dcf0f40c tempest-ServerRescueNegativeTestJSON-1573931620 tempest-ServerRescueNegativeTestJSON-1573931620-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 12:59:34.123105 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-70eebf2f-0fd3-41f1-96a6-6125dcf0f40c tempest-ServerRescueNegativeTestJSON-1573931620 tempest-ServerRescueNegativeTestJSON-1573931620-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 12:59:34.262458 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.policy [None req-70eebf2f-0fd3-41f1-96a6-6125dcf0f40c tempest-ServerRescueNegativeTestJSON-1573931620 tempest-ServerRescueNegativeTestJSON-1573931620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '731cbbfe17214ded8ac66299d66dfc45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '010919ea84eb4eb8b936c63153600eba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116064) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 12:59:34.284001 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: INFO nova.api.openstack.requestlog [None req-70eebf2f-0fd3-41f1-96a6-6125dcf0f40c tempest-ServerRescueNegativeTestJSON-1573931620 tempest-ServerRescueNegativeTestJSON-1573931620-project] 10.222.0.49 "GET /compute/v2.1/servers/eb6e04a4-8901-47df-9b51-7c1664bd3f6c" status: 200 len: 1523 microversion: 2.1 time: 0.180313 Dec 14 12:59:34.294948 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: [pid: 116064|app: 0|req: 150/314] 10.222.0.49 () {58 vars in 1235 bytes} [Tue Dec 14 12:59:34 2021] GET /compute/v2.1/servers/eb6e04a4-8901-47df-9b51-7c1664bd3f6c => generated 1523 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 14 12:59:34.298832 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.api.openstack.wsgi [None req-39ba2cbe-fd56-4957-9d07-6ba2c269a004 tempest-AttachVolumeNegativeTest-1000400951 tempest-AttachVolumeNegativeTest-1000400951-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "b5a1d095-3b51-4fae-ba5c-f49f070c8b9f"}} {{(pid=116063) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 14 12:59:34.300181 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.compute.api [None req-39ba2cbe-fd56-4957-9d07-6ba2c269a004 tempest-AttachVolumeNegativeTest-1000400951 tempest-AttachVolumeNegativeTest-1000400951-project] [instance: 8d264701-aaa0-465f-a4aa-0cffa41351ef] Fetching instance by UUID {{(pid=116063) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 12:59:34.312501 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-39ba2cbe-fd56-4957-9d07-6ba2c269a004 tempest-AttachVolumeNegativeTest-1000400951 tempest-AttachVolumeNegativeTest-1000400951-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 12:59:34.313196 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-39ba2cbe-fd56-4957-9d07-6ba2c269a004 tempest-AttachVolumeNegativeTest-1000400951 tempest-AttachVolumeNegativeTest-1000400951-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 12:59:34.314076 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-39ba2cbe-fd56-4957-9d07-6ba2c269a004 tempest-AttachVolumeNegativeTest-1000400951 tempest-AttachVolumeNegativeTest-1000400951-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 12:59:34.314404 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-39ba2cbe-fd56-4957-9d07-6ba2c269a004 tempest-AttachVolumeNegativeTest-1000400951 tempest-AttachVolumeNegativeTest-1000400951-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 12:59:34.651745 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: INFO nova.api.openstack.requestlog [None req-39ba2cbe-fd56-4957-9d07-6ba2c269a004 tempest-AttachVolumeNegativeTest-1000400951 tempest-AttachVolumeNegativeTest-1000400951-project] 10.222.0.49 "POST /compute/v2.1/servers/8d264701-aaa0-465f-a4aa-0cffa41351ef/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.364479 Dec 14 12:59:34.653413 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: [pid: 116063|app: 0|req: 165/315] 10.222.0.49 () {60 vars in 1322 bytes} [Tue Dec 14 12:59:34 2021] POST /compute/v2.1/servers/8d264701-aaa0-465f-a4aa-0cffa41351ef/os-volume_attachments => generated 194 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Dec 14 12:59:34.723215 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.api.openstack.wsgi [None req-255080bb-0800-4bb1-b6e2-6f344b707512 tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116064) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 14 12:59:34.725093 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.compute.api [None req-255080bb-0800-4bb1-b6e2-6f344b707512 tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] [instance: c8de7730-62f2-4a77-b1e9-cf6a74fa366d] Fetching instance by UUID {{(pid=116064) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 12:59:34.745537 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-255080bb-0800-4bb1-b6e2-6f344b707512 tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 12:59:34.746074 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-255080bb-0800-4bb1-b6e2-6f344b707512 tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 12:59:34.750067 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-255080bb-0800-4bb1-b6e2-6f344b707512 tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 12:59:34.750649 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-255080bb-0800-4bb1-b6e2-6f344b707512 tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 12:59:34.866484 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: INFO nova.api.openstack.requestlog [None req-255080bb-0800-4bb1-b6e2-6f344b707512 tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] 10.222.0.49 "POST /compute/v2.1/servers/c8de7730-62f2-4a77-b1e9-cf6a74fa366d/action" status: 200 len: 28576 microversion: 2.20 time: 0.148045 Dec 14 12:59:34.870457 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: [pid: 116064|app: 0|req: 151/316] 10.222.0.49 () {62 vars in 1318 bytes} [Tue Dec 14 12:59:34 2021] POST /compute/v2.1/servers/c8de7730-62f2-4a77-b1e9-cf6a74fa366d/action => generated 28576 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 14 12:59:35.040466 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.api.openstack.wsgi [None req-2f559ed6-5ab2-4073-a822-ca428d506755 tempest-VolumesNegativeTest-1177368279 tempest-VolumesNegativeTest-1177368279-project] Calling method '>' {{(pid=116063) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 12:59:35.041825 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.compute.api [None req-2f559ed6-5ab2-4073-a822-ca428d506755 tempest-VolumesNegativeTest-1177368279 tempest-VolumesNegativeTest-1177368279-project] [instance: 64bca4a7-c923-443e-a304-580fcbd76c14] Fetching instance by UUID {{(pid=116063) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 12:59:35.051509 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-2f559ed6-5ab2-4073-a822-ca428d506755 tempest-VolumesNegativeTest-1177368279 tempest-VolumesNegativeTest-1177368279-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 12:59:35.052394 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-2f559ed6-5ab2-4073-a822-ca428d506755 tempest-VolumesNegativeTest-1177368279 tempest-VolumesNegativeTest-1177368279-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 12:59:35.053395 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-2f559ed6-5ab2-4073-a822-ca428d506755 tempest-VolumesNegativeTest-1177368279 tempest-VolumesNegativeTest-1177368279-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 12:59:35.053970 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-2f559ed6-5ab2-4073-a822-ca428d506755 tempest-VolumesNegativeTest-1177368279 tempest-VolumesNegativeTest-1177368279-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 12:59:35.217953 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.policy [None req-2f559ed6-5ab2-4073-a822-ca428d506755 tempest-VolumesNegativeTest-1177368279 tempest-VolumesNegativeTest-1177368279-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68514732cd1d4c9d8181796d4573303f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fe74d6e6bd748d4a6f320530dffe300', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116063) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 12:59:35.226315 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: INFO nova.api.openstack.requestlog [None req-2f559ed6-5ab2-4073-a822-ca428d506755 tempest-VolumesNegativeTest-1177368279 tempest-VolumesNegativeTest-1177368279-project] 10.222.0.49 "GET /compute/v2.1/servers/64bca4a7-c923-443e-a304-580fcbd76c14" status: 200 len: 1314 microversion: 2.1 time: 0.190674 Dec 14 12:59:35.226920 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: [pid: 116063|app: 0|req: 166/317] 10.222.0.49 () {58 vars in 1235 bytes} [Tue Dec 14 12:59:35 2021] GET /compute/v2.1/servers/64bca4a7-c923-443e-a304-580fcbd76c14 => generated 1314 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 14 12:59:35.302702 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.api.openstack.wsgi [None req-e19cf2ed-5ba8-4829-8c96-83677d7a75eb tempest-ServerRescueNegativeTestJSON-1573931620 tempest-ServerRescueNegativeTestJSON-1573931620-project] Calling method '>' {{(pid=116064) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 12:59:35.303402 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.compute.api [None req-e19cf2ed-5ba8-4829-8c96-83677d7a75eb tempest-ServerRescueNegativeTestJSON-1573931620 tempest-ServerRescueNegativeTestJSON-1573931620-project] [instance: eb6e04a4-8901-47df-9b51-7c1664bd3f6c] Fetching instance by UUID {{(pid=116064) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 12:59:35.310429 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-e19cf2ed-5ba8-4829-8c96-83677d7a75eb tempest-ServerRescueNegativeTestJSON-1573931620 tempest-ServerRescueNegativeTestJSON-1573931620-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 12:59:35.310879 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-e19cf2ed-5ba8-4829-8c96-83677d7a75eb tempest-ServerRescueNegativeTestJSON-1573931620 tempest-ServerRescueNegativeTestJSON-1573931620-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 12:59:35.311663 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-e19cf2ed-5ba8-4829-8c96-83677d7a75eb tempest-ServerRescueNegativeTestJSON-1573931620 tempest-ServerRescueNegativeTestJSON-1573931620-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 12:59:35.312095 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-e19cf2ed-5ba8-4829-8c96-83677d7a75eb tempest-ServerRescueNegativeTestJSON-1573931620 tempest-ServerRescueNegativeTestJSON-1573931620-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 12:59:35.505585 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.policy [None req-e19cf2ed-5ba8-4829-8c96-83677d7a75eb tempest-ServerRescueNegativeTestJSON-1573931620 tempest-ServerRescueNegativeTestJSON-1573931620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '731cbbfe17214ded8ac66299d66dfc45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '010919ea84eb4eb8b936c63153600eba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116064) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 12:59:35.524177 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: INFO nova.api.openstack.requestlog [None req-e19cf2ed-5ba8-4829-8c96-83677d7a75eb tempest-ServerRescueNegativeTestJSON-1573931620 tempest-ServerRescueNegativeTestJSON-1573931620-project] 10.222.0.49 "GET /compute/v2.1/servers/eb6e04a4-8901-47df-9b51-7c1664bd3f6c" status: 200 len: 1523 microversion: 2.1 time: 0.225467 Dec 14 12:59:35.535482 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: [pid: 116064|app: 0|req: 152/318] 10.222.0.49 () {58 vars in 1235 bytes} [Tue Dec 14 12:59:35 2021] GET /compute/v2.1/servers/eb6e04a4-8901-47df-9b51-7c1664bd3f6c => generated 1523 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 14 12:59:35.880110 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.api.openstack.wsgi [None req-03c22bf2-458b-4882-ab5f-f47018595a33 tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116063) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 14 12:59:35.881329 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.compute.api [None req-03c22bf2-458b-4882-ab5f-f47018595a33 tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] [instance: c8de7730-62f2-4a77-b1e9-cf6a74fa366d] Fetching instance by UUID {{(pid=116063) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 12:59:35.888287 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-03c22bf2-458b-4882-ab5f-f47018595a33 tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 12:59:35.888888 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-03c22bf2-458b-4882-ab5f-f47018595a33 tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 12:59:35.890220 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-03c22bf2-458b-4882-ab5f-f47018595a33 tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 12:59:35.890753 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-03c22bf2-458b-4882-ab5f-f47018595a33 tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 12:59:35.997694 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: INFO nova.api.openstack.requestlog [None req-03c22bf2-458b-4882-ab5f-f47018595a33 tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] 10.222.0.49 "POST /compute/v2.1/servers/c8de7730-62f2-4a77-b1e9-cf6a74fa366d/action" status: 200 len: 28576 microversion: 2.20 time: 0.121669 Dec 14 12:59:36.003395 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: [pid: 116063|app: 0|req: 167/319] 10.222.0.49 () {62 vars in 1318 bytes} [Tue Dec 14 12:59:35 2021] POST /compute/v2.1/servers/c8de7730-62f2-4a77-b1e9-cf6a74fa366d/action => generated 28576 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 14 12:59:36.245055 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.api.openstack.wsgi [None req-f6c0bec1-a69a-4972-9ced-fc262feb37b7 tempest-VolumesNegativeTest-1177368279 tempest-VolumesNegativeTest-1177368279-project] Calling method '>' {{(pid=116064) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 12:59:36.245554 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.compute.api [None req-f6c0bec1-a69a-4972-9ced-fc262feb37b7 tempest-VolumesNegativeTest-1177368279 tempest-VolumesNegativeTest-1177368279-project] [instance: 64bca4a7-c923-443e-a304-580fcbd76c14] Fetching instance by UUID {{(pid=116064) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 12:59:36.253025 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-f6c0bec1-a69a-4972-9ced-fc262feb37b7 tempest-VolumesNegativeTest-1177368279 tempest-VolumesNegativeTest-1177368279-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 12:59:36.253585 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-f6c0bec1-a69a-4972-9ced-fc262feb37b7 tempest-VolumesNegativeTest-1177368279 tempest-VolumesNegativeTest-1177368279-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 12:59:36.254370 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-f6c0bec1-a69a-4972-9ced-fc262feb37b7 tempest-VolumesNegativeTest-1177368279 tempest-VolumesNegativeTest-1177368279-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 12:59:36.255140 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-f6c0bec1-a69a-4972-9ced-fc262feb37b7 tempest-VolumesNegativeTest-1177368279 tempest-VolumesNegativeTest-1177368279-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 12:59:36.435004 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.policy [None req-f6c0bec1-a69a-4972-9ced-fc262feb37b7 tempest-VolumesNegativeTest-1177368279 tempest-VolumesNegativeTest-1177368279-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68514732cd1d4c9d8181796d4573303f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fe74d6e6bd748d4a6f320530dffe300', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116064) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 12:59:36.448641 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: INFO nova.api.openstack.requestlog [None req-f6c0bec1-a69a-4972-9ced-fc262feb37b7 tempest-VolumesNegativeTest-1177368279 tempest-VolumesNegativeTest-1177368279-project] 10.222.0.49 "GET /compute/v2.1/servers/64bca4a7-c923-443e-a304-580fcbd76c14" status: 200 len: 1314 microversion: 2.1 time: 0.207444 Dec 14 12:59:36.449494 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: [pid: 116064|app: 0|req: 153/320] 10.222.0.49 () {58 vars in 1235 bytes} [Tue Dec 14 12:59:36 2021] GET /compute/v2.1/servers/64bca4a7-c923-443e-a304-580fcbd76c14 => generated 1314 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 14 12:59:36.543265 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.api.openstack.wsgi [None req-d256b587-f0ef-42eb-b24e-2ba28f7ea0dd tempest-ServerRescueNegativeTestJSON-1573931620 tempest-ServerRescueNegativeTestJSON-1573931620-project] Calling method '>' {{(pid=116063) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 12:59:36.544304 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.compute.api [None req-d256b587-f0ef-42eb-b24e-2ba28f7ea0dd tempest-ServerRescueNegativeTestJSON-1573931620 tempest-ServerRescueNegativeTestJSON-1573931620-project] [instance: eb6e04a4-8901-47df-9b51-7c1664bd3f6c] Fetching instance by UUID {{(pid=116063) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 12:59:36.555269 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-d256b587-f0ef-42eb-b24e-2ba28f7ea0dd tempest-ServerRescueNegativeTestJSON-1573931620 tempest-ServerRescueNegativeTestJSON-1573931620-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 12:59:36.555720 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-d256b587-f0ef-42eb-b24e-2ba28f7ea0dd tempest-ServerRescueNegativeTestJSON-1573931620 tempest-ServerRescueNegativeTestJSON-1573931620-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 12:59:36.556635 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-d256b587-f0ef-42eb-b24e-2ba28f7ea0dd tempest-ServerRescueNegativeTestJSON-1573931620 tempest-ServerRescueNegativeTestJSON-1573931620-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 12:59:36.557469 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-d256b587-f0ef-42eb-b24e-2ba28f7ea0dd tempest-ServerRescueNegativeTestJSON-1573931620 tempest-ServerRescueNegativeTestJSON-1573931620-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 12:59:36.707993 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.policy [None req-d256b587-f0ef-42eb-b24e-2ba28f7ea0dd tempest-ServerRescueNegativeTestJSON-1573931620 tempest-ServerRescueNegativeTestJSON-1573931620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '731cbbfe17214ded8ac66299d66dfc45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '010919ea84eb4eb8b936c63153600eba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116063) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 12:59:36.720898 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: INFO nova.api.openstack.requestlog [None req-d256b587-f0ef-42eb-b24e-2ba28f7ea0dd tempest-ServerRescueNegativeTestJSON-1573931620 tempest-ServerRescueNegativeTestJSON-1573931620-project] 10.222.0.49 "GET /compute/v2.1/servers/eb6e04a4-8901-47df-9b51-7c1664bd3f6c" status: 200 len: 1523 microversion: 2.1 time: 0.178276 Dec 14 12:59:36.720898 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: [pid: 116063|app: 0|req: 168/321] 10.222.0.49 () {58 vars in 1235 bytes} [Tue Dec 14 12:59:36 2021] GET /compute/v2.1/servers/eb6e04a4-8901-47df-9b51-7c1664bd3f6c => generated 1523 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 14 12:59:37.011859 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.api.openstack.wsgi [None req-39c62241-176b-48af-b4e1-9340a1b12346 tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116064) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 14 12:59:37.013156 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.compute.api [None req-39c62241-176b-48af-b4e1-9340a1b12346 tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] [instance: c8de7730-62f2-4a77-b1e9-cf6a74fa366d] Fetching instance by UUID {{(pid=116064) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 12:59:37.027715 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-39c62241-176b-48af-b4e1-9340a1b12346 tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 12:59:37.029100 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-39c62241-176b-48af-b4e1-9340a1b12346 tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 12:59:37.030969 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-39c62241-176b-48af-b4e1-9340a1b12346 tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 12:59:37.031415 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-39c62241-176b-48af-b4e1-9340a1b12346 tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 12:59:37.138886 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: INFO nova.api.openstack.requestlog [None req-39c62241-176b-48af-b4e1-9340a1b12346 tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] 10.222.0.49 "POST /compute/v2.1/servers/c8de7730-62f2-4a77-b1e9-cf6a74fa366d/action" status: 200 len: 28576 microversion: 2.20 time: 0.130944 Dec 14 12:59:37.140090 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: [pid: 116064|app: 0|req: 154/322] 10.222.0.49 () {62 vars in 1318 bytes} [Tue Dec 14 12:59:37 2021] POST /compute/v2.1/servers/c8de7730-62f2-4a77-b1e9-cf6a74fa366d/action => generated 28576 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 14 12:59:37.466410 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.api.openstack.wsgi [None req-d217b858-9050-48bb-b9ef-88c1270a5cfa tempest-VolumesNegativeTest-1177368279 tempest-VolumesNegativeTest-1177368279-project] Calling method '>' {{(pid=116063) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 12:59:37.467101 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.compute.api [None req-d217b858-9050-48bb-b9ef-88c1270a5cfa tempest-VolumesNegativeTest-1177368279 tempest-VolumesNegativeTest-1177368279-project] [instance: 64bca4a7-c923-443e-a304-580fcbd76c14] Fetching instance by UUID {{(pid=116063) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 12:59:37.482443 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-d217b858-9050-48bb-b9ef-88c1270a5cfa tempest-VolumesNegativeTest-1177368279 tempest-VolumesNegativeTest-1177368279-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 12:59:37.483248 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-d217b858-9050-48bb-b9ef-88c1270a5cfa tempest-VolumesNegativeTest-1177368279 tempest-VolumesNegativeTest-1177368279-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 12:59:37.484271 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-d217b858-9050-48bb-b9ef-88c1270a5cfa tempest-VolumesNegativeTest-1177368279 tempest-VolumesNegativeTest-1177368279-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 12:59:37.484907 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-d217b858-9050-48bb-b9ef-88c1270a5cfa tempest-VolumesNegativeTest-1177368279 tempest-VolumesNegativeTest-1177368279-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 12:59:37.677194 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.policy [None req-d217b858-9050-48bb-b9ef-88c1270a5cfa tempest-VolumesNegativeTest-1177368279 tempest-VolumesNegativeTest-1177368279-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68514732cd1d4c9d8181796d4573303f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fe74d6e6bd748d4a6f320530dffe300', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116063) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 12:59:37.684637 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: INFO nova.api.openstack.requestlog [None req-d217b858-9050-48bb-b9ef-88c1270a5cfa tempest-VolumesNegativeTest-1177368279 tempest-VolumesNegativeTest-1177368279-project] 10.222.0.49 "GET /compute/v2.1/servers/64bca4a7-c923-443e-a304-580fcbd76c14" status: 200 len: 1314 microversion: 2.1 time: 0.222259 Dec 14 12:59:37.685229 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: [pid: 116063|app: 0|req: 169/323] 10.222.0.49 () {58 vars in 1235 bytes} [Tue Dec 14 12:59:37 2021] GET /compute/v2.1/servers/64bca4a7-c923-443e-a304-580fcbd76c14 => generated 1314 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 14 12:59:37.737291 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.api.openstack.wsgi [None req-bfb0ad4f-a65e-4918-9d93-9bba5f9edc28 tempest-ServerRescueNegativeTestJSON-1573931620 tempest-ServerRescueNegativeTestJSON-1573931620-project] Calling method '>' {{(pid=116064) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 12:59:37.738013 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.compute.api [None req-bfb0ad4f-a65e-4918-9d93-9bba5f9edc28 tempest-ServerRescueNegativeTestJSON-1573931620 tempest-ServerRescueNegativeTestJSON-1573931620-project] [instance: eb6e04a4-8901-47df-9b51-7c1664bd3f6c] Fetching instance by UUID {{(pid=116064) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 12:59:37.745222 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-bfb0ad4f-a65e-4918-9d93-9bba5f9edc28 tempest-ServerRescueNegativeTestJSON-1573931620 tempest-ServerRescueNegativeTestJSON-1573931620-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 12:59:37.745863 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-bfb0ad4f-a65e-4918-9d93-9bba5f9edc28 tempest-ServerRescueNegativeTestJSON-1573931620 tempest-ServerRescueNegativeTestJSON-1573931620-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 12:59:37.746833 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-bfb0ad4f-a65e-4918-9d93-9bba5f9edc28 tempest-ServerRescueNegativeTestJSON-1573931620 tempest-ServerRescueNegativeTestJSON-1573931620-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 12:59:37.747264 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-bfb0ad4f-a65e-4918-9d93-9bba5f9edc28 tempest-ServerRescueNegativeTestJSON-1573931620 tempest-ServerRescueNegativeTestJSON-1573931620-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 12:59:37.893371 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.policy [None req-bfb0ad4f-a65e-4918-9d93-9bba5f9edc28 tempest-ServerRescueNegativeTestJSON-1573931620 tempest-ServerRescueNegativeTestJSON-1573931620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '731cbbfe17214ded8ac66299d66dfc45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '010919ea84eb4eb8b936c63153600eba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116064) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 12:59:37.901622 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: INFO nova.api.openstack.requestlog [None req-bfb0ad4f-a65e-4918-9d93-9bba5f9edc28 tempest-ServerRescueNegativeTestJSON-1573931620 tempest-ServerRescueNegativeTestJSON-1573931620-project] 10.222.0.49 "GET /compute/v2.1/servers/eb6e04a4-8901-47df-9b51-7c1664bd3f6c" status: 200 len: 1523 microversion: 2.1 time: 0.171668 Dec 14 12:59:37.902747 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: [pid: 116064|app: 0|req: 155/324] 10.222.0.49 () {58 vars in 1235 bytes} [Tue Dec 14 12:59:37 2021] GET /compute/v2.1/servers/eb6e04a4-8901-47df-9b51-7c1664bd3f6c => generated 1523 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 14 12:59:38.152009 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.api.openstack.wsgi [None req-5db7f395-dd8f-4164-8e88-ef2f9f820aaa tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116063) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 14 12:59:38.153046 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.compute.api [None req-5db7f395-dd8f-4164-8e88-ef2f9f820aaa tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] [instance: c8de7730-62f2-4a77-b1e9-cf6a74fa366d] Fetching instance by UUID {{(pid=116063) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 12:59:38.159824 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-5db7f395-dd8f-4164-8e88-ef2f9f820aaa tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 12:59:38.160255 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-5db7f395-dd8f-4164-8e88-ef2f9f820aaa tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 12:59:38.161296 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-5db7f395-dd8f-4164-8e88-ef2f9f820aaa tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 12:59:38.161732 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-5db7f395-dd8f-4164-8e88-ef2f9f820aaa tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 12:59:38.246297 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: INFO nova.api.openstack.requestlog [None req-5db7f395-dd8f-4164-8e88-ef2f9f820aaa tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] 10.222.0.49 "POST /compute/v2.1/servers/c8de7730-62f2-4a77-b1e9-cf6a74fa366d/action" status: 200 len: 28576 microversion: 2.20 time: 0.098202 Dec 14 12:59:38.247492 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: [pid: 116063|app: 0|req: 170/325] 10.222.0.49 () {62 vars in 1318 bytes} [Tue Dec 14 12:59:38 2021] POST /compute/v2.1/servers/c8de7730-62f2-4a77-b1e9-cf6a74fa366d/action => generated 28576 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 14 12:59:38.701848 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.api.openstack.wsgi [None req-1182feca-3ec5-46bf-9d94-50f16a7f9b89 tempest-VolumesNegativeTest-1177368279 tempest-VolumesNegativeTest-1177368279-project] Calling method '>' {{(pid=116064) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 12:59:38.702738 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.compute.api [None req-1182feca-3ec5-46bf-9d94-50f16a7f9b89 tempest-VolumesNegativeTest-1177368279 tempest-VolumesNegativeTest-1177368279-project] [instance: 64bca4a7-c923-443e-a304-580fcbd76c14] Fetching instance by UUID {{(pid=116064) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 12:59:38.710344 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-1182feca-3ec5-46bf-9d94-50f16a7f9b89 tempest-VolumesNegativeTest-1177368279 tempest-VolumesNegativeTest-1177368279-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 12:59:38.710999 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-1182feca-3ec5-46bf-9d94-50f16a7f9b89 tempest-VolumesNegativeTest-1177368279 tempest-VolumesNegativeTest-1177368279-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 12:59:38.711874 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-1182feca-3ec5-46bf-9d94-50f16a7f9b89 tempest-VolumesNegativeTest-1177368279 tempest-VolumesNegativeTest-1177368279-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 12:59:38.712397 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-1182feca-3ec5-46bf-9d94-50f16a7f9b89 tempest-VolumesNegativeTest-1177368279 tempest-VolumesNegativeTest-1177368279-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 12:59:38.921708 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.api.openstack.wsgi [None req-3c212a83-a488-4fce-9b15-6b9b9f285606 tempest-ServerRescueNegativeTestJSON-1573931620 tempest-ServerRescueNegativeTestJSON-1573931620-project] Calling method '>' {{(pid=116063) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 12:59:38.922998 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.compute.api [None req-3c212a83-a488-4fce-9b15-6b9b9f285606 tempest-ServerRescueNegativeTestJSON-1573931620 tempest-ServerRescueNegativeTestJSON-1573931620-project] [instance: eb6e04a4-8901-47df-9b51-7c1664bd3f6c] Fetching instance by UUID {{(pid=116063) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 12:59:38.933642 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-3c212a83-a488-4fce-9b15-6b9b9f285606 tempest-ServerRescueNegativeTestJSON-1573931620 tempest-ServerRescueNegativeTestJSON-1573931620-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 12:59:38.933994 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-3c212a83-a488-4fce-9b15-6b9b9f285606 tempest-ServerRescueNegativeTestJSON-1573931620 tempest-ServerRescueNegativeTestJSON-1573931620-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 12:59:38.935209 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-3c212a83-a488-4fce-9b15-6b9b9f285606 tempest-ServerRescueNegativeTestJSON-1573931620 tempest-ServerRescueNegativeTestJSON-1573931620-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 12:59:38.936103 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-3c212a83-a488-4fce-9b15-6b9b9f285606 tempest-ServerRescueNegativeTestJSON-1573931620 tempest-ServerRescueNegativeTestJSON-1573931620-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 12:59:39.157536 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.policy [None req-1182feca-3ec5-46bf-9d94-50f16a7f9b89 tempest-VolumesNegativeTest-1177368279 tempest-VolumesNegativeTest-1177368279-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68514732cd1d4c9d8181796d4573303f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fe74d6e6bd748d4a6f320530dffe300', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116064) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 12:59:39.170789 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: INFO nova.api.openstack.requestlog [None req-1182feca-3ec5-46bf-9d94-50f16a7f9b89 tempest-VolumesNegativeTest-1177368279 tempest-VolumesNegativeTest-1177368279-project] 10.222.0.49 "GET /compute/v2.1/servers/64bca4a7-c923-443e-a304-580fcbd76c14" status: 200 len: 1314 microversion: 2.1 time: 0.472408 Dec 14 12:59:39.182337 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: [pid: 116064|app: 0|req: 156/326] 10.222.0.49 () {58 vars in 1235 bytes} [Tue Dec 14 12:59:38 2021] GET /compute/v2.1/servers/64bca4a7-c923-443e-a304-580fcbd76c14 => generated 1314 bytes in 485 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 14 12:59:39.188968 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.api.openstack.wsgi [req-be9e17c7-0973-4ae8-ab7e-0c81056320f1 req-f1eadc27-cad5-439f-91a9-f8490aae664c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "64bca4a7-c923-443e-a304-580fcbd76c14", "name": "network-vif-plugged", "status": "completed", "tag": "f3c25b41-d22f-41fb-921e-52e0ff1be2a4"}]} {{(pid=116064) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 14 12:59:39.190513 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.policy [None req-3c212a83-a488-4fce-9b15-6b9b9f285606 tempest-ServerRescueNegativeTestJSON-1573931620 tempest-ServerRescueNegativeTestJSON-1573931620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '731cbbfe17214ded8ac66299d66dfc45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '010919ea84eb4eb8b936c63153600eba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116063) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 12:59:39.194147 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 14 12:59:39.194147 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: warnings.warn(msg) Dec 14 12:59:39.198968 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: INFO nova.api.openstack.requestlog [None req-3c212a83-a488-4fce-9b15-6b9b9f285606 tempest-ServerRescueNegativeTestJSON-1573931620 tempest-ServerRescueNegativeTestJSON-1573931620-project] 10.222.0.49 "GET /compute/v2.1/servers/eb6e04a4-8901-47df-9b51-7c1664bd3f6c" status: 200 len: 1523 microversion: 2.1 time: 0.282747 Dec 14 12:59:39.200515 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: [pid: 116063|app: 0|req: 171/327] 10.222.0.49 () {58 vars in 1235 bytes} [Tue Dec 14 12:59:38 2021] GET /compute/v2.1/servers/eb6e04a4-8901-47df-9b51-7c1664bd3f6c => generated 1523 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 14 12:59:39.210174 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [req-be9e17c7-0973-4ae8-ab7e-0c81056320f1 req-f1eadc27-cad5-439f-91a9-f8490aae664c service nova] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 12:59:39.210980 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [req-be9e17c7-0973-4ae8-ab7e-0c81056320f1 req-f1eadc27-cad5-439f-91a9-f8490aae664c service nova] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 12:59:39.232267 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: INFO nova.api.openstack.compute.server_external_events [req-be9e17c7-0973-4ae8-ab7e-0c81056320f1 req-f1eadc27-cad5-439f-91a9-f8490aae664c service nova] Creating event network-vif-plugged:f3c25b41-d22f-41fb-921e-52e0ff1be2a4 for instance 64bca4a7-c923-443e-a304-580fcbd76c14 on hv-cinder-78447 Dec 14 12:59:39.243651 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: INFO nova.api.openstack.requestlog [req-be9e17c7-0973-4ae8-ab7e-0c81056320f1 req-f1eadc27-cad5-439f-91a9-f8490aae664c service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.059102 Dec 14 12:59:39.245804 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: [pid: 116064|app: 0|req: 157/328] 10.222.0.49 () {64 vars in 1317 bytes} [Tue Dec 14 12:59:39 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 14 12:59:39.258801 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.api.openstack.wsgi [None req-e01ba42f-e2dd-4919-8717-60f0224d5611 tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116063) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 14 12:59:39.262204 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.compute.api [None req-e01ba42f-e2dd-4919-8717-60f0224d5611 tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] [instance: c8de7730-62f2-4a77-b1e9-cf6a74fa366d] Fetching instance by UUID {{(pid=116063) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 12:59:39.273741 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-e01ba42f-e2dd-4919-8717-60f0224d5611 tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 12:59:39.274197 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-e01ba42f-e2dd-4919-8717-60f0224d5611 tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 12:59:39.275009 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-e01ba42f-e2dd-4919-8717-60f0224d5611 tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 12:59:39.275441 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-e01ba42f-e2dd-4919-8717-60f0224d5611 tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 12:59:39.388791 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: INFO nova.api.openstack.requestlog [None req-e01ba42f-e2dd-4919-8717-60f0224d5611 tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] 10.222.0.49 "POST /compute/v2.1/servers/c8de7730-62f2-4a77-b1e9-cf6a74fa366d/action" status: 200 len: 28576 microversion: 2.20 time: 0.133306 Dec 14 12:59:39.389991 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: [pid: 116063|app: 0|req: 172/329] 10.222.0.49 () {62 vars in 1318 bytes} [Tue Dec 14 12:59:39 2021] POST /compute/v2.1/servers/c8de7730-62f2-4a77-b1e9-cf6a74fa366d/action => generated 28576 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 14 12:59:40.192743 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.api.openstack.wsgi [None req-59d90b5a-08de-4428-b7e9-f83016cc5057 tempest-VolumesNegativeTest-1177368279 tempest-VolumesNegativeTest-1177368279-project] Calling method '>' {{(pid=116064) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 12:59:40.194303 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.compute.api [None req-59d90b5a-08de-4428-b7e9-f83016cc5057 tempest-VolumesNegativeTest-1177368279 tempest-VolumesNegativeTest-1177368279-project] [instance: 64bca4a7-c923-443e-a304-580fcbd76c14] Fetching instance by UUID {{(pid=116064) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 12:59:40.201937 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-59d90b5a-08de-4428-b7e9-f83016cc5057 tempest-VolumesNegativeTest-1177368279 tempest-VolumesNegativeTest-1177368279-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 12:59:40.202377 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-59d90b5a-08de-4428-b7e9-f83016cc5057 tempest-VolumesNegativeTest-1177368279 tempest-VolumesNegativeTest-1177368279-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 12:59:40.203181 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-59d90b5a-08de-4428-b7e9-f83016cc5057 tempest-VolumesNegativeTest-1177368279 tempest-VolumesNegativeTest-1177368279-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 12:59:40.203622 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-59d90b5a-08de-4428-b7e9-f83016cc5057 tempest-VolumesNegativeTest-1177368279 tempest-VolumesNegativeTest-1177368279-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 12:59:40.218224 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.api.openstack.wsgi [None req-4df5f102-cf81-4c9e-bd86-18b909a46624 tempest-ServerRescueNegativeTestJSON-1573931620 tempest-ServerRescueNegativeTestJSON-1573931620-project] Calling method '>' {{(pid=116063) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 12:59:40.218921 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.compute.api [None req-4df5f102-cf81-4c9e-bd86-18b909a46624 tempest-ServerRescueNegativeTestJSON-1573931620 tempest-ServerRescueNegativeTestJSON-1573931620-project] [instance: eb6e04a4-8901-47df-9b51-7c1664bd3f6c] Fetching instance by UUID {{(pid=116063) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 12:59:40.236658 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-4df5f102-cf81-4c9e-bd86-18b909a46624 tempest-ServerRescueNegativeTestJSON-1573931620 tempest-ServerRescueNegativeTestJSON-1573931620-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 12:59:40.237742 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-4df5f102-cf81-4c9e-bd86-18b909a46624 tempest-ServerRescueNegativeTestJSON-1573931620 tempest-ServerRescueNegativeTestJSON-1573931620-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 12:59:40.238549 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-4df5f102-cf81-4c9e-bd86-18b909a46624 tempest-ServerRescueNegativeTestJSON-1573931620 tempest-ServerRescueNegativeTestJSON-1573931620-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 12:59:40.240024 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-4df5f102-cf81-4c9e-bd86-18b909a46624 tempest-ServerRescueNegativeTestJSON-1573931620 tempest-ServerRescueNegativeTestJSON-1573931620-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 12:59:40.379051 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.policy [None req-59d90b5a-08de-4428-b7e9-f83016cc5057 tempest-VolumesNegativeTest-1177368279 tempest-VolumesNegativeTest-1177368279-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68514732cd1d4c9d8181796d4573303f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fe74d6e6bd748d4a6f320530dffe300', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116064) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 12:59:40.389472 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: INFO nova.api.openstack.requestlog [None req-59d90b5a-08de-4428-b7e9-f83016cc5057 tempest-VolumesNegativeTest-1177368279 tempest-VolumesNegativeTest-1177368279-project] 10.222.0.49 "GET /compute/v2.1/servers/64bca4a7-c923-443e-a304-580fcbd76c14" status: 200 len: 1314 microversion: 2.1 time: 0.200763 Dec 14 12:59:40.390570 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: [pid: 116064|app: 0|req: 158/330] 10.222.0.49 () {58 vars in 1235 bytes} [Tue Dec 14 12:59:40 2021] GET /compute/v2.1/servers/64bca4a7-c923-443e-a304-580fcbd76c14 => generated 1314 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 14 12:59:40.410014 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.api.openstack.wsgi [None req-29249b17-f037-485f-b25e-db510ebcc79b tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116064) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 14 12:59:40.410961 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.compute.api [None req-29249b17-f037-485f-b25e-db510ebcc79b tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] [instance: c8de7730-62f2-4a77-b1e9-cf6a74fa366d] Fetching instance by UUID {{(pid=116064) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 12:59:40.417204 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-29249b17-f037-485f-b25e-db510ebcc79b tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 12:59:40.417910 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-29249b17-f037-485f-b25e-db510ebcc79b tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 12:59:40.418865 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-29249b17-f037-485f-b25e-db510ebcc79b tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 12:59:40.419444 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-29249b17-f037-485f-b25e-db510ebcc79b tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 12:59:40.445746 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.policy [None req-4df5f102-cf81-4c9e-bd86-18b909a46624 tempest-ServerRescueNegativeTestJSON-1573931620 tempest-ServerRescueNegativeTestJSON-1573931620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '731cbbfe17214ded8ac66299d66dfc45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '010919ea84eb4eb8b936c63153600eba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116063) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 12:59:40.454782 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: INFO nova.api.openstack.requestlog [None req-4df5f102-cf81-4c9e-bd86-18b909a46624 tempest-ServerRescueNegativeTestJSON-1573931620 tempest-ServerRescueNegativeTestJSON-1573931620-project] 10.222.0.49 "GET /compute/v2.1/servers/eb6e04a4-8901-47df-9b51-7c1664bd3f6c" status: 200 len: 1523 microversion: 2.1 time: 0.240619 Dec 14 12:59:40.455747 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: [pid: 116063|app: 0|req: 173/331] 10.222.0.49 () {58 vars in 1235 bytes} [Tue Dec 14 12:59:40 2021] GET /compute/v2.1/servers/eb6e04a4-8901-47df-9b51-7c1664bd3f6c => generated 1523 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 14 12:59:40.526791 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: INFO nova.api.openstack.requestlog [None req-29249b17-f037-485f-b25e-db510ebcc79b tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] 10.222.0.49 "POST /compute/v2.1/servers/c8de7730-62f2-4a77-b1e9-cf6a74fa366d/action" status: 200 len: 28576 microversion: 2.20 time: 0.124843 Dec 14 12:59:40.527825 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: [pid: 116064|app: 0|req: 159/332] 10.222.0.49 () {62 vars in 1318 bytes} [Tue Dec 14 12:59:40 2021] POST /compute/v2.1/servers/c8de7730-62f2-4a77-b1e9-cf6a74fa366d/action => generated 28576 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Dec 14 12:59:41.408107 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.api.openstack.wsgi [None req-64815b99-0f39-4853-83ff-27f2e40c9d7f tempest-VolumesNegativeTest-1177368279 tempest-VolumesNegativeTest-1177368279-project] Calling method '>' {{(pid=116063) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 12:59:41.408765 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.compute.api [None req-64815b99-0f39-4853-83ff-27f2e40c9d7f tempest-VolumesNegativeTest-1177368279 tempest-VolumesNegativeTest-1177368279-project] [instance: 64bca4a7-c923-443e-a304-580fcbd76c14] Fetching instance by UUID {{(pid=116063) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 12:59:41.416467 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-64815b99-0f39-4853-83ff-27f2e40c9d7f tempest-VolumesNegativeTest-1177368279 tempest-VolumesNegativeTest-1177368279-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 12:59:41.423892 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-64815b99-0f39-4853-83ff-27f2e40c9d7f tempest-VolumesNegativeTest-1177368279 tempest-VolumesNegativeTest-1177368279-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 12:59:41.441936 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-64815b99-0f39-4853-83ff-27f2e40c9d7f tempest-VolumesNegativeTest-1177368279 tempest-VolumesNegativeTest-1177368279-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.017s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 12:59:41.442699 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-64815b99-0f39-4853-83ff-27f2e40c9d7f tempest-VolumesNegativeTest-1177368279 tempest-VolumesNegativeTest-1177368279-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 12:59:41.472771 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.api.openstack.wsgi [None req-2b8b6784-ef23-4bf7-9966-fb3f5b454245 tempest-ServerRescueNegativeTestJSON-1573931620 tempest-ServerRescueNegativeTestJSON-1573931620-project] Calling method '>' {{(pid=116064) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 12:59:41.474252 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.compute.api [None req-2b8b6784-ef23-4bf7-9966-fb3f5b454245 tempest-ServerRescueNegativeTestJSON-1573931620 tempest-ServerRescueNegativeTestJSON-1573931620-project] [instance: eb6e04a4-8901-47df-9b51-7c1664bd3f6c] Fetching instance by UUID {{(pid=116064) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 12:59:41.487495 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-2b8b6784-ef23-4bf7-9966-fb3f5b454245 tempest-ServerRescueNegativeTestJSON-1573931620 tempest-ServerRescueNegativeTestJSON-1573931620-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 12:59:41.488045 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-2b8b6784-ef23-4bf7-9966-fb3f5b454245 tempest-ServerRescueNegativeTestJSON-1573931620 tempest-ServerRescueNegativeTestJSON-1573931620-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 12:59:41.490134 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-2b8b6784-ef23-4bf7-9966-fb3f5b454245 tempest-ServerRescueNegativeTestJSON-1573931620 tempest-ServerRescueNegativeTestJSON-1573931620-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 12:59:41.490773 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-2b8b6784-ef23-4bf7-9966-fb3f5b454245 tempest-ServerRescueNegativeTestJSON-1573931620 tempest-ServerRescueNegativeTestJSON-1573931620-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 12:59:41.806839 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.policy [None req-64815b99-0f39-4853-83ff-27f2e40c9d7f tempest-VolumesNegativeTest-1177368279 tempest-VolumesNegativeTest-1177368279-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68514732cd1d4c9d8181796d4573303f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fe74d6e6bd748d4a6f320530dffe300', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116063) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 12:59:41.827300 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: INFO nova.api.openstack.requestlog [None req-64815b99-0f39-4853-83ff-27f2e40c9d7f tempest-VolumesNegativeTest-1177368279 tempest-VolumesNegativeTest-1177368279-project] 10.222.0.49 "GET /compute/v2.1/servers/64bca4a7-c923-443e-a304-580fcbd76c14" status: 200 len: 1314 microversion: 2.1 time: 0.422960 Dec 14 12:59:41.849041 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: [pid: 116063|app: 0|req: 174/333] 10.222.0.49 () {58 vars in 1235 bytes} [Tue Dec 14 12:59:41 2021] GET /compute/v2.1/servers/64bca4a7-c923-443e-a304-580fcbd76c14 => generated 1314 bytes in 445 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 14 12:59:41.861474 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.api.openstack.wsgi [None req-82df564a-740f-485b-a80f-78b8c242f73a tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116063) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 14 12:59:41.862388 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.compute.api [None req-82df564a-740f-485b-a80f-78b8c242f73a tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] [instance: c8de7730-62f2-4a77-b1e9-cf6a74fa366d] Fetching instance by UUID {{(pid=116063) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 12:59:41.872244 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-82df564a-740f-485b-a80f-78b8c242f73a tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 12:59:41.873232 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-82df564a-740f-485b-a80f-78b8c242f73a tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 12:59:41.874407 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-82df564a-740f-485b-a80f-78b8c242f73a tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 12:59:41.874981 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-82df564a-740f-485b-a80f-78b8c242f73a tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 12:59:41.875532 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.policy [None req-2b8b6784-ef23-4bf7-9966-fb3f5b454245 tempest-ServerRescueNegativeTestJSON-1573931620 tempest-ServerRescueNegativeTestJSON-1573931620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '731cbbfe17214ded8ac66299d66dfc45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '010919ea84eb4eb8b936c63153600eba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116064) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 12:59:41.886108 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: INFO nova.api.openstack.requestlog [None req-2b8b6784-ef23-4bf7-9966-fb3f5b454245 tempest-ServerRescueNegativeTestJSON-1573931620 tempest-ServerRescueNegativeTestJSON-1573931620-project] 10.222.0.49 "GET /compute/v2.1/servers/eb6e04a4-8901-47df-9b51-7c1664bd3f6c" status: 200 len: 1523 microversion: 2.1 time: 0.417487 Dec 14 12:59:41.888206 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: [pid: 116064|app: 0|req: 160/334] 10.222.0.49 () {58 vars in 1235 bytes} [Tue Dec 14 12:59:41 2021] GET /compute/v2.1/servers/eb6e04a4-8901-47df-9b51-7c1664bd3f6c => generated 1523 bytes in 421 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 14 12:59:42.071798 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: INFO nova.api.openstack.requestlog [None req-82df564a-740f-485b-a80f-78b8c242f73a tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] 10.222.0.49 "POST /compute/v2.1/servers/c8de7730-62f2-4a77-b1e9-cf6a74fa366d/action" status: 200 len: 28986 microversion: 2.20 time: 0.219786 Dec 14 12:59:42.072318 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: [pid: 116063|app: 0|req: 175/335] 10.222.0.49 () {62 vars in 1318 bytes} [Tue Dec 14 12:59:41 2021] POST /compute/v2.1/servers/c8de7730-62f2-4a77-b1e9-cf6a74fa366d/action => generated 28986 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 14 12:59:42.366033 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.api.openstack.wsgi [None req-754c47ed-f60a-4a1d-a901-b20e85705848 tempest-AttachVolumeNegativeTest-1000400951 tempest-AttachVolumeNegativeTest-1000400951-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "b5a1d095-3b51-4fae-ba5c-f49f070c8b9f"}} {{(pid=116064) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 14 12:59:42.367168 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.compute.api [None req-754c47ed-f60a-4a1d-a901-b20e85705848 tempest-AttachVolumeNegativeTest-1000400951 tempest-AttachVolumeNegativeTest-1000400951-project] [instance: 8d264701-aaa0-465f-a4aa-0cffa41351ef] Fetching instance by UUID {{(pid=116064) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 12:59:42.374390 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-754c47ed-f60a-4a1d-a901-b20e85705848 tempest-AttachVolumeNegativeTest-1000400951 tempest-AttachVolumeNegativeTest-1000400951-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 12:59:42.375084 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-754c47ed-f60a-4a1d-a901-b20e85705848 tempest-AttachVolumeNegativeTest-1000400951 tempest-AttachVolumeNegativeTest-1000400951-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 12:59:42.376075 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-754c47ed-f60a-4a1d-a901-b20e85705848 tempest-AttachVolumeNegativeTest-1000400951 tempest-AttachVolumeNegativeTest-1000400951-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 12:59:42.376596 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-754c47ed-f60a-4a1d-a901-b20e85705848 tempest-AttachVolumeNegativeTest-1000400951 tempest-AttachVolumeNegativeTest-1000400951-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 12:59:42.469768 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: INFO nova.api.openstack.wsgi [None req-754c47ed-f60a-4a1d-a901-b20e85705848 tempest-AttachVolumeNegativeTest-1000400951 tempest-AttachVolumeNegativeTest-1000400951-project] HTTP exception thrown: Invalid volume: volume b5a1d095-3b51-4fae-ba5c-f49f070c8b9f is already attached to instances: 8d264701-aaa0-465f-a4aa-0cffa41351ef Dec 14 12:59:42.470381 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.api.openstack.wsgi [None req-754c47ed-f60a-4a1d-a901-b20e85705848 tempest-AttachVolumeNegativeTest-1000400951 tempest-AttachVolumeNegativeTest-1000400951-project] Returning 400 to user: Invalid volume: volume b5a1d095-3b51-4fae-ba5c-f49f070c8b9f is already attached to instances: 8d264701-aaa0-465f-a4aa-0cffa41351ef {{(pid=116064) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 14 12:59:42.471227 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: INFO nova.api.openstack.requestlog [None req-754c47ed-f60a-4a1d-a901-b20e85705848 tempest-AttachVolumeNegativeTest-1000400951 tempest-AttachVolumeNegativeTest-1000400951-project] 10.222.0.49 "POST /compute/v2.1/servers/8d264701-aaa0-465f-a4aa-0cffa41351ef/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.109236 Dec 14 12:59:42.471793 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: [pid: 116064|app: 0|req: 161/336] 10.222.0.49 () {60 vars in 1322 bytes} [Tue Dec 14 12:59:42 2021] POST /compute/v2.1/servers/8d264701-aaa0-465f-a4aa-0cffa41351ef/os-volume_attachments => generated 174 bytes in 110 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Dec 14 12:59:42.532429 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.api.openstack.wsgi [None req-0c261af0-ef94-4585-a5d3-e7df961a2919 tempest-AttachVolumeNegativeTest-1000400951 tempest-AttachVolumeNegativeTest-1000400951-project] Calling method '>' {{(pid=116063) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 12:59:42.533152 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.compute.api [None req-0c261af0-ef94-4585-a5d3-e7df961a2919 tempest-AttachVolumeNegativeTest-1000400951 tempest-AttachVolumeNegativeTest-1000400951-project] [instance: 8d264701-aaa0-465f-a4aa-0cffa41351ef] Fetching instance by UUID {{(pid=116063) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 12:59:42.542021 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-0c261af0-ef94-4585-a5d3-e7df961a2919 tempest-AttachVolumeNegativeTest-1000400951 tempest-AttachVolumeNegativeTest-1000400951-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 12:59:42.542893 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-0c261af0-ef94-4585-a5d3-e7df961a2919 tempest-AttachVolumeNegativeTest-1000400951 tempest-AttachVolumeNegativeTest-1000400951-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 12:59:42.543770 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-0c261af0-ef94-4585-a5d3-e7df961a2919 tempest-AttachVolumeNegativeTest-1000400951 tempest-AttachVolumeNegativeTest-1000400951-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 12:59:42.544329 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-0c261af0-ef94-4585-a5d3-e7df961a2919 tempest-AttachVolumeNegativeTest-1000400951 tempest-AttachVolumeNegativeTest-1000400951-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 12:59:42.638136 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.objects.instance [None req-0c261af0-ef94-4585-a5d3-e7df961a2919 tempest-AttachVolumeNegativeTest-1000400951 tempest-AttachVolumeNegativeTest-1000400951-project] Lazy-loading 'services' on Instance uuid 8d264701-aaa0-465f-a4aa-0cffa41351ef {{(pid=116063) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Dec 14 12:59:42.720086 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: INFO nova.api.openstack.requestlog [None req-0c261af0-ef94-4585-a5d3-e7df961a2919 tempest-AttachVolumeNegativeTest-1000400951 tempest-AttachVolumeNegativeTest-1000400951-project] 10.222.0.49 "DELETE /compute/v2.1/servers/8d264701-aaa0-465f-a4aa-0cffa41351ef/os-volume_attachments/b5a1d095-3b51-4fae-ba5c-f49f070c8b9f" status: 202 len: 0 microversion: 2.1 time: 0.190989 Dec 14 12:59:42.722057 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: [pid: 116063|app: 0|req: 176/337] 10.222.0.49 () {58 vars in 1415 bytes} [Tue Dec 14 12:59:42 2021] DELETE /compute/v2.1/servers/8d264701-aaa0-465f-a4aa-0cffa41351ef/os-volume_attachments/b5a1d095-3b51-4fae-ba5c-f49f070c8b9f => generated 0 bytes in 195 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Dec 14 12:59:42.731623 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.api.openstack.wsgi [None req-1063ab14-19e7-41dc-bef7-515c5ba63990 tempest-AttachVolumeNegativeTest-1000400951 tempest-AttachVolumeNegativeTest-1000400951-project] Calling method '>' {{(pid=116064) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 12:59:42.733057 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.compute.api [None req-1063ab14-19e7-41dc-bef7-515c5ba63990 tempest-AttachVolumeNegativeTest-1000400951 tempest-AttachVolumeNegativeTest-1000400951-project] [instance: 8d264701-aaa0-465f-a4aa-0cffa41351ef] Fetching instance by UUID {{(pid=116064) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 12:59:42.740499 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-1063ab14-19e7-41dc-bef7-515c5ba63990 tempest-AttachVolumeNegativeTest-1000400951 tempest-AttachVolumeNegativeTest-1000400951-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 12:59:42.740993 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-1063ab14-19e7-41dc-bef7-515c5ba63990 tempest-AttachVolumeNegativeTest-1000400951 tempest-AttachVolumeNegativeTest-1000400951-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 12:59:42.742019 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-1063ab14-19e7-41dc-bef7-515c5ba63990 tempest-AttachVolumeNegativeTest-1000400951 tempest-AttachVolumeNegativeTest-1000400951-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 12:59:42.742732 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-1063ab14-19e7-41dc-bef7-515c5ba63990 tempest-AttachVolumeNegativeTest-1000400951 tempest-AttachVolumeNegativeTest-1000400951-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 12:59:42.775490 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: INFO nova.api.openstack.requestlog [None req-1063ab14-19e7-41dc-bef7-515c5ba63990 tempest-AttachVolumeNegativeTest-1000400951 tempest-AttachVolumeNegativeTest-1000400951-project] 10.222.0.49 "GET /compute/v2.1/servers/8d264701-aaa0-465f-a4aa-0cffa41351ef/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048252 Dec 14 12:59:42.776069 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: [pid: 116064|app: 0|req: 162/338] 10.222.0.49 () {58 vars in 1301 bytes} [Tue Dec 14 12:59:42 2021] GET /compute/v2.1/servers/8d264701-aaa0-465f-a4aa-0cffa41351ef/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 14 12:59:42.858940 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.api.openstack.wsgi [None req-c8a272da-f615-43b0-8707-4bf73e422f7d tempest-VolumesNegativeTest-1177368279 tempest-VolumesNegativeTest-1177368279-project] Calling method '>' {{(pid=116063) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 12:59:42.860214 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.compute.api [None req-c8a272da-f615-43b0-8707-4bf73e422f7d tempest-VolumesNegativeTest-1177368279 tempest-VolumesNegativeTest-1177368279-project] [instance: 64bca4a7-c923-443e-a304-580fcbd76c14] Fetching instance by UUID {{(pid=116063) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 12:59:42.867007 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-c8a272da-f615-43b0-8707-4bf73e422f7d tempest-VolumesNegativeTest-1177368279 tempest-VolumesNegativeTest-1177368279-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 12:59:42.867443 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-c8a272da-f615-43b0-8707-4bf73e422f7d tempest-VolumesNegativeTest-1177368279 tempest-VolumesNegativeTest-1177368279-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 12:59:42.868291 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-c8a272da-f615-43b0-8707-4bf73e422f7d tempest-VolumesNegativeTest-1177368279 tempest-VolumesNegativeTest-1177368279-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 12:59:42.868819 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-c8a272da-f615-43b0-8707-4bf73e422f7d tempest-VolumesNegativeTest-1177368279 tempest-VolumesNegativeTest-1177368279-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 12:59:42.905227 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.api.openstack.wsgi [None req-f1c9cd56-3687-4f9e-b72a-93297a795528 tempest-ServerRescueNegativeTestJSON-1573931620 tempest-ServerRescueNegativeTestJSON-1573931620-project] Calling method '>' {{(pid=116064) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 12:59:42.906431 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.compute.api [None req-f1c9cd56-3687-4f9e-b72a-93297a795528 tempest-ServerRescueNegativeTestJSON-1573931620 tempest-ServerRescueNegativeTestJSON-1573931620-project] [instance: eb6e04a4-8901-47df-9b51-7c1664bd3f6c] Fetching instance by UUID {{(pid=116064) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 12:59:42.914678 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-f1c9cd56-3687-4f9e-b72a-93297a795528 tempest-ServerRescueNegativeTestJSON-1573931620 tempest-ServerRescueNegativeTestJSON-1573931620-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 12:59:42.915489 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-f1c9cd56-3687-4f9e-b72a-93297a795528 tempest-ServerRescueNegativeTestJSON-1573931620 tempest-ServerRescueNegativeTestJSON-1573931620-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 12:59:42.916752 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-f1c9cd56-3687-4f9e-b72a-93297a795528 tempest-ServerRescueNegativeTestJSON-1573931620 tempest-ServerRescueNegativeTestJSON-1573931620-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 12:59:42.917474 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-f1c9cd56-3687-4f9e-b72a-93297a795528 tempest-ServerRescueNegativeTestJSON-1573931620 tempest-ServerRescueNegativeTestJSON-1573931620-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 12:59:43.107957 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.policy [None req-c8a272da-f615-43b0-8707-4bf73e422f7d tempest-VolumesNegativeTest-1177368279 tempest-VolumesNegativeTest-1177368279-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68514732cd1d4c9d8181796d4573303f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fe74d6e6bd748d4a6f320530dffe300', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116063) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 12:59:43.116654 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: INFO nova.api.openstack.requestlog [None req-c8a272da-f615-43b0-8707-4bf73e422f7d tempest-VolumesNegativeTest-1177368279 tempest-VolumesNegativeTest-1177368279-project] 10.222.0.49 "GET /compute/v2.1/servers/64bca4a7-c923-443e-a304-580fcbd76c14" status: 200 len: 1463 microversion: 2.1 time: 0.267268 Dec 14 12:59:43.117550 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: [pid: 116063|app: 0|req: 177/339] 10.222.0.49 () {58 vars in 1235 bytes} [Tue Dec 14 12:59:42 2021] GET /compute/v2.1/servers/64bca4a7-c923-443e-a304-580fcbd76c14 => generated 1463 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 14 12:59:43.147409 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.api.openstack.wsgi [None req-89a05043-3f49-4e3e-8839-e8e85f7411ea tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116063) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 14 12:59:43.149861 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.compute.api [None req-89a05043-3f49-4e3e-8839-e8e85f7411ea tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] [instance: c8de7730-62f2-4a77-b1e9-cf6a74fa366d] Fetching instance by UUID {{(pid=116063) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 12:59:43.157579 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.policy [None req-f1c9cd56-3687-4f9e-b72a-93297a795528 tempest-ServerRescueNegativeTestJSON-1573931620 tempest-ServerRescueNegativeTestJSON-1573931620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '731cbbfe17214ded8ac66299d66dfc45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '010919ea84eb4eb8b936c63153600eba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116064) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 12:59:43.158344 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-89a05043-3f49-4e3e-8839-e8e85f7411ea tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 12:59:43.159130 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-89a05043-3f49-4e3e-8839-e8e85f7411ea tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 12:59:43.164416 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-89a05043-3f49-4e3e-8839-e8e85f7411ea tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 12:59:43.164990 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-89a05043-3f49-4e3e-8839-e8e85f7411ea tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 12:59:43.165624 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: INFO nova.api.openstack.requestlog [None req-f1c9cd56-3687-4f9e-b72a-93297a795528 tempest-ServerRescueNegativeTestJSON-1573931620 tempest-ServerRescueNegativeTestJSON-1573931620-project] 10.222.0.49 "GET /compute/v2.1/servers/eb6e04a4-8901-47df-9b51-7c1664bd3f6c" status: 200 len: 1523 microversion: 2.1 time: 0.264149 Dec 14 12:59:43.167574 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: [pid: 116064|app: 0|req: 163/340] 10.222.0.49 () {58 vars in 1235 bytes} [Tue Dec 14 12:59:42 2021] GET /compute/v2.1/servers/eb6e04a4-8901-47df-9b51-7c1664bd3f6c => generated 1523 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 14 12:59:43.177377 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.api.openstack.wsgi [None req-84dc5d8d-32b2-4493-9319-232cd26f96dc tempest-VolumesNegativeTest-1177368279 tempest-VolumesNegativeTest-1177368279-project] Calling method '>' {{(pid=116064) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 12:59:43.177377 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.compute.api [None req-84dc5d8d-32b2-4493-9319-232cd26f96dc tempest-VolumesNegativeTest-1177368279 tempest-VolumesNegativeTest-1177368279-project] [instance: 64bca4a7-c923-443e-a304-580fcbd76c14] Fetching instance by UUID {{(pid=116064) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 12:59:43.180134 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-84dc5d8d-32b2-4493-9319-232cd26f96dc tempest-VolumesNegativeTest-1177368279 tempest-VolumesNegativeTest-1177368279-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 12:59:43.180582 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-84dc5d8d-32b2-4493-9319-232cd26f96dc tempest-VolumesNegativeTest-1177368279 tempest-VolumesNegativeTest-1177368279-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 12:59:43.181430 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-84dc5d8d-32b2-4493-9319-232cd26f96dc tempest-VolumesNegativeTest-1177368279 tempest-VolumesNegativeTest-1177368279-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 12:59:43.181846 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-84dc5d8d-32b2-4493-9319-232cd26f96dc tempest-VolumesNegativeTest-1177368279 tempest-VolumesNegativeTest-1177368279-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 12:59:43.209908 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.compute.api [None req-84dc5d8d-32b2-4493-9319-232cd26f96dc tempest-VolumesNegativeTest-1177368279 tempest-VolumesNegativeTest-1177368279-project] [instance: 64bca4a7-c923-443e-a304-580fcbd76c14] Going to try to terminate instance {{(pid=116064) delete /opt/stack/nova/nova/compute/api.py:2614}} Dec 14 12:59:43.314077 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: INFO nova.api.openstack.requestlog [None req-84dc5d8d-32b2-4493-9319-232cd26f96dc tempest-VolumesNegativeTest-1177368279 tempest-VolumesNegativeTest-1177368279-project] 10.222.0.49 "DELETE /compute/v2.1/servers/64bca4a7-c923-443e-a304-580fcbd76c14" status: 204 len: 0 microversion: 2.1 time: 0.145117 Dec 14 12:59:43.314965 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: [pid: 116064|app: 0|req: 164/341] 10.222.0.49 () {58 vars in 1238 bytes} [Tue Dec 14 12:59:43 2021] DELETE /compute/v2.1/servers/64bca4a7-c923-443e-a304-580fcbd76c14 => generated 0 bytes in 147 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Dec 14 12:59:43.324510 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.api.openstack.wsgi [None req-4c8ec163-f636-4e9c-9504-803d6b258b4e tempest-VolumesNegativeTest-1177368279 tempest-VolumesNegativeTest-1177368279-project] Calling method '>' {{(pid=116064) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 12:59:43.325304 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.compute.api [None req-4c8ec163-f636-4e9c-9504-803d6b258b4e tempest-VolumesNegativeTest-1177368279 tempest-VolumesNegativeTest-1177368279-project] [instance: 64bca4a7-c923-443e-a304-580fcbd76c14] Fetching instance by UUID {{(pid=116064) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 12:59:43.331770 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-4c8ec163-f636-4e9c-9504-803d6b258b4e tempest-VolumesNegativeTest-1177368279 tempest-VolumesNegativeTest-1177368279-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 12:59:43.332551 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-4c8ec163-f636-4e9c-9504-803d6b258b4e tempest-VolumesNegativeTest-1177368279 tempest-VolumesNegativeTest-1177368279-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 12:59:43.333575 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-4c8ec163-f636-4e9c-9504-803d6b258b4e tempest-VolumesNegativeTest-1177368279 tempest-VolumesNegativeTest-1177368279-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 12:59:43.334156 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-4c8ec163-f636-4e9c-9504-803d6b258b4e tempest-VolumesNegativeTest-1177368279 tempest-VolumesNegativeTest-1177368279-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 12:59:43.486830 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.policy [None req-4c8ec163-f636-4e9c-9504-803d6b258b4e tempest-VolumesNegativeTest-1177368279 tempest-VolumesNegativeTest-1177368279-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68514732cd1d4c9d8181796d4573303f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fe74d6e6bd748d4a6f320530dffe300', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116064) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 12:59:43.494146 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: INFO nova.api.openstack.requestlog [None req-4c8ec163-f636-4e9c-9504-803d6b258b4e tempest-VolumesNegativeTest-1177368279 tempest-VolumesNegativeTest-1177368279-project] 10.222.0.49 "GET /compute/v2.1/servers/64bca4a7-c923-443e-a304-580fcbd76c14" status: 200 len: 1469 microversion: 2.1 time: 0.174834 Dec 14 12:59:43.494730 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: [pid: 116064|app: 0|req: 165/342] 10.222.0.49 () {58 vars in 1235 bytes} [Tue Dec 14 12:59:43 2021] GET /compute/v2.1/servers/64bca4a7-c923-443e-a304-580fcbd76c14 => generated 1469 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 14 12:59:43.791261 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.api.openstack.wsgi [None req-bd48d279-95e7-4e5c-9fa9-9763ce799f03 tempest-AttachVolumeNegativeTest-1000400951 tempest-AttachVolumeNegativeTest-1000400951-project] Calling method '>' {{(pid=116064) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 12:59:43.792612 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.compute.api [None req-bd48d279-95e7-4e5c-9fa9-9763ce799f03 tempest-AttachVolumeNegativeTest-1000400951 tempest-AttachVolumeNegativeTest-1000400951-project] [instance: 8d264701-aaa0-465f-a4aa-0cffa41351ef] Fetching instance by UUID {{(pid=116064) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 12:59:43.799884 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-bd48d279-95e7-4e5c-9fa9-9763ce799f03 tempest-AttachVolumeNegativeTest-1000400951 tempest-AttachVolumeNegativeTest-1000400951-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 12:59:43.800420 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-bd48d279-95e7-4e5c-9fa9-9763ce799f03 tempest-AttachVolumeNegativeTest-1000400951 tempest-AttachVolumeNegativeTest-1000400951-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 12:59:43.801667 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-bd48d279-95e7-4e5c-9fa9-9763ce799f03 tempest-AttachVolumeNegativeTest-1000400951 tempest-AttachVolumeNegativeTest-1000400951-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 12:59:43.802329 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-bd48d279-95e7-4e5c-9fa9-9763ce799f03 tempest-AttachVolumeNegativeTest-1000400951 tempest-AttachVolumeNegativeTest-1000400951-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 12:59:43.844594 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: INFO nova.api.openstack.requestlog [None req-bd48d279-95e7-4e5c-9fa9-9763ce799f03 tempest-AttachVolumeNegativeTest-1000400951 tempest-AttachVolumeNegativeTest-1000400951-project] 10.222.0.49 "GET /compute/v2.1/servers/8d264701-aaa0-465f-a4aa-0cffa41351ef/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.059606 Dec 14 12:59:43.845414 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: [pid: 116064|app: 0|req: 166/343] 10.222.0.49 () {58 vars in 1301 bytes} [Tue Dec 14 12:59:43 2021] GET /compute/v2.1/servers/8d264701-aaa0-465f-a4aa-0cffa41351ef/os-volume_attachments => generated 197 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 14 12:59:44.187840 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.api.openstack.wsgi [None req-d01562c3-8d9d-41cc-b88b-f2dac3e17abd tempest-ServerRescueNegativeTestJSON-1573931620 tempest-ServerRescueNegativeTestJSON-1573931620-project] Calling method '>' {{(pid=116064) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 12:59:44.189246 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.compute.api [None req-d01562c3-8d9d-41cc-b88b-f2dac3e17abd tempest-ServerRescueNegativeTestJSON-1573931620 tempest-ServerRescueNegativeTestJSON-1573931620-project] [instance: eb6e04a4-8901-47df-9b51-7c1664bd3f6c] Fetching instance by UUID {{(pid=116064) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 12:59:44.199896 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-d01562c3-8d9d-41cc-b88b-f2dac3e17abd tempest-ServerRescueNegativeTestJSON-1573931620 tempest-ServerRescueNegativeTestJSON-1573931620-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 12:59:44.200640 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-d01562c3-8d9d-41cc-b88b-f2dac3e17abd tempest-ServerRescueNegativeTestJSON-1573931620 tempest-ServerRescueNegativeTestJSON-1573931620-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 12:59:44.201986 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-d01562c3-8d9d-41cc-b88b-f2dac3e17abd tempest-ServerRescueNegativeTestJSON-1573931620 tempest-ServerRescueNegativeTestJSON-1573931620-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 12:59:44.202702 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-d01562c3-8d9d-41cc-b88b-f2dac3e17abd tempest-ServerRescueNegativeTestJSON-1573931620 tempest-ServerRescueNegativeTestJSON-1573931620-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 12:59:44.340354 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.policy [None req-d01562c3-8d9d-41cc-b88b-f2dac3e17abd tempest-ServerRescueNegativeTestJSON-1573931620 tempest-ServerRescueNegativeTestJSON-1573931620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '731cbbfe17214ded8ac66299d66dfc45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '010919ea84eb4eb8b936c63153600eba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116064) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 12:59:44.347729 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: INFO nova.api.openstack.requestlog [None req-d01562c3-8d9d-41cc-b88b-f2dac3e17abd tempest-ServerRescueNegativeTestJSON-1573931620 tempest-ServerRescueNegativeTestJSON-1573931620-project] 10.222.0.49 "GET /compute/v2.1/servers/eb6e04a4-8901-47df-9b51-7c1664bd3f6c" status: 200 len: 1523 microversion: 2.1 time: 0.166117 Dec 14 12:59:44.348300 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: [pid: 116064|app: 0|req: 167/344] 10.222.0.49 () {58 vars in 1235 bytes} [Tue Dec 14 12:59:44 2021] GET /compute/v2.1/servers/eb6e04a4-8901-47df-9b51-7c1664bd3f6c => generated 1523 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 14 12:59:44.511779 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.api.openstack.wsgi [None req-91f51145-01ba-4bbf-b76a-1afbbea1fcb9 tempest-VolumesNegativeTest-1177368279 tempest-VolumesNegativeTest-1177368279-project] Calling method '>' {{(pid=116064) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 12:59:44.512434 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.compute.api [None req-91f51145-01ba-4bbf-b76a-1afbbea1fcb9 tempest-VolumesNegativeTest-1177368279 tempest-VolumesNegativeTest-1177368279-project] [instance: 64bca4a7-c923-443e-a304-580fcbd76c14] Fetching instance by UUID {{(pid=116064) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 12:59:44.518910 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-91f51145-01ba-4bbf-b76a-1afbbea1fcb9 tempest-VolumesNegativeTest-1177368279 tempest-VolumesNegativeTest-1177368279-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 12:59:44.519364 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-91f51145-01ba-4bbf-b76a-1afbbea1fcb9 tempest-VolumesNegativeTest-1177368279 tempest-VolumesNegativeTest-1177368279-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 12:59:44.520145 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-91f51145-01ba-4bbf-b76a-1afbbea1fcb9 tempest-VolumesNegativeTest-1177368279 tempest-VolumesNegativeTest-1177368279-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 12:59:44.520624 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-91f51145-01ba-4bbf-b76a-1afbbea1fcb9 tempest-VolumesNegativeTest-1177368279 tempest-VolumesNegativeTest-1177368279-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 12:59:44.663498 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.policy [None req-91f51145-01ba-4bbf-b76a-1afbbea1fcb9 tempest-VolumesNegativeTest-1177368279 tempest-VolumesNegativeTest-1177368279-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68514732cd1d4c9d8181796d4573303f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fe74d6e6bd748d4a6f320530dffe300', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116064) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 12:59:44.671646 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: INFO nova.api.openstack.requestlog [None req-91f51145-01ba-4bbf-b76a-1afbbea1fcb9 tempest-VolumesNegativeTest-1177368279 tempest-VolumesNegativeTest-1177368279-project] 10.222.0.49 "GET /compute/v2.1/servers/64bca4a7-c923-443e-a304-580fcbd76c14" status: 200 len: 1469 microversion: 2.1 time: 0.163927 Dec 14 12:59:44.672575 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: [pid: 116064|app: 0|req: 168/345] 10.222.0.49 () {58 vars in 1235 bytes} [Tue Dec 14 12:59:44 2021] GET /compute/v2.1/servers/64bca4a7-c923-443e-a304-580fcbd76c14 => generated 1469 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 14 12:59:44.861746 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.api.openstack.wsgi [None req-2eb1099b-d588-4e69-8633-ac1e85118a29 tempest-AttachVolumeNegativeTest-1000400951 tempest-AttachVolumeNegativeTest-1000400951-project] Calling method '>' {{(pid=116064) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 12:59:44.863118 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.compute.api [None req-2eb1099b-d588-4e69-8633-ac1e85118a29 tempest-AttachVolumeNegativeTest-1000400951 tempest-AttachVolumeNegativeTest-1000400951-project] [instance: 8d264701-aaa0-465f-a4aa-0cffa41351ef] Fetching instance by UUID {{(pid=116064) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 12:59:44.872351 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-2eb1099b-d588-4e69-8633-ac1e85118a29 tempest-AttachVolumeNegativeTest-1000400951 tempest-AttachVolumeNegativeTest-1000400951-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 12:59:44.872808 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-2eb1099b-d588-4e69-8633-ac1e85118a29 tempest-AttachVolumeNegativeTest-1000400951 tempest-AttachVolumeNegativeTest-1000400951-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 12:59:44.873632 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-2eb1099b-d588-4e69-8633-ac1e85118a29 tempest-AttachVolumeNegativeTest-1000400951 tempest-AttachVolumeNegativeTest-1000400951-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 12:59:44.874070 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-2eb1099b-d588-4e69-8633-ac1e85118a29 tempest-AttachVolumeNegativeTest-1000400951 tempest-AttachVolumeNegativeTest-1000400951-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 12:59:44.903090 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: INFO nova.api.openstack.requestlog [None req-2eb1099b-d588-4e69-8633-ac1e85118a29 tempest-AttachVolumeNegativeTest-1000400951 tempest-AttachVolumeNegativeTest-1000400951-project] 10.222.0.49 "GET /compute/v2.1/servers/8d264701-aaa0-465f-a4aa-0cffa41351ef/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047873 Dec 14 12:59:44.903636 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: [pid: 116064|app: 0|req: 169/346] 10.222.0.49 () {58 vars in 1301 bytes} [Tue Dec 14 12:59:44 2021] GET /compute/v2.1/servers/8d264701-aaa0-465f-a4aa-0cffa41351ef/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 14 12:59:45.368933 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.api.openstack.wsgi [None req-d30526fb-4ae6-4eb0-bf4b-6c902b2a6a87 tempest-ServerRescueNegativeTestJSON-1573931620 tempest-ServerRescueNegativeTestJSON-1573931620-project] Calling method '>' {{(pid=116064) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 12:59:45.370019 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.compute.api [None req-d30526fb-4ae6-4eb0-bf4b-6c902b2a6a87 tempest-ServerRescueNegativeTestJSON-1573931620 tempest-ServerRescueNegativeTestJSON-1573931620-project] [instance: eb6e04a4-8901-47df-9b51-7c1664bd3f6c] Fetching instance by UUID {{(pid=116064) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 12:59:45.381023 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-d30526fb-4ae6-4eb0-bf4b-6c902b2a6a87 tempest-ServerRescueNegativeTestJSON-1573931620 tempest-ServerRescueNegativeTestJSON-1573931620-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 12:59:45.381817 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-d30526fb-4ae6-4eb0-bf4b-6c902b2a6a87 tempest-ServerRescueNegativeTestJSON-1573931620 tempest-ServerRescueNegativeTestJSON-1573931620-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 12:59:45.383125 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-d30526fb-4ae6-4eb0-bf4b-6c902b2a6a87 tempest-ServerRescueNegativeTestJSON-1573931620 tempest-ServerRescueNegativeTestJSON-1573931620-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 12:59:45.383839 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-d30526fb-4ae6-4eb0-bf4b-6c902b2a6a87 tempest-ServerRescueNegativeTestJSON-1573931620 tempest-ServerRescueNegativeTestJSON-1573931620-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 12:59:45.520593 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.policy [None req-d30526fb-4ae6-4eb0-bf4b-6c902b2a6a87 tempest-ServerRescueNegativeTestJSON-1573931620 tempest-ServerRescueNegativeTestJSON-1573931620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '731cbbfe17214ded8ac66299d66dfc45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '010919ea84eb4eb8b936c63153600eba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116064) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 12:59:45.528401 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: INFO nova.api.openstack.requestlog [None req-d30526fb-4ae6-4eb0-bf4b-6c902b2a6a87 tempest-ServerRescueNegativeTestJSON-1573931620 tempest-ServerRescueNegativeTestJSON-1573931620-project] 10.222.0.49 "GET /compute/v2.1/servers/eb6e04a4-8901-47df-9b51-7c1664bd3f6c" status: 200 len: 1523 microversion: 2.1 time: 0.165882 Dec 14 12:59:45.528988 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: [pid: 116064|app: 0|req: 170/347] 10.222.0.49 () {58 vars in 1235 bytes} [Tue Dec 14 12:59:45 2021] GET /compute/v2.1/servers/eb6e04a4-8901-47df-9b51-7c1664bd3f6c => generated 1523 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 14 12:59:45.692941 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.api.openstack.wsgi [None req-c689df67-5a0b-448b-95d2-e46307350d1c tempest-VolumesNegativeTest-1177368279 tempest-VolumesNegativeTest-1177368279-project] Calling method '>' {{(pid=116064) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 12:59:45.693982 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.compute.api [None req-c689df67-5a0b-448b-95d2-e46307350d1c tempest-VolumesNegativeTest-1177368279 tempest-VolumesNegativeTest-1177368279-project] [instance: 64bca4a7-c923-443e-a304-580fcbd76c14] Fetching instance by UUID {{(pid=116064) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 12:59:45.704385 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-c689df67-5a0b-448b-95d2-e46307350d1c tempest-VolumesNegativeTest-1177368279 tempest-VolumesNegativeTest-1177368279-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 12:59:45.705203 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-c689df67-5a0b-448b-95d2-e46307350d1c tempest-VolumesNegativeTest-1177368279 tempest-VolumesNegativeTest-1177368279-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 12:59:45.706513 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-c689df67-5a0b-448b-95d2-e46307350d1c tempest-VolumesNegativeTest-1177368279 tempest-VolumesNegativeTest-1177368279-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 12:59:45.707234 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-c689df67-5a0b-448b-95d2-e46307350d1c tempest-VolumesNegativeTest-1177368279 tempest-VolumesNegativeTest-1177368279-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 12:59:45.860083 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.policy [None req-c689df67-5a0b-448b-95d2-e46307350d1c tempest-VolumesNegativeTest-1177368279 tempest-VolumesNegativeTest-1177368279-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68514732cd1d4c9d8181796d4573303f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fe74d6e6bd748d4a6f320530dffe300', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116064) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 12:59:45.868018 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: INFO nova.api.openstack.requestlog [None req-c689df67-5a0b-448b-95d2-e46307350d1c tempest-VolumesNegativeTest-1177368279 tempest-VolumesNegativeTest-1177368279-project] 10.222.0.49 "GET /compute/v2.1/servers/64bca4a7-c923-443e-a304-580fcbd76c14" status: 200 len: 1469 microversion: 2.1 time: 0.181138 Dec 14 12:59:45.868597 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: [pid: 116064|app: 0|req: 171/348] 10.222.0.49 () {58 vars in 1235 bytes} [Tue Dec 14 12:59:45 2021] GET /compute/v2.1/servers/64bca4a7-c923-443e-a304-580fcbd76c14 => generated 1469 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 14 12:59:45.914508 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.api.openstack.wsgi [None req-2244b5d5-83b3-4405-bffc-93b8da889db2 tempest-AttachVolumeNegativeTest-1000400951 tempest-AttachVolumeNegativeTest-1000400951-project] Calling method '>' {{(pid=116064) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 12:59:45.915334 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.compute.api [None req-2244b5d5-83b3-4405-bffc-93b8da889db2 tempest-AttachVolumeNegativeTest-1000400951 tempest-AttachVolumeNegativeTest-1000400951-project] [instance: 8d264701-aaa0-465f-a4aa-0cffa41351ef] Fetching instance by UUID {{(pid=116064) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 12:59:45.921360 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-2244b5d5-83b3-4405-bffc-93b8da889db2 tempest-AttachVolumeNegativeTest-1000400951 tempest-AttachVolumeNegativeTest-1000400951-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 12:59:45.921793 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-2244b5d5-83b3-4405-bffc-93b8da889db2 tempest-AttachVolumeNegativeTest-1000400951 tempest-AttachVolumeNegativeTest-1000400951-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 12:59:45.922911 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-2244b5d5-83b3-4405-bffc-93b8da889db2 tempest-AttachVolumeNegativeTest-1000400951 tempest-AttachVolumeNegativeTest-1000400951-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 12:59:45.923339 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-2244b5d5-83b3-4405-bffc-93b8da889db2 tempest-AttachVolumeNegativeTest-1000400951 tempest-AttachVolumeNegativeTest-1000400951-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 12:59:45.952083 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: INFO nova.api.openstack.requestlog [None req-2244b5d5-83b3-4405-bffc-93b8da889db2 tempest-AttachVolumeNegativeTest-1000400951 tempest-AttachVolumeNegativeTest-1000400951-project] 10.222.0.49 "GET /compute/v2.1/servers/8d264701-aaa0-465f-a4aa-0cffa41351ef/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041246 Dec 14 12:59:45.952617 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: [pid: 116064|app: 0|req: 172/349] 10.222.0.49 () {58 vars in 1301 bytes} [Tue Dec 14 12:59:45 2021] GET /compute/v2.1/servers/8d264701-aaa0-465f-a4aa-0cffa41351ef/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Dec 14 12:59:46.258561 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: INFO nova.api.openstack.requestlog [None req-89a05043-3f49-4e3e-8839-e8e85f7411ea tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] 10.222.0.49 "POST /compute/v2.1/servers/c8de7730-62f2-4a77-b1e9-cf6a74fa366d/action" status: 200 len: 31496 microversion: 2.20 time: 3.116064 Dec 14 12:59:46.259539 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: [pid: 116063|app: 0|req: 178/350] 10.222.0.49 () {62 vars in 1318 bytes} [Tue Dec 14 12:59:43 2021] POST /compute/v2.1/servers/c8de7730-62f2-4a77-b1e9-cf6a74fa366d/action => generated 31496 bytes in 3130 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 14 12:59:46.544725 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.api.openstack.wsgi [None req-6c0d21dd-dd31-462b-b12c-d193a32e3243 tempest-ServerRescueNegativeTestJSON-1573931620 tempest-ServerRescueNegativeTestJSON-1573931620-project] Calling method '>' {{(pid=116064) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 12:59:46.546055 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.compute.api [None req-6c0d21dd-dd31-462b-b12c-d193a32e3243 tempest-ServerRescueNegativeTestJSON-1573931620 tempest-ServerRescueNegativeTestJSON-1573931620-project] [instance: eb6e04a4-8901-47df-9b51-7c1664bd3f6c] Fetching instance by UUID {{(pid=116064) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 12:59:46.552965 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-6c0d21dd-dd31-462b-b12c-d193a32e3243 tempest-ServerRescueNegativeTestJSON-1573931620 tempest-ServerRescueNegativeTestJSON-1573931620-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 12:59:46.553481 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-6c0d21dd-dd31-462b-b12c-d193a32e3243 tempest-ServerRescueNegativeTestJSON-1573931620 tempest-ServerRescueNegativeTestJSON-1573931620-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 12:59:46.554205 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-6c0d21dd-dd31-462b-b12c-d193a32e3243 tempest-ServerRescueNegativeTestJSON-1573931620 tempest-ServerRescueNegativeTestJSON-1573931620-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 12:59:46.554804 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-6c0d21dd-dd31-462b-b12c-d193a32e3243 tempest-ServerRescueNegativeTestJSON-1573931620 tempest-ServerRescueNegativeTestJSON-1573931620-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 12:59:46.700552 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.policy [None req-6c0d21dd-dd31-462b-b12c-d193a32e3243 tempest-ServerRescueNegativeTestJSON-1573931620 tempest-ServerRescueNegativeTestJSON-1573931620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '731cbbfe17214ded8ac66299d66dfc45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '010919ea84eb4eb8b936c63153600eba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116064) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 12:59:46.708371 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: INFO nova.api.openstack.requestlog [None req-6c0d21dd-dd31-462b-b12c-d193a32e3243 tempest-ServerRescueNegativeTestJSON-1573931620 tempest-ServerRescueNegativeTestJSON-1573931620-project] 10.222.0.49 "GET /compute/v2.1/servers/eb6e04a4-8901-47df-9b51-7c1664bd3f6c" status: 200 len: 1523 microversion: 2.1 time: 0.167560 Dec 14 12:59:46.708966 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: [pid: 116064|app: 0|req: 173/351] 10.222.0.49 () {58 vars in 1235 bytes} [Tue Dec 14 12:59:46 2021] GET /compute/v2.1/servers/eb6e04a4-8901-47df-9b51-7c1664bd3f6c => generated 1523 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 14 12:59:46.886034 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.api.openstack.wsgi [None req-c2a090a1-c12a-4382-845d-2f3d0dd486cc tempest-VolumesNegativeTest-1177368279 tempest-VolumesNegativeTest-1177368279-project] Calling method '>' {{(pid=116063) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 12:59:46.887104 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.compute.api [None req-c2a090a1-c12a-4382-845d-2f3d0dd486cc tempest-VolumesNegativeTest-1177368279 tempest-VolumesNegativeTest-1177368279-project] [instance: 64bca4a7-c923-443e-a304-580fcbd76c14] Fetching instance by UUID {{(pid=116063) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 12:59:46.894566 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-c2a090a1-c12a-4382-845d-2f3d0dd486cc tempest-VolumesNegativeTest-1177368279 tempest-VolumesNegativeTest-1177368279-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 12:59:46.895021 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-c2a090a1-c12a-4382-845d-2f3d0dd486cc tempest-VolumesNegativeTest-1177368279 tempest-VolumesNegativeTest-1177368279-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 12:59:46.895800 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-c2a090a1-c12a-4382-845d-2f3d0dd486cc tempest-VolumesNegativeTest-1177368279 tempest-VolumesNegativeTest-1177368279-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 12:59:46.896257 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-c2a090a1-c12a-4382-845d-2f3d0dd486cc tempest-VolumesNegativeTest-1177368279 tempest-VolumesNegativeTest-1177368279-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 12:59:46.966360 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.api.openstack.wsgi [None req-baa330b9-375e-4480-a59c-828855c8c680 tempest-AttachVolumeNegativeTest-1000400951 tempest-AttachVolumeNegativeTest-1000400951-project] Calling method '>' {{(pid=116064) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 12:59:46.967298 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.compute.api [None req-baa330b9-375e-4480-a59c-828855c8c680 tempest-AttachVolumeNegativeTest-1000400951 tempest-AttachVolumeNegativeTest-1000400951-project] [instance: 8d264701-aaa0-465f-a4aa-0cffa41351ef] Fetching instance by UUID {{(pid=116064) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 12:59:46.973686 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-baa330b9-375e-4480-a59c-828855c8c680 tempest-AttachVolumeNegativeTest-1000400951 tempest-AttachVolumeNegativeTest-1000400951-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 12:59:46.974386 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-baa330b9-375e-4480-a59c-828855c8c680 tempest-AttachVolumeNegativeTest-1000400951 tempest-AttachVolumeNegativeTest-1000400951-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 12:59:46.975350 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-baa330b9-375e-4480-a59c-828855c8c680 tempest-AttachVolumeNegativeTest-1000400951 tempest-AttachVolumeNegativeTest-1000400951-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 12:59:46.975945 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-baa330b9-375e-4480-a59c-828855c8c680 tempest-AttachVolumeNegativeTest-1000400951 tempest-AttachVolumeNegativeTest-1000400951-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 12:59:47.020322 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: INFO nova.api.openstack.requestlog [None req-baa330b9-375e-4480-a59c-828855c8c680 tempest-AttachVolumeNegativeTest-1000400951 tempest-AttachVolumeNegativeTest-1000400951-project] 10.222.0.49 "GET /compute/v2.1/servers/8d264701-aaa0-465f-a4aa-0cffa41351ef/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.058233 Dec 14 12:59:47.020948 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: [pid: 116064|app: 0|req: 174/352] 10.222.0.49 () {58 vars in 1301 bytes} [Tue Dec 14 12:59:46 2021] GET /compute/v2.1/servers/8d264701-aaa0-465f-a4aa-0cffa41351ef/os-volume_attachments => generated 197 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 14 12:59:47.067066 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.policy [None req-c2a090a1-c12a-4382-845d-2f3d0dd486cc tempest-VolumesNegativeTest-1177368279 tempest-VolumesNegativeTest-1177368279-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68514732cd1d4c9d8181796d4573303f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fe74d6e6bd748d4a6f320530dffe300', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116063) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 12:59:47.075021 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: INFO nova.api.openstack.requestlog [None req-c2a090a1-c12a-4382-845d-2f3d0dd486cc tempest-VolumesNegativeTest-1177368279 tempest-VolumesNegativeTest-1177368279-project] 10.222.0.49 "GET /compute/v2.1/servers/64bca4a7-c923-443e-a304-580fcbd76c14" status: 200 len: 1469 microversion: 2.1 time: 0.193124 Dec 14 12:59:47.086183 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: [pid: 116063|app: 0|req: 179/353] 10.222.0.49 () {58 vars in 1235 bytes} [Tue Dec 14 12:59:46 2021] GET /compute/v2.1/servers/64bca4a7-c923-443e-a304-580fcbd76c14 => generated 1469 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 14 12:59:47.271855 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.api.openstack.wsgi [None req-5c853187-8f62-4914-9101-35af3e2a69fe tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116064) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 14 12:59:47.272926 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.compute.api [None req-5c853187-8f62-4914-9101-35af3e2a69fe tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] [instance: c8de7730-62f2-4a77-b1e9-cf6a74fa366d] Fetching instance by UUID {{(pid=116064) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 12:59:47.279587 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-5c853187-8f62-4914-9101-35af3e2a69fe tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 12:59:47.280140 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-5c853187-8f62-4914-9101-35af3e2a69fe tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 12:59:47.280999 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-5c853187-8f62-4914-9101-35af3e2a69fe tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 12:59:47.281438 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-5c853187-8f62-4914-9101-35af3e2a69fe tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 12:59:47.405122 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: INFO nova.api.openstack.requestlog [None req-5c853187-8f62-4914-9101-35af3e2a69fe tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] 10.222.0.49 "POST /compute/v2.1/servers/c8de7730-62f2-4a77-b1e9-cf6a74fa366d/action" status: 200 len: 32031 microversion: 2.20 time: 0.137144 Dec 14 12:59:47.405722 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: [pid: 116064|app: 0|req: 175/354] 10.222.0.49 () {62 vars in 1318 bytes} [Tue Dec 14 12:59:47 2021] POST /compute/v2.1/servers/c8de7730-62f2-4a77-b1e9-cf6a74fa366d/action => generated 32031 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Dec 14 12:59:47.725751 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.api.openstack.wsgi [None req-4fd276b9-7a0e-476d-86eb-c68d7f6a8d89 tempest-ServerRescueNegativeTestJSON-1573931620 tempest-ServerRescueNegativeTestJSON-1573931620-project] Calling method '>' {{(pid=116063) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 12:59:47.726346 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.compute.api [None req-4fd276b9-7a0e-476d-86eb-c68d7f6a8d89 tempest-ServerRescueNegativeTestJSON-1573931620 tempest-ServerRescueNegativeTestJSON-1573931620-project] [instance: eb6e04a4-8901-47df-9b51-7c1664bd3f6c] Fetching instance by UUID {{(pid=116063) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 12:59:47.733257 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-4fd276b9-7a0e-476d-86eb-c68d7f6a8d89 tempest-ServerRescueNegativeTestJSON-1573931620 tempest-ServerRescueNegativeTestJSON-1573931620-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 12:59:47.733960 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-4fd276b9-7a0e-476d-86eb-c68d7f6a8d89 tempest-ServerRescueNegativeTestJSON-1573931620 tempest-ServerRescueNegativeTestJSON-1573931620-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 12:59:47.735000 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-4fd276b9-7a0e-476d-86eb-c68d7f6a8d89 tempest-ServerRescueNegativeTestJSON-1573931620 tempest-ServerRescueNegativeTestJSON-1573931620-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 12:59:47.735685 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-4fd276b9-7a0e-476d-86eb-c68d7f6a8d89 tempest-ServerRescueNegativeTestJSON-1573931620 tempest-ServerRescueNegativeTestJSON-1573931620-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 12:59:47.902395 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.policy [None req-4fd276b9-7a0e-476d-86eb-c68d7f6a8d89 tempest-ServerRescueNegativeTestJSON-1573931620 tempest-ServerRescueNegativeTestJSON-1573931620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '731cbbfe17214ded8ac66299d66dfc45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '010919ea84eb4eb8b936c63153600eba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116063) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 12:59:47.910389 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: INFO nova.api.openstack.requestlog [None req-4fd276b9-7a0e-476d-86eb-c68d7f6a8d89 tempest-ServerRescueNegativeTestJSON-1573931620 tempest-ServerRescueNegativeTestJSON-1573931620-project] 10.222.0.49 "GET /compute/v2.1/servers/eb6e04a4-8901-47df-9b51-7c1664bd3f6c" status: 200 len: 1523 microversion: 2.1 time: 0.188313 Dec 14 12:59:47.911115 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: [pid: 116063|app: 0|req: 180/355] 10.222.0.49 () {58 vars in 1235 bytes} [Tue Dec 14 12:59:47 2021] GET /compute/v2.1/servers/eb6e04a4-8901-47df-9b51-7c1664bd3f6c => generated 1523 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 14 12:59:48.032422 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.api.openstack.wsgi [None req-956e935b-e92c-4745-b76c-ec927a36580a tempest-AttachVolumeNegativeTest-1000400951 tempest-AttachVolumeNegativeTest-1000400951-project] Calling method '>' {{(pid=116064) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 12:59:48.033565 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.compute.api [None req-956e935b-e92c-4745-b76c-ec927a36580a tempest-AttachVolumeNegativeTest-1000400951 tempest-AttachVolumeNegativeTest-1000400951-project] [instance: 8d264701-aaa0-465f-a4aa-0cffa41351ef] Fetching instance by UUID {{(pid=116064) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 12:59:48.041143 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-956e935b-e92c-4745-b76c-ec927a36580a tempest-AttachVolumeNegativeTest-1000400951 tempest-AttachVolumeNegativeTest-1000400951-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 12:59:48.041607 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-956e935b-e92c-4745-b76c-ec927a36580a tempest-AttachVolumeNegativeTest-1000400951 tempest-AttachVolumeNegativeTest-1000400951-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 12:59:48.042376 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-956e935b-e92c-4745-b76c-ec927a36580a tempest-AttachVolumeNegativeTest-1000400951 tempest-AttachVolumeNegativeTest-1000400951-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 12:59:48.042811 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-956e935b-e92c-4745-b76c-ec927a36580a tempest-AttachVolumeNegativeTest-1000400951 tempest-AttachVolumeNegativeTest-1000400951-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 12:59:48.072011 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: INFO nova.api.openstack.requestlog [None req-956e935b-e92c-4745-b76c-ec927a36580a tempest-AttachVolumeNegativeTest-1000400951 tempest-AttachVolumeNegativeTest-1000400951-project] 10.222.0.49 "GET /compute/v2.1/servers/8d264701-aaa0-465f-a4aa-0cffa41351ef/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.043794 Dec 14 12:59:48.072563 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: [pid: 116064|app: 0|req: 176/356] 10.222.0.49 () {58 vars in 1301 bytes} [Tue Dec 14 12:59:48 2021] GET /compute/v2.1/servers/8d264701-aaa0-465f-a4aa-0cffa41351ef/os-volume_attachments => generated 25 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Dec 14 12:59:48.091250 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.api.openstack.wsgi [None req-9d67b0a8-6f03-43c1-8b85-1a0a99196a7c tempest-VolumesNegativeTest-1177368279 tempest-VolumesNegativeTest-1177368279-project] Calling method '>' {{(pid=116063) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 12:59:48.092400 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.compute.api [None req-9d67b0a8-6f03-43c1-8b85-1a0a99196a7c tempest-VolumesNegativeTest-1177368279 tempest-VolumesNegativeTest-1177368279-project] [instance: 64bca4a7-c923-443e-a304-580fcbd76c14] Fetching instance by UUID {{(pid=116063) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 12:59:48.099103 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-9d67b0a8-6f03-43c1-8b85-1a0a99196a7c tempest-VolumesNegativeTest-1177368279 tempest-VolumesNegativeTest-1177368279-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 12:59:48.099642 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-9d67b0a8-6f03-43c1-8b85-1a0a99196a7c tempest-VolumesNegativeTest-1177368279 tempest-VolumesNegativeTest-1177368279-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 12:59:48.100429 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-9d67b0a8-6f03-43c1-8b85-1a0a99196a7c tempest-VolumesNegativeTest-1177368279 tempest-VolumesNegativeTest-1177368279-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 12:59:48.100881 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-9d67b0a8-6f03-43c1-8b85-1a0a99196a7c tempest-VolumesNegativeTest-1177368279 tempest-VolumesNegativeTest-1177368279-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 12:59:48.247529 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.api.openstack.wsgi [None req-5392c649-fb1b-4a70-820e-6bd3de854947 tempest-AttachVolumeNegativeTest-1000400951 tempest-AttachVolumeNegativeTest-1000400951-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1763930545", "imageRef": "1733dcd4-5ded-44e1-8b8d-392adb05c67a", "flavorRef": "452", "networks": [{"uuid": "f9d231ae-628f-4043-969c-cf414631d868"}]}} {{(pid=116064) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 14 12:59:48.261222 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.policy [None req-9d67b0a8-6f03-43c1-8b85-1a0a99196a7c tempest-VolumesNegativeTest-1177368279 tempest-VolumesNegativeTest-1177368279-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68514732cd1d4c9d8181796d4573303f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fe74d6e6bd748d4a6f320530dffe300', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116063) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 12:59:48.269799 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: INFO nova.api.openstack.requestlog [None req-9d67b0a8-6f03-43c1-8b85-1a0a99196a7c tempest-VolumesNegativeTest-1177368279 tempest-VolumesNegativeTest-1177368279-project] 10.222.0.49 "GET /compute/v2.1/servers/64bca4a7-c923-443e-a304-580fcbd76c14" status: 200 len: 1469 microversion: 2.1 time: 0.182227 Dec 14 12:59:48.272894 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: [pid: 116063|app: 0|req: 181/357] 10.222.0.49 () {58 vars in 1235 bytes} [Tue Dec 14 12:59:48 2021] GET /compute/v2.1/servers/64bca4a7-c923-443e-a304-580fcbd76c14 => generated 1469 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 14 12:59:48.416866 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.api.openstack.wsgi [None req-793172cb-3d3a-4fb8-8c12-a545cb5ca1ce tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116063) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 14 12:59:48.417919 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.compute.api [None req-793172cb-3d3a-4fb8-8c12-a545cb5ca1ce tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] [instance: c8de7730-62f2-4a77-b1e9-cf6a74fa366d] Fetching instance by UUID {{(pid=116063) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 12:59:48.424316 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-793172cb-3d3a-4fb8-8c12-a545cb5ca1ce tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 12:59:48.424756 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-793172cb-3d3a-4fb8-8c12-a545cb5ca1ce tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 12:59:48.425587 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-793172cb-3d3a-4fb8-8c12-a545cb5ca1ce tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 12:59:48.425986 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-793172cb-3d3a-4fb8-8c12-a545cb5ca1ce tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 12:59:51.670966 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: INFO nova.api.openstack.requestlog [None req-793172cb-3d3a-4fb8-8c12-a545cb5ca1ce tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] 10.222.0.49 "POST /compute/v2.1/servers/c8de7730-62f2-4a77-b1e9-cf6a74fa366d/action" status: 200 len: 33338 microversion: 2.20 time: 3.257724 Dec 14 12:59:51.673387 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: [pid: 116063|app: 0|req: 182/358] 10.222.0.49 () {62 vars in 1318 bytes} [Tue Dec 14 12:59:48 2021] POST /compute/v2.1/servers/c8de7730-62f2-4a77-b1e9-cf6a74fa366d/action => generated 33338 bytes in 3261 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Dec 14 12:59:51.679186 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.api.openstack.wsgi [None req-216cfc6b-77bb-458b-ad31-e83f470057a2 tempest-ServerRescueNegativeTestJSON-1573931620 tempest-ServerRescueNegativeTestJSON-1573931620-project] Calling method '>' {{(pid=116063) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 12:59:51.680255 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.compute.api [None req-216cfc6b-77bb-458b-ad31-e83f470057a2 tempest-ServerRescueNegativeTestJSON-1573931620 tempest-ServerRescueNegativeTestJSON-1573931620-project] [instance: eb6e04a4-8901-47df-9b51-7c1664bd3f6c] Fetching instance by UUID {{(pid=116063) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 12:59:51.688220 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-216cfc6b-77bb-458b-ad31-e83f470057a2 tempest-ServerRescueNegativeTestJSON-1573931620 tempest-ServerRescueNegativeTestJSON-1573931620-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 12:59:51.688791 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-216cfc6b-77bb-458b-ad31-e83f470057a2 tempest-ServerRescueNegativeTestJSON-1573931620 tempest-ServerRescueNegativeTestJSON-1573931620-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 12:59:51.689912 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-216cfc6b-77bb-458b-ad31-e83f470057a2 tempest-ServerRescueNegativeTestJSON-1573931620 tempest-ServerRescueNegativeTestJSON-1573931620-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 12:59:51.690354 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-216cfc6b-77bb-458b-ad31-e83f470057a2 tempest-ServerRescueNegativeTestJSON-1573931620 tempest-ServerRescueNegativeTestJSON-1573931620-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 12:59:51.834608 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.policy [None req-216cfc6b-77bb-458b-ad31-e83f470057a2 tempest-ServerRescueNegativeTestJSON-1573931620 tempest-ServerRescueNegativeTestJSON-1573931620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '731cbbfe17214ded8ac66299d66dfc45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '010919ea84eb4eb8b936c63153600eba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116063) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 12:59:51.842563 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: INFO nova.api.openstack.requestlog [None req-216cfc6b-77bb-458b-ad31-e83f470057a2 tempest-ServerRescueNegativeTestJSON-1573931620 tempest-ServerRescueNegativeTestJSON-1573931620-project] 10.222.0.49 "GET /compute/v2.1/servers/eb6e04a4-8901-47df-9b51-7c1664bd3f6c" status: 200 len: 1523 microversion: 2.1 time: 0.167569 Dec 14 12:59:51.843122 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: [pid: 116063|app: 0|req: 183/359] 10.222.0.49 () {58 vars in 1235 bytes} [Tue Dec 14 12:59:51 2021] GET /compute/v2.1/servers/eb6e04a4-8901-47df-9b51-7c1664bd3f6c => generated 1523 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 14 12:59:51.862536 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.api.openstack.wsgi [None req-75f98422-38b6-40cf-9ce3-c98ead840ce3 tempest-VolumesNegativeTest-1177368279 tempest-VolumesNegativeTest-1177368279-project] Calling method '>' {{(pid=116063) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 12:59:51.863239 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.compute.api [None req-75f98422-38b6-40cf-9ce3-c98ead840ce3 tempest-VolumesNegativeTest-1177368279 tempest-VolumesNegativeTest-1177368279-project] [instance: 64bca4a7-c923-443e-a304-580fcbd76c14] Fetching instance by UUID {{(pid=116063) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 12:59:51.870065 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-75f98422-38b6-40cf-9ce3-c98ead840ce3 tempest-VolumesNegativeTest-1177368279 tempest-VolumesNegativeTest-1177368279-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 12:59:51.870590 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-75f98422-38b6-40cf-9ce3-c98ead840ce3 tempest-VolumesNegativeTest-1177368279 tempest-VolumesNegativeTest-1177368279-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 12:59:51.871510 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-75f98422-38b6-40cf-9ce3-c98ead840ce3 tempest-VolumesNegativeTest-1177368279 tempest-VolumesNegativeTest-1177368279-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 12:59:51.871930 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-75f98422-38b6-40cf-9ce3-c98ead840ce3 tempest-VolumesNegativeTest-1177368279 tempest-VolumesNegativeTest-1177368279-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 12:59:52.021134 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.policy [None req-75f98422-38b6-40cf-9ce3-c98ead840ce3 tempest-VolumesNegativeTest-1177368279 tempest-VolumesNegativeTest-1177368279-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68514732cd1d4c9d8181796d4573303f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fe74d6e6bd748d4a6f320530dffe300', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116063) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 12:59:52.028961 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: INFO nova.api.openstack.requestlog [None req-75f98422-38b6-40cf-9ce3-c98ead840ce3 tempest-VolumesNegativeTest-1177368279 tempest-VolumesNegativeTest-1177368279-project] 10.222.0.49 "GET /compute/v2.1/servers/64bca4a7-c923-443e-a304-580fcbd76c14" status: 200 len: 1469 microversion: 2.1 time: 0.184366 Dec 14 12:59:52.029541 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: [pid: 116063|app: 0|req: 184/360] 10.222.0.49 () {58 vars in 1235 bytes} [Tue Dec 14 12:59:51 2021] GET /compute/v2.1/servers/64bca4a7-c923-443e-a304-580fcbd76c14 => generated 1469 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 14 12:59:52.686585 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.api.openstack.wsgi [None req-2e3581d7-2302-4fb9-aec2-0fbb48159bf3 tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116063) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 14 12:59:52.688060 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.compute.api [None req-2e3581d7-2302-4fb9-aec2-0fbb48159bf3 tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] [instance: c8de7730-62f2-4a77-b1e9-cf6a74fa366d] Fetching instance by UUID {{(pid=116063) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 12:59:52.698771 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-2e3581d7-2302-4fb9-aec2-0fbb48159bf3 tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 12:59:52.699512 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-2e3581d7-2302-4fb9-aec2-0fbb48159bf3 tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 12:59:52.700783 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-2e3581d7-2302-4fb9-aec2-0fbb48159bf3 tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 12:59:52.701573 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-2e3581d7-2302-4fb9-aec2-0fbb48159bf3 tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 12:59:56.020082 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: INFO nova.api.openstack.requestlog [None req-2e3581d7-2302-4fb9-aec2-0fbb48159bf3 tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] 10.222.0.49 "POST /compute/v2.1/servers/c8de7730-62f2-4a77-b1e9-cf6a74fa366d/action" status: 200 len: 35506 microversion: 2.20 time: 3.339583 Dec 14 12:59:56.022306 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: [pid: 116063|app: 0|req: 185/361] 10.222.0.49 () {62 vars in 1318 bytes} [Tue Dec 14 12:59:52 2021] POST /compute/v2.1/servers/c8de7730-62f2-4a77-b1e9-cf6a74fa366d/action => generated 35506 bytes in 3343 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 14 12:59:56.028210 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.api.openstack.wsgi [None req-4dd221f5-1e9f-4139-b103-5aa9ab689fc2 tempest-ServerRescueNegativeTestJSON-1573931620 tempest-ServerRescueNegativeTestJSON-1573931620-project] Calling method '>' {{(pid=116063) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 12:59:56.029376 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.compute.api [None req-4dd221f5-1e9f-4139-b103-5aa9ab689fc2 tempest-ServerRescueNegativeTestJSON-1573931620 tempest-ServerRescueNegativeTestJSON-1573931620-project] [instance: eb6e04a4-8901-47df-9b51-7c1664bd3f6c] Fetching instance by UUID {{(pid=116063) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 12:59:56.038572 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-4dd221f5-1e9f-4139-b103-5aa9ab689fc2 tempest-ServerRescueNegativeTestJSON-1573931620 tempest-ServerRescueNegativeTestJSON-1573931620-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 12:59:56.039282 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-4dd221f5-1e9f-4139-b103-5aa9ab689fc2 tempest-ServerRescueNegativeTestJSON-1573931620 tempest-ServerRescueNegativeTestJSON-1573931620-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 12:59:56.040290 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-4dd221f5-1e9f-4139-b103-5aa9ab689fc2 tempest-ServerRescueNegativeTestJSON-1573931620 tempest-ServerRescueNegativeTestJSON-1573931620-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 12:59:56.040925 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-4dd221f5-1e9f-4139-b103-5aa9ab689fc2 tempest-ServerRescueNegativeTestJSON-1573931620 tempest-ServerRescueNegativeTestJSON-1573931620-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 12:59:56.193389 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.policy [None req-4dd221f5-1e9f-4139-b103-5aa9ab689fc2 tempest-ServerRescueNegativeTestJSON-1573931620 tempest-ServerRescueNegativeTestJSON-1573931620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '731cbbfe17214ded8ac66299d66dfc45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '010919ea84eb4eb8b936c63153600eba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116063) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 12:59:56.203340 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: INFO nova.api.openstack.requestlog [None req-4dd221f5-1e9f-4139-b103-5aa9ab689fc2 tempest-ServerRescueNegativeTestJSON-1573931620 tempest-ServerRescueNegativeTestJSON-1573931620-project] 10.222.0.49 "GET /compute/v2.1/servers/eb6e04a4-8901-47df-9b51-7c1664bd3f6c" status: 200 len: 1523 microversion: 2.1 time: 0.179510 Dec 14 12:59:56.213204 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: [pid: 116063|app: 0|req: 186/362] 10.222.0.49 () {58 vars in 1235 bytes} [Tue Dec 14 12:59:56 2021] GET /compute/v2.1/servers/eb6e04a4-8901-47df-9b51-7c1664bd3f6c => generated 1523 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 14 12:59:56.218408 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.api.openstack.wsgi [None req-12d835ca-fede-4617-bc99-d15642fc0e0c tempest-VolumesNegativeTest-1177368279 tempest-VolumesNegativeTest-1177368279-project] Calling method '>' {{(pid=116063) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 12:59:56.219344 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.compute.api [None req-12d835ca-fede-4617-bc99-d15642fc0e0c tempest-VolumesNegativeTest-1177368279 tempest-VolumesNegativeTest-1177368279-project] [instance: 64bca4a7-c923-443e-a304-580fcbd76c14] Fetching instance by UUID {{(pid=116063) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 12:59:56.229748 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-12d835ca-fede-4617-bc99-d15642fc0e0c tempest-VolumesNegativeTest-1177368279 tempest-VolumesNegativeTest-1177368279-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 12:59:56.230495 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-12d835ca-fede-4617-bc99-d15642fc0e0c tempest-VolumesNegativeTest-1177368279 tempest-VolumesNegativeTest-1177368279-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 12:59:56.231437 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-12d835ca-fede-4617-bc99-d15642fc0e0c tempest-VolumesNegativeTest-1177368279 tempest-VolumesNegativeTest-1177368279-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 12:59:56.232043 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-12d835ca-fede-4617-bc99-d15642fc0e0c tempest-VolumesNegativeTest-1177368279 tempest-VolumesNegativeTest-1177368279-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 12:59:56.384093 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.policy [None req-12d835ca-fede-4617-bc99-d15642fc0e0c tempest-VolumesNegativeTest-1177368279 tempest-VolumesNegativeTest-1177368279-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68514732cd1d4c9d8181796d4573303f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fe74d6e6bd748d4a6f320530dffe300', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116063) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 12:59:56.396049 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: INFO nova.api.openstack.requestlog [None req-12d835ca-fede-4617-bc99-d15642fc0e0c tempest-VolumesNegativeTest-1177368279 tempest-VolumesNegativeTest-1177368279-project] 10.222.0.49 "GET /compute/v2.1/servers/64bca4a7-c923-443e-a304-580fcbd76c14" status: 200 len: 1469 microversion: 2.1 time: 0.181320 Dec 14 12:59:56.396809 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: [pid: 116063|app: 0|req: 187/363] 10.222.0.49 () {58 vars in 1235 bytes} [Tue Dec 14 12:59:56 2021] GET /compute/v2.1/servers/64bca4a7-c923-443e-a304-580fcbd76c14 => generated 1469 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 14 12:59:56.726520 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.api.openstack.wsgi [req-7d60004b-f748-48b6-ad7f-885932332d12 req-7d6adf46-7cc6-4ac6-9fa4-e5a40e1349e0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "64bca4a7-c923-443e-a304-580fcbd76c14", "name": "network-vif-deleted", "tag": "f3c25b41-d22f-41fb-921e-52e0ff1be2a4"}]} {{(pid=116063) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 14 12:59:56.729782 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 14 12:59:56.729782 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: warnings.warn(msg) Dec 14 12:59:56.737299 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [req-7d60004b-f748-48b6-ad7f-885932332d12 req-7d6adf46-7cc6-4ac6-9fa4-e5a40e1349e0 service nova] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 12:59:56.737974 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [req-7d60004b-f748-48b6-ad7f-885932332d12 req-7d6adf46-7cc6-4ac6-9fa4-e5a40e1349e0 service nova] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 12:59:56.750508 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: INFO nova.api.openstack.compute.server_external_events [req-7d60004b-f748-48b6-ad7f-885932332d12 req-7d6adf46-7cc6-4ac6-9fa4-e5a40e1349e0 service nova] Creating event network-vif-deleted:f3c25b41-d22f-41fb-921e-52e0ff1be2a4 for instance 64bca4a7-c923-443e-a304-580fcbd76c14 on hv-cinder-78447 Dec 14 12:59:56.755801 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: INFO nova.api.openstack.requestlog [req-7d60004b-f748-48b6-ad7f-885932332d12 req-7d6adf46-7cc6-4ac6-9fa4-e5a40e1349e0 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035061 Dec 14 12:59:56.756404 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: [pid: 116063|app: 0|req: 188/364] 10.222.0.49 () {64 vars in 1317 bytes} [Tue Dec 14 12:59:56 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Dec 14 12:59:57.034006 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.api.openstack.wsgi [None req-c0ac755f-2eb2-4109-8d3f-652cb5d8cbee tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116063) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 14 12:59:57.035001 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.compute.api [None req-c0ac755f-2eb2-4109-8d3f-652cb5d8cbee tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] [instance: c8de7730-62f2-4a77-b1e9-cf6a74fa366d] Fetching instance by UUID {{(pid=116063) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 12:59:57.041444 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-c0ac755f-2eb2-4109-8d3f-652cb5d8cbee tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 12:59:57.042129 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-c0ac755f-2eb2-4109-8d3f-652cb5d8cbee tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 12:59:57.043151 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-c0ac755f-2eb2-4109-8d3f-652cb5d8cbee tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 12:59:57.043500 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-c0ac755f-2eb2-4109-8d3f-652cb5d8cbee tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 12:59:57.150479 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: INFO nova.api.openstack.requestlog [None req-c0ac755f-2eb2-4109-8d3f-652cb5d8cbee tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] 10.222.0.49 "POST /compute/v2.1/servers/c8de7730-62f2-4a77-b1e9-cf6a74fa366d/action" status: 200 len: 35865 microversion: 2.20 time: 0.120444 Dec 14 12:59:57.151152 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: [pid: 116063|app: 0|req: 189/365] 10.222.0.49 () {62 vars in 1318 bytes} [Tue Dec 14 12:59:57 2021] POST /compute/v2.1/servers/c8de7730-62f2-4a77-b1e9-cf6a74fa366d/action => generated 35865 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 14 12:59:57.221193 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.api.openstack.wsgi [None req-e5308ee5-3cd3-4d15-84d9-f41706f55851 tempest-ServerRescueNegativeTestJSON-1573931620 tempest-ServerRescueNegativeTestJSON-1573931620-project] Calling method '>' {{(pid=116063) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 12:59:57.221892 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.compute.api [None req-e5308ee5-3cd3-4d15-84d9-f41706f55851 tempest-ServerRescueNegativeTestJSON-1573931620 tempest-ServerRescueNegativeTestJSON-1573931620-project] [instance: eb6e04a4-8901-47df-9b51-7c1664bd3f6c] Fetching instance by UUID {{(pid=116063) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 12:59:57.229102 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-e5308ee5-3cd3-4d15-84d9-f41706f55851 tempest-ServerRescueNegativeTestJSON-1573931620 tempest-ServerRescueNegativeTestJSON-1573931620-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 12:59:57.229687 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-e5308ee5-3cd3-4d15-84d9-f41706f55851 tempest-ServerRescueNegativeTestJSON-1573931620 tempest-ServerRescueNegativeTestJSON-1573931620-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 12:59:57.230534 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-e5308ee5-3cd3-4d15-84d9-f41706f55851 tempest-ServerRescueNegativeTestJSON-1573931620 tempest-ServerRescueNegativeTestJSON-1573931620-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 12:59:57.230937 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-e5308ee5-3cd3-4d15-84d9-f41706f55851 tempest-ServerRescueNegativeTestJSON-1573931620 tempest-ServerRescueNegativeTestJSON-1573931620-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 12:59:57.389360 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.policy [None req-e5308ee5-3cd3-4d15-84d9-f41706f55851 tempest-ServerRescueNegativeTestJSON-1573931620 tempest-ServerRescueNegativeTestJSON-1573931620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '731cbbfe17214ded8ac66299d66dfc45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '010919ea84eb4eb8b936c63153600eba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116063) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 12:59:57.397884 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: INFO nova.api.openstack.requestlog [None req-e5308ee5-3cd3-4d15-84d9-f41706f55851 tempest-ServerRescueNegativeTestJSON-1573931620 tempest-ServerRescueNegativeTestJSON-1573931620-project] 10.222.0.49 "GET /compute/v2.1/servers/eb6e04a4-8901-47df-9b51-7c1664bd3f6c" status: 200 len: 1523 microversion: 2.1 time: 0.180906 Dec 14 12:59:57.398721 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: [pid: 116063|app: 0|req: 190/366] 10.222.0.49 () {58 vars in 1235 bytes} [Tue Dec 14 12:59:57 2021] GET /compute/v2.1/servers/eb6e04a4-8901-47df-9b51-7c1664bd3f6c => generated 1523 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 14 12:59:57.414658 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.api.openstack.wsgi [None req-31a3d98c-1be2-43e8-918d-e59868d8f58a tempest-VolumesNegativeTest-1177368279 tempest-VolumesNegativeTest-1177368279-project] Calling method '>' {{(pid=116063) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 12:59:57.415527 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.compute.api [None req-31a3d98c-1be2-43e8-918d-e59868d8f58a tempest-VolumesNegativeTest-1177368279 tempest-VolumesNegativeTest-1177368279-project] [instance: 64bca4a7-c923-443e-a304-580fcbd76c14] Fetching instance by UUID {{(pid=116063) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 12:59:57.422495 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-31a3d98c-1be2-43e8-918d-e59868d8f58a tempest-VolumesNegativeTest-1177368279 tempest-VolumesNegativeTest-1177368279-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 12:59:57.423172 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-31a3d98c-1be2-43e8-918d-e59868d8f58a tempest-VolumesNegativeTest-1177368279 tempest-VolumesNegativeTest-1177368279-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 12:59:57.423963 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-31a3d98c-1be2-43e8-918d-e59868d8f58a tempest-VolumesNegativeTest-1177368279 tempest-VolumesNegativeTest-1177368279-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 12:59:57.424394 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-31a3d98c-1be2-43e8-918d-e59868d8f58a tempest-VolumesNegativeTest-1177368279 tempest-VolumesNegativeTest-1177368279-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 12:59:57.461752 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-31a3d98c-1be2-43e8-918d-e59868d8f58a tempest-VolumesNegativeTest-1177368279 tempest-VolumesNegativeTest-1177368279-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 12:59:57.462639 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-31a3d98c-1be2-43e8-918d-e59868d8f58a tempest-VolumesNegativeTest-1177368279 tempest-VolumesNegativeTest-1177368279-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 12:59:57.463356 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.objects.instance [None req-31a3d98c-1be2-43e8-918d-e59868d8f58a tempest-VolumesNegativeTest-1177368279 tempest-VolumesNegativeTest-1177368279-project] Lazy-loading 'fault' on Instance uuid 64bca4a7-c923-443e-a304-580fcbd76c14 {{(pid=116063) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Dec 14 12:59:57.505679 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.policy [None req-31a3d98c-1be2-43e8-918d-e59868d8f58a tempest-VolumesNegativeTest-1177368279 tempest-VolumesNegativeTest-1177368279-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68514732cd1d4c9d8181796d4573303f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fe74d6e6bd748d4a6f320530dffe300', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116063) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 12:59:57.513214 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: INFO nova.api.openstack.requestlog [None req-31a3d98c-1be2-43e8-918d-e59868d8f58a tempest-VolumesNegativeTest-1177368279 tempest-VolumesNegativeTest-1177368279-project] 10.222.0.49 "GET /compute/v2.1/servers/64bca4a7-c923-443e-a304-580fcbd76c14" status: 200 len: 1304 microversion: 2.1 time: 0.102185 Dec 14 12:59:57.513843 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: [pid: 116063|app: 0|req: 191/367] 10.222.0.49 () {58 vars in 1235 bytes} [Tue Dec 14 12:59:57 2021] GET /compute/v2.1/servers/64bca4a7-c923-443e-a304-580fcbd76c14 => generated 1304 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 14 12:59:58.162924 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.api.openstack.wsgi [None req-9a395ee4-ad00-4e87-8f7c-c6e3fe6766a2 tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116063) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 14 12:59:58.163771 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.compute.api [None req-9a395ee4-ad00-4e87-8f7c-c6e3fe6766a2 tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] [instance: c8de7730-62f2-4a77-b1e9-cf6a74fa366d] Fetching instance by UUID {{(pid=116063) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 12:59:58.172618 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-9a395ee4-ad00-4e87-8f7c-c6e3fe6766a2 tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 12:59:58.175377 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-9a395ee4-ad00-4e87-8f7c-c6e3fe6766a2 tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 12:59:58.176225 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-9a395ee4-ad00-4e87-8f7c-c6e3fe6766a2 tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 12:59:58.177836 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-9a395ee4-ad00-4e87-8f7c-c6e3fe6766a2 tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 13:00:00.809480 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: INFO nova.api.openstack.requestlog [None req-9a395ee4-ad00-4e87-8f7c-c6e3fe6766a2 tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] 10.222.0.49 "POST /compute/v2.1/servers/c8de7730-62f2-4a77-b1e9-cf6a74fa366d/action" status: 200 len: 37872 microversion: 2.20 time: 2.650340 Dec 14 13:00:00.812796 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: [pid: 116063|app: 0|req: 192/368] 10.222.0.49 () {62 vars in 1318 bytes} [Tue Dec 14 12:59:58 2021] POST /compute/v2.1/servers/c8de7730-62f2-4a77-b1e9-cf6a74fa366d/action => generated 37872 bytes in 2655 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 14 13:00:00.819609 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.api.openstack.wsgi [None req-87d5e383-78bb-4e70-b8f0-7f948fa5d548 tempest-ServerRescueNegativeTestJSON-1573931620 tempest-ServerRescueNegativeTestJSON-1573931620-project] Calling method '>' {{(pid=116063) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 13:00:00.820298 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.compute.api [None req-87d5e383-78bb-4e70-b8f0-7f948fa5d548 tempest-ServerRescueNegativeTestJSON-1573931620 tempest-ServerRescueNegativeTestJSON-1573931620-project] [instance: eb6e04a4-8901-47df-9b51-7c1664bd3f6c] Fetching instance by UUID {{(pid=116063) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 13:00:00.827955 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-87d5e383-78bb-4e70-b8f0-7f948fa5d548 tempest-ServerRescueNegativeTestJSON-1573931620 tempest-ServerRescueNegativeTestJSON-1573931620-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 13:00:00.828488 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-87d5e383-78bb-4e70-b8f0-7f948fa5d548 tempest-ServerRescueNegativeTestJSON-1573931620 tempest-ServerRescueNegativeTestJSON-1573931620-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 13:00:00.829315 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-87d5e383-78bb-4e70-b8f0-7f948fa5d548 tempest-ServerRescueNegativeTestJSON-1573931620 tempest-ServerRescueNegativeTestJSON-1573931620-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 13:00:00.829742 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-87d5e383-78bb-4e70-b8f0-7f948fa5d548 tempest-ServerRescueNegativeTestJSON-1573931620 tempest-ServerRescueNegativeTestJSON-1573931620-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 13:00:00.901439 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.network.neutron [None req-5392c649-fb1b-4a70-820e-6bd3de854947 tempest-AttachVolumeNegativeTest-1000400951 tempest-AttachVolumeNegativeTest-1000400951-project] validate_networks() for [('f9d231ae-628f-4043-969c-cf414631d868', None, None, None, None, None)] {{(pid=116064) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Dec 14 13:00:01.060825 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.policy [None req-87d5e383-78bb-4e70-b8f0-7f948fa5d548 tempest-ServerRescueNegativeTestJSON-1573931620 tempest-ServerRescueNegativeTestJSON-1573931620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '731cbbfe17214ded8ac66299d66dfc45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '010919ea84eb4eb8b936c63153600eba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116063) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 13:00:01.070757 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: INFO nova.api.openstack.requestlog [None req-87d5e383-78bb-4e70-b8f0-7f948fa5d548 tempest-ServerRescueNegativeTestJSON-1573931620 tempest-ServerRescueNegativeTestJSON-1573931620-project] 10.222.0.49 "GET /compute/v2.1/servers/eb6e04a4-8901-47df-9b51-7c1664bd3f6c" status: 200 len: 1523 microversion: 2.1 time: 0.254758 Dec 14 13:00:01.072823 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: [pid: 116063|app: 0|req: 193/369] 10.222.0.49 () {58 vars in 1235 bytes} [Tue Dec 14 13:00:00 2021] GET /compute/v2.1/servers/eb6e04a4-8901-47df-9b51-7c1664bd3f6c => generated 1523 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 14 13:00:01.079538 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.api.openstack.wsgi [None req-54f8887a-ff05-4424-af62-e474f371a779 tempest-VolumesNegativeTest-1177368279 tempest-VolumesNegativeTest-1177368279-project] Calling method '>' {{(pid=116063) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 13:00:01.080463 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.compute.api [None req-54f8887a-ff05-4424-af62-e474f371a779 tempest-VolumesNegativeTest-1177368279 tempest-VolumesNegativeTest-1177368279-project] [instance: 64bca4a7-c923-443e-a304-580fcbd76c14] Fetching instance by UUID {{(pid=116063) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 13:00:01.091289 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-54f8887a-ff05-4424-af62-e474f371a779 tempest-VolumesNegativeTest-1177368279 tempest-VolumesNegativeTest-1177368279-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 13:00:01.091738 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-54f8887a-ff05-4424-af62-e474f371a779 tempest-VolumesNegativeTest-1177368279 tempest-VolumesNegativeTest-1177368279-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 13:00:01.093299 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-54f8887a-ff05-4424-af62-e474f371a779 tempest-VolumesNegativeTest-1177368279 tempest-VolumesNegativeTest-1177368279-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 13:00:01.094090 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-54f8887a-ff05-4424-af62-e474f371a779 tempest-VolumesNegativeTest-1177368279 tempest-VolumesNegativeTest-1177368279-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 13:00:01.116809 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: INFO nova.api.openstack.wsgi [None req-54f8887a-ff05-4424-af62-e474f371a779 tempest-VolumesNegativeTest-1177368279 tempest-VolumesNegativeTest-1177368279-project] HTTP exception thrown: Instance 64bca4a7-c923-443e-a304-580fcbd76c14 could not be found. Dec 14 13:00:01.117481 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.api.openstack.wsgi [None req-54f8887a-ff05-4424-af62-e474f371a779 tempest-VolumesNegativeTest-1177368279 tempest-VolumesNegativeTest-1177368279-project] Returning 404 to user: Instance 64bca4a7-c923-443e-a304-580fcbd76c14 could not be found. {{(pid=116063) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 14 13:00:01.118524 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: INFO nova.api.openstack.requestlog [None req-54f8887a-ff05-4424-af62-e474f371a779 tempest-VolumesNegativeTest-1177368279 tempest-VolumesNegativeTest-1177368279-project] 10.222.0.49 "GET /compute/v2.1/servers/64bca4a7-c923-443e-a304-580fcbd76c14" status: 404 len: 111 microversion: 2.1 time: 0.043907 Dec 14 13:00:01.119248 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: [pid: 116063|app: 0|req: 194/370] 10.222.0.49 () {58 vars in 1235 bytes} [Tue Dec 14 13:00:01 2021] GET /compute/v2.1/servers/64bca4a7-c923-443e-a304-580fcbd76c14 => generated 111 bytes in 45 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Dec 14 13:00:01.407357 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.virt.hardware [None req-5392c649-fb1b-4a70-820e-6bd3de854947 tempest-AttachVolumeNegativeTest-1000400951 tempest-AttachVolumeNegativeTest-1000400951-project] Flavor limits 0:0:0 {{(pid=116064) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Dec 14 13:00:01.407958 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.virt.hardware [None req-5392c649-fb1b-4a70-820e-6bd3de854947 tempest-AttachVolumeNegativeTest-1000400951 tempest-AttachVolumeNegativeTest-1000400951-project] Image limits 0:0:0 {{(pid=116064) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Dec 14 13:00:01.408422 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.virt.hardware [None req-5392c649-fb1b-4a70-820e-6bd3de854947 tempest-AttachVolumeNegativeTest-1000400951 tempest-AttachVolumeNegativeTest-1000400951-project] Flavor pref 0:0:0 {{(pid=116064) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Dec 14 13:00:01.408824 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.virt.hardware [None req-5392c649-fb1b-4a70-820e-6bd3de854947 tempest-AttachVolumeNegativeTest-1000400951 tempest-AttachVolumeNegativeTest-1000400951-project] Image pref 0:0:0 {{(pid=116064) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Dec 14 13:00:01.409253 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.virt.hardware [None req-5392c649-fb1b-4a70-820e-6bd3de854947 tempest-AttachVolumeNegativeTest-1000400951 tempest-AttachVolumeNegativeTest-1000400951-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=116064) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Dec 14 13:00:01.418092 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-5392c649-fb1b-4a70-820e-6bd3de854947 tempest-AttachVolumeNegativeTest-1000400951 tempest-AttachVolumeNegativeTest-1000400951-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 13:00:01.418740 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-5392c649-fb1b-4a70-820e-6bd3de854947 tempest-AttachVolumeNegativeTest-1000400951 tempest-AttachVolumeNegativeTest-1000400951-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 13:00:01.419713 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-5392c649-fb1b-4a70-820e-6bd3de854947 tempest-AttachVolumeNegativeTest-1000400951 tempest-AttachVolumeNegativeTest-1000400951-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 13:00:01.420310 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-5392c649-fb1b-4a70-820e-6bd3de854947 tempest-AttachVolumeNegativeTest-1000400951 tempest-AttachVolumeNegativeTest-1000400951-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 13:00:01.445642 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.quota [None req-5392c649-fb1b-4a70-820e-6bd3de854947 tempest-AttachVolumeNegativeTest-1000400951 tempest-AttachVolumeNegativeTest-1000400951-project] Getting quotas for project ad27b8951cae4eeeafa257f45217653a. Resources: {'cores', 'instances', 'ram'} {{(pid=116064) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 14 13:00:01.456650 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.quota [None req-5392c649-fb1b-4a70-820e-6bd3de854947 tempest-AttachVolumeNegativeTest-1000400951 tempest-AttachVolumeNegativeTest-1000400951-project] Getting quotas for user 57d0ec01f0784c8ea87d339980bed3cf and project ad27b8951cae4eeeafa257f45217653a. Resources: {'cores', 'instances', 'ram'} {{(pid=116064) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 14 13:00:01.469813 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.compute.api [None req-5392c649-fb1b-4a70-820e-6bd3de854947 tempest-AttachVolumeNegativeTest-1000400951 tempest-AttachVolumeNegativeTest-1000400951-project] Going to run 1 instances... {{(pid=116064) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Dec 14 13:00:01.472453 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.compute.api [None req-5392c649-fb1b-4a70-820e-6bd3de854947 tempest-AttachVolumeNegativeTest-1000400951 tempest-AttachVolumeNegativeTest-1000400951-project] [instance: e79e4c5e-a1c6-4f80-9a63-d340231e3359] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='1733dcd4-5ded-44e1-8b8d-392adb05c67a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=116064) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Dec 14 13:00:01.528387 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: INFO nova.api.openstack.requestlog [None req-5392c649-fb1b-4a70-820e-6bd3de854947 tempest-AttachVolumeNegativeTest-1000400951 tempest-AttachVolumeNegativeTest-1000400951-project] 10.222.0.49 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 13.286226 Dec 14 13:00:01.529642 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: [pid: 116064|app: 0|req: 177/371] 10.222.0.49 () {60 vars in 1146 bytes} [Tue Dec 14 12:59:48 2021] POST /compute/v2.1/servers => generated 380 bytes in 13288 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Dec 14 13:00:01.540124 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.api.openstack.wsgi [None req-799e8994-9872-4462-bb70-b8a6fdd95fda tempest-AttachVolumeNegativeTest-1000400951 tempest-AttachVolumeNegativeTest-1000400951-project] Calling method '>' {{(pid=116063) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 13:00:01.541048 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.compute.api [None req-799e8994-9872-4462-bb70-b8a6fdd95fda tempest-AttachVolumeNegativeTest-1000400951 tempest-AttachVolumeNegativeTest-1000400951-project] [instance: e79e4c5e-a1c6-4f80-9a63-d340231e3359] Fetching instance by UUID {{(pid=116063) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 13:00:01.666386 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.policy [None req-799e8994-9872-4462-bb70-b8a6fdd95fda tempest-AttachVolumeNegativeTest-1000400951 tempest-AttachVolumeNegativeTest-1000400951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57d0ec01f0784c8ea87d339980bed3cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad27b8951cae4eeeafa257f45217653a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116063) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 13:00:01.675284 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: INFO nova.api.openstack.requestlog [None req-799e8994-9872-4462-bb70-b8a6fdd95fda tempest-AttachVolumeNegativeTest-1000400951 tempest-AttachVolumeNegativeTest-1000400951-project] 10.222.0.49 "GET /compute/v2.1/servers/e79e4c5e-a1c6-4f80-9a63-d340231e3359" status: 200 len: 1218 microversion: 2.1 time: 0.139470 Dec 14 13:00:01.676264 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: [pid: 116063|app: 0|req: 195/372] 10.222.0.49 () {58 vars in 1235 bytes} [Tue Dec 14 13:00:01 2021] GET /compute/v2.1/servers/e79e4c5e-a1c6-4f80-9a63-d340231e3359 => generated 1218 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 14 13:00:01.823987 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.api.openstack.wsgi [None req-4c18d0fd-1c2b-4e8a-89b6-0b7cc73c2351 tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116064) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 14 13:00:01.825305 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.compute.api [None req-4c18d0fd-1c2b-4e8a-89b6-0b7cc73c2351 tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] [instance: c8de7730-62f2-4a77-b1e9-cf6a74fa366d] Fetching instance by UUID {{(pid=116064) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 13:00:01.832396 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-4c18d0fd-1c2b-4e8a-89b6-0b7cc73c2351 tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 13:00:01.833097 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-4c18d0fd-1c2b-4e8a-89b6-0b7cc73c2351 tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 13:00:01.834239 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-4c18d0fd-1c2b-4e8a-89b6-0b7cc73c2351 tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 13:00:01.834822 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-4c18d0fd-1c2b-4e8a-89b6-0b7cc73c2351 tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 13:00:02.111468 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.api.openstack.wsgi [None req-6f26eab6-f1f7-4851-8616-ceb60677beee tempest-ServerRescueNegativeTestJSON-1573931620 tempest-ServerRescueNegativeTestJSON-1573931620-project] Calling method '>' {{(pid=116063) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 13:00:02.112177 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.compute.api [None req-6f26eab6-f1f7-4851-8616-ceb60677beee tempest-ServerRescueNegativeTestJSON-1573931620 tempest-ServerRescueNegativeTestJSON-1573931620-project] [instance: eb6e04a4-8901-47df-9b51-7c1664bd3f6c] Fetching instance by UUID {{(pid=116063) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 13:00:02.124239 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-6f26eab6-f1f7-4851-8616-ceb60677beee tempest-ServerRescueNegativeTestJSON-1573931620 tempest-ServerRescueNegativeTestJSON-1573931620-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 13:00:02.124691 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-6f26eab6-f1f7-4851-8616-ceb60677beee tempest-ServerRescueNegativeTestJSON-1573931620 tempest-ServerRescueNegativeTestJSON-1573931620-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 13:00:02.134637 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-6f26eab6-f1f7-4851-8616-ceb60677beee tempest-ServerRescueNegativeTestJSON-1573931620 tempest-ServerRescueNegativeTestJSON-1573931620-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 13:00:02.135096 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-6f26eab6-f1f7-4851-8616-ceb60677beee tempest-ServerRescueNegativeTestJSON-1573931620 tempest-ServerRescueNegativeTestJSON-1573931620-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 13:00:02.312385 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.policy [None req-6f26eab6-f1f7-4851-8616-ceb60677beee tempest-ServerRescueNegativeTestJSON-1573931620 tempest-ServerRescueNegativeTestJSON-1573931620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '731cbbfe17214ded8ac66299d66dfc45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '010919ea84eb4eb8b936c63153600eba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116063) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 13:00:02.320312 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: INFO nova.api.openstack.requestlog [None req-6f26eab6-f1f7-4851-8616-ceb60677beee tempest-ServerRescueNegativeTestJSON-1573931620 tempest-ServerRescueNegativeTestJSON-1573931620-project] 10.222.0.49 "GET /compute/v2.1/servers/eb6e04a4-8901-47df-9b51-7c1664bd3f6c" status: 200 len: 1523 microversion: 2.1 time: 0.232047 Dec 14 13:00:02.320916 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: [pid: 116063|app: 0|req: 196/373] 10.222.0.49 () {58 vars in 1235 bytes} [Tue Dec 14 13:00:02 2021] GET /compute/v2.1/servers/eb6e04a4-8901-47df-9b51-7c1664bd3f6c => generated 1523 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 14 13:00:02.692872 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.api.openstack.wsgi [None req-4332fd42-c54d-4230-9808-00fd86de660e tempest-AttachVolumeNegativeTest-1000400951 tempest-AttachVolumeNegativeTest-1000400951-project] Calling method '>' {{(pid=116063) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 13:00:02.693570 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.compute.api [None req-4332fd42-c54d-4230-9808-00fd86de660e tempest-AttachVolumeNegativeTest-1000400951 tempest-AttachVolumeNegativeTest-1000400951-project] [instance: e79e4c5e-a1c6-4f80-9a63-d340231e3359] Fetching instance by UUID {{(pid=116063) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 13:00:02.699870 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-4332fd42-c54d-4230-9808-00fd86de660e tempest-AttachVolumeNegativeTest-1000400951 tempest-AttachVolumeNegativeTest-1000400951-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 13:00:02.700310 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-4332fd42-c54d-4230-9808-00fd86de660e tempest-AttachVolumeNegativeTest-1000400951 tempest-AttachVolumeNegativeTest-1000400951-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 13:00:02.701116 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-4332fd42-c54d-4230-9808-00fd86de660e tempest-AttachVolumeNegativeTest-1000400951 tempest-AttachVolumeNegativeTest-1000400951-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 13:00:02.701520 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-4332fd42-c54d-4230-9808-00fd86de660e tempest-AttachVolumeNegativeTest-1000400951 tempest-AttachVolumeNegativeTest-1000400951-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 13:00:02.760486 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.policy [None req-4332fd42-c54d-4230-9808-00fd86de660e tempest-AttachVolumeNegativeTest-1000400951 tempest-AttachVolumeNegativeTest-1000400951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57d0ec01f0784c8ea87d339980bed3cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad27b8951cae4eeeafa257f45217653a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116063) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 13:00:02.768623 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: INFO nova.api.openstack.requestlog [None req-4332fd42-c54d-4230-9808-00fd86de660e tempest-AttachVolumeNegativeTest-1000400951 tempest-AttachVolumeNegativeTest-1000400951-project] 10.222.0.49 "GET /compute/v2.1/servers/e79e4c5e-a1c6-4f80-9a63-d340231e3359" status: 200 len: 1222 microversion: 2.1 time: 0.079504 Dec 14 13:00:02.769634 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: [pid: 116063|app: 0|req: 197/374] 10.222.0.49 () {58 vars in 1235 bytes} [Tue Dec 14 13:00:02 2021] GET /compute/v2.1/servers/e79e4c5e-a1c6-4f80-9a63-d340231e3359 => generated 1222 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 14 13:00:03.337932 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.api.openstack.wsgi [None req-f0a23b34-b6b8-4024-82f6-2b5526b6e490 tempest-ServerRescueNegativeTestJSON-1573931620 tempest-ServerRescueNegativeTestJSON-1573931620-project] Calling method '>' {{(pid=116063) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 13:00:03.338730 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.compute.api [None req-f0a23b34-b6b8-4024-82f6-2b5526b6e490 tempest-ServerRescueNegativeTestJSON-1573931620 tempest-ServerRescueNegativeTestJSON-1573931620-project] [instance: eb6e04a4-8901-47df-9b51-7c1664bd3f6c] Fetching instance by UUID {{(pid=116063) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 13:00:03.345825 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-f0a23b34-b6b8-4024-82f6-2b5526b6e490 tempest-ServerRescueNegativeTestJSON-1573931620 tempest-ServerRescueNegativeTestJSON-1573931620-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 13:00:03.346136 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-f0a23b34-b6b8-4024-82f6-2b5526b6e490 tempest-ServerRescueNegativeTestJSON-1573931620 tempest-ServerRescueNegativeTestJSON-1573931620-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 13:00:03.346922 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-f0a23b34-b6b8-4024-82f6-2b5526b6e490 tempest-ServerRescueNegativeTestJSON-1573931620 tempest-ServerRescueNegativeTestJSON-1573931620-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 13:00:03.347350 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-f0a23b34-b6b8-4024-82f6-2b5526b6e490 tempest-ServerRescueNegativeTestJSON-1573931620 tempest-ServerRescueNegativeTestJSON-1573931620-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 13:00:03.492486 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.policy [None req-f0a23b34-b6b8-4024-82f6-2b5526b6e490 tempest-ServerRescueNegativeTestJSON-1573931620 tempest-ServerRescueNegativeTestJSON-1573931620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '731cbbfe17214ded8ac66299d66dfc45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '010919ea84eb4eb8b936c63153600eba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116063) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 13:00:03.502929 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: INFO nova.api.openstack.requestlog [None req-f0a23b34-b6b8-4024-82f6-2b5526b6e490 tempest-ServerRescueNegativeTestJSON-1573931620 tempest-ServerRescueNegativeTestJSON-1573931620-project] 10.222.0.49 "GET /compute/v2.1/servers/eb6e04a4-8901-47df-9b51-7c1664bd3f6c" status: 200 len: 1523 microversion: 2.1 time: 0.169345 Dec 14 13:00:03.503637 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: [pid: 116063|app: 0|req: 198/375] 10.222.0.49 () {58 vars in 1235 bytes} [Tue Dec 14 13:00:03 2021] GET /compute/v2.1/servers/eb6e04a4-8901-47df-9b51-7c1664bd3f6c => generated 1523 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 14 13:00:03.785505 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.api.openstack.wsgi [None req-820492d5-7e26-4f0d-bf5a-da3fdac6a588 tempest-AttachVolumeNegativeTest-1000400951 tempest-AttachVolumeNegativeTest-1000400951-project] Calling method '>' {{(pid=116063) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 13:00:03.786082 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.compute.api [None req-820492d5-7e26-4f0d-bf5a-da3fdac6a588 tempest-AttachVolumeNegativeTest-1000400951 tempest-AttachVolumeNegativeTest-1000400951-project] [instance: e79e4c5e-a1c6-4f80-9a63-d340231e3359] Fetching instance by UUID {{(pid=116063) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 13:00:03.792302 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-820492d5-7e26-4f0d-bf5a-da3fdac6a588 tempest-AttachVolumeNegativeTest-1000400951 tempest-AttachVolumeNegativeTest-1000400951-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 13:00:03.792811 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-820492d5-7e26-4f0d-bf5a-da3fdac6a588 tempest-AttachVolumeNegativeTest-1000400951 tempest-AttachVolumeNegativeTest-1000400951-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 13:00:03.793610 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-820492d5-7e26-4f0d-bf5a-da3fdac6a588 tempest-AttachVolumeNegativeTest-1000400951 tempest-AttachVolumeNegativeTest-1000400951-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 13:00:03.794040 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-820492d5-7e26-4f0d-bf5a-da3fdac6a588 tempest-AttachVolumeNegativeTest-1000400951 tempest-AttachVolumeNegativeTest-1000400951-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 13:00:03.860947 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.policy [None req-820492d5-7e26-4f0d-bf5a-da3fdac6a588 tempest-AttachVolumeNegativeTest-1000400951 tempest-AttachVolumeNegativeTest-1000400951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57d0ec01f0784c8ea87d339980bed3cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad27b8951cae4eeeafa257f45217653a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116063) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 13:00:03.869108 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: INFO nova.api.openstack.requestlog [None req-820492d5-7e26-4f0d-bf5a-da3fdac6a588 tempest-AttachVolumeNegativeTest-1000400951 tempest-AttachVolumeNegativeTest-1000400951-project] 10.222.0.49 "GET /compute/v2.1/servers/e79e4c5e-a1c6-4f80-9a63-d340231e3359" status: 200 len: 1222 microversion: 2.1 time: 0.087161 Dec 14 13:00:03.869708 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: [pid: 116063|app: 0|req: 199/376] 10.222.0.49 () {58 vars in 1235 bytes} [Tue Dec 14 13:00:03 2021] GET /compute/v2.1/servers/e79e4c5e-a1c6-4f80-9a63-d340231e3359 => generated 1222 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 14 13:00:03.982218 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: INFO nova.api.openstack.requestlog [None req-4c18d0fd-1c2b-4e8a-89b6-0b7cc73c2351 tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] 10.222.0.49 "POST /compute/v2.1/servers/c8de7730-62f2-4a77-b1e9-cf6a74fa366d/action" status: 200 len: 37939 microversion: 2.20 time: 2.163470 Dec 14 13:00:03.982853 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: [pid: 116064|app: 0|req: 178/377] 10.222.0.49 () {62 vars in 1318 bytes} [Tue Dec 14 13:00:01 2021] POST /compute/v2.1/servers/c8de7730-62f2-4a77-b1e9-cf6a74fa366d/action => generated 37939 bytes in 2165 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Dec 14 13:00:04.519400 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.api.openstack.wsgi [None req-ad988498-d2dd-48e2-8ed9-6f9528ea8c83 tempest-ServerRescueNegativeTestJSON-1573931620 tempest-ServerRescueNegativeTestJSON-1573931620-project] Calling method '>' {{(pid=116063) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 13:00:04.520010 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.compute.api [None req-ad988498-d2dd-48e2-8ed9-6f9528ea8c83 tempest-ServerRescueNegativeTestJSON-1573931620 tempest-ServerRescueNegativeTestJSON-1573931620-project] [instance: eb6e04a4-8901-47df-9b51-7c1664bd3f6c] Fetching instance by UUID {{(pid=116063) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 13:00:04.526584 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-ad988498-d2dd-48e2-8ed9-6f9528ea8c83 tempest-ServerRescueNegativeTestJSON-1573931620 tempest-ServerRescueNegativeTestJSON-1573931620-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 13:00:04.527032 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-ad988498-d2dd-48e2-8ed9-6f9528ea8c83 tempest-ServerRescueNegativeTestJSON-1573931620 tempest-ServerRescueNegativeTestJSON-1573931620-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 13:00:04.527809 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-ad988498-d2dd-48e2-8ed9-6f9528ea8c83 tempest-ServerRescueNegativeTestJSON-1573931620 tempest-ServerRescueNegativeTestJSON-1573931620-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 13:00:04.528245 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-ad988498-d2dd-48e2-8ed9-6f9528ea8c83 tempest-ServerRescueNegativeTestJSON-1573931620 tempest-ServerRescueNegativeTestJSON-1573931620-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 13:00:04.671446 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.policy [None req-ad988498-d2dd-48e2-8ed9-6f9528ea8c83 tempest-ServerRescueNegativeTestJSON-1573931620 tempest-ServerRescueNegativeTestJSON-1573931620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '731cbbfe17214ded8ac66299d66dfc45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '010919ea84eb4eb8b936c63153600eba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116063) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 13:00:04.679462 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: INFO nova.api.openstack.requestlog [None req-ad988498-d2dd-48e2-8ed9-6f9528ea8c83 tempest-ServerRescueNegativeTestJSON-1573931620 tempest-ServerRescueNegativeTestJSON-1573931620-project] 10.222.0.49 "GET /compute/v2.1/servers/eb6e04a4-8901-47df-9b51-7c1664bd3f6c" status: 200 len: 1523 microversion: 2.1 time: 0.163711 Dec 14 13:00:04.680039 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: [pid: 116063|app: 0|req: 200/378] 10.222.0.49 () {58 vars in 1235 bytes} [Tue Dec 14 13:00:04 2021] GET /compute/v2.1/servers/eb6e04a4-8901-47df-9b51-7c1664bd3f6c => generated 1523 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 14 13:00:04.886886 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.api.openstack.wsgi [None req-dc278b50-8e08-4416-ad43-23df5aceaa03 tempest-AttachVolumeNegativeTest-1000400951 tempest-AttachVolumeNegativeTest-1000400951-project] Calling method '>' {{(pid=116064) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 13:00:04.887587 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.compute.api [None req-dc278b50-8e08-4416-ad43-23df5aceaa03 tempest-AttachVolumeNegativeTest-1000400951 tempest-AttachVolumeNegativeTest-1000400951-project] [instance: e79e4c5e-a1c6-4f80-9a63-d340231e3359] Fetching instance by UUID {{(pid=116064) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 13:00:04.894929 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-dc278b50-8e08-4416-ad43-23df5aceaa03 tempest-AttachVolumeNegativeTest-1000400951 tempest-AttachVolumeNegativeTest-1000400951-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 13:00:04.895384 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-dc278b50-8e08-4416-ad43-23df5aceaa03 tempest-AttachVolumeNegativeTest-1000400951 tempest-AttachVolumeNegativeTest-1000400951-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 13:00:04.896163 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-dc278b50-8e08-4416-ad43-23df5aceaa03 tempest-AttachVolumeNegativeTest-1000400951 tempest-AttachVolumeNegativeTest-1000400951-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 13:00:04.896604 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-dc278b50-8e08-4416-ad43-23df5aceaa03 tempest-AttachVolumeNegativeTest-1000400951 tempest-AttachVolumeNegativeTest-1000400951-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 13:00:04.956063 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.policy [None req-dc278b50-8e08-4416-ad43-23df5aceaa03 tempest-AttachVolumeNegativeTest-1000400951 tempest-AttachVolumeNegativeTest-1000400951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57d0ec01f0784c8ea87d339980bed3cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad27b8951cae4eeeafa257f45217653a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116064) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 13:00:04.964611 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: INFO nova.api.openstack.requestlog [None req-dc278b50-8e08-4416-ad43-23df5aceaa03 tempest-AttachVolumeNegativeTest-1000400951 tempest-AttachVolumeNegativeTest-1000400951-project] 10.222.0.49 "GET /compute/v2.1/servers/e79e4c5e-a1c6-4f80-9a63-d340231e3359" status: 200 len: 1222 microversion: 2.1 time: 0.081846 Dec 14 13:00:04.965231 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: [pid: 116064|app: 0|req: 179/379] 10.222.0.49 () {58 vars in 1235 bytes} [Tue Dec 14 13:00:04 2021] GET /compute/v2.1/servers/e79e4c5e-a1c6-4f80-9a63-d340231e3359 => generated 1222 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 14 13:00:04.994542 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.api.openstack.wsgi [None req-324d3286-3087-45a5-9136-5710b98d73d7 tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116063) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 14 13:00:04.995453 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.compute.api [None req-324d3286-3087-45a5-9136-5710b98d73d7 tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] [instance: c8de7730-62f2-4a77-b1e9-cf6a74fa366d] Fetching instance by UUID {{(pid=116063) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 13:00:05.001949 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-324d3286-3087-45a5-9136-5710b98d73d7 tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 13:00:05.002399 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-324d3286-3087-45a5-9136-5710b98d73d7 tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 13:00:05.003178 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-324d3286-3087-45a5-9136-5710b98d73d7 tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 13:00:05.003618 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-324d3286-3087-45a5-9136-5710b98d73d7 tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 13:00:05.205275 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: INFO nova.api.openstack.requestlog [None req-324d3286-3087-45a5-9136-5710b98d73d7 tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] 10.222.0.49 "POST /compute/v2.1/servers/c8de7730-62f2-4a77-b1e9-cf6a74fa366d/action" status: 200 len: 37939 microversion: 2.20 time: 0.214021 Dec 14 13:00:05.207040 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: [pid: 116063|app: 0|req: 201/380] 10.222.0.49 () {62 vars in 1318 bytes} [Tue Dec 14 13:00:04 2021] POST /compute/v2.1/servers/c8de7730-62f2-4a77-b1e9-cf6a74fa366d/action => generated 37939 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 14 13:00:05.696518 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.api.openstack.wsgi [None req-1faf4a62-de85-471c-b172-9be2aa1a032e tempest-ServerRescueNegativeTestJSON-1573931620 tempest-ServerRescueNegativeTestJSON-1573931620-project] Calling method '>' {{(pid=116064) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 13:00:05.697155 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.compute.api [None req-1faf4a62-de85-471c-b172-9be2aa1a032e tempest-ServerRescueNegativeTestJSON-1573931620 tempest-ServerRescueNegativeTestJSON-1573931620-project] [instance: eb6e04a4-8901-47df-9b51-7c1664bd3f6c] Fetching instance by UUID {{(pid=116064) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 13:00:05.703908 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-1faf4a62-de85-471c-b172-9be2aa1a032e tempest-ServerRescueNegativeTestJSON-1573931620 tempest-ServerRescueNegativeTestJSON-1573931620-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 13:00:05.704361 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-1faf4a62-de85-471c-b172-9be2aa1a032e tempest-ServerRescueNegativeTestJSON-1573931620 tempest-ServerRescueNegativeTestJSON-1573931620-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 13:00:05.705239 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-1faf4a62-de85-471c-b172-9be2aa1a032e tempest-ServerRescueNegativeTestJSON-1573931620 tempest-ServerRescueNegativeTestJSON-1573931620-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 13:00:05.705677 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-1faf4a62-de85-471c-b172-9be2aa1a032e tempest-ServerRescueNegativeTestJSON-1573931620 tempest-ServerRescueNegativeTestJSON-1573931620-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 13:00:05.851918 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.policy [None req-1faf4a62-de85-471c-b172-9be2aa1a032e tempest-ServerRescueNegativeTestJSON-1573931620 tempest-ServerRescueNegativeTestJSON-1573931620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '731cbbfe17214ded8ac66299d66dfc45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '010919ea84eb4eb8b936c63153600eba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116064) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 13:00:05.862919 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: INFO nova.api.openstack.requestlog [None req-1faf4a62-de85-471c-b172-9be2aa1a032e tempest-ServerRescueNegativeTestJSON-1573931620 tempest-ServerRescueNegativeTestJSON-1573931620-project] 10.222.0.49 "GET /compute/v2.1/servers/eb6e04a4-8901-47df-9b51-7c1664bd3f6c" status: 200 len: 1523 microversion: 2.1 time: 0.169739 Dec 14 13:00:05.863888 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: [pid: 116064|app: 0|req: 180/381] 10.222.0.49 () {58 vars in 1235 bytes} [Tue Dec 14 13:00:05 2021] GET /compute/v2.1/servers/eb6e04a4-8901-47df-9b51-7c1664bd3f6c => generated 1523 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 14 13:00:05.982041 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.api.openstack.wsgi [None req-351b2d5e-5cea-45c3-a9b5-34d60fc16ca6 tempest-AttachVolumeNegativeTest-1000400951 tempest-AttachVolumeNegativeTest-1000400951-project] Calling method '>' {{(pid=116063) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 13:00:05.983725 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.compute.api [None req-351b2d5e-5cea-45c3-a9b5-34d60fc16ca6 tempest-AttachVolumeNegativeTest-1000400951 tempest-AttachVolumeNegativeTest-1000400951-project] [instance: e79e4c5e-a1c6-4f80-9a63-d340231e3359] Fetching instance by UUID {{(pid=116063) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 13:00:06.011279 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-351b2d5e-5cea-45c3-a9b5-34d60fc16ca6 tempest-AttachVolumeNegativeTest-1000400951 tempest-AttachVolumeNegativeTest-1000400951-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 13:00:06.011722 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-351b2d5e-5cea-45c3-a9b5-34d60fc16ca6 tempest-AttachVolumeNegativeTest-1000400951 tempest-AttachVolumeNegativeTest-1000400951-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 13:00:06.012540 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-351b2d5e-5cea-45c3-a9b5-34d60fc16ca6 tempest-AttachVolumeNegativeTest-1000400951 tempest-AttachVolumeNegativeTest-1000400951-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 13:00:06.013007 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-351b2d5e-5cea-45c3-a9b5-34d60fc16ca6 tempest-AttachVolumeNegativeTest-1000400951 tempest-AttachVolumeNegativeTest-1000400951-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 13:00:06.099806 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.policy [None req-351b2d5e-5cea-45c3-a9b5-34d60fc16ca6 tempest-AttachVolumeNegativeTest-1000400951 tempest-AttachVolumeNegativeTest-1000400951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57d0ec01f0784c8ea87d339980bed3cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad27b8951cae4eeeafa257f45217653a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116063) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 13:00:06.117304 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: INFO nova.api.openstack.requestlog [None req-351b2d5e-5cea-45c3-a9b5-34d60fc16ca6 tempest-AttachVolumeNegativeTest-1000400951 tempest-AttachVolumeNegativeTest-1000400951-project] 10.222.0.49 "GET /compute/v2.1/servers/e79e4c5e-a1c6-4f80-9a63-d340231e3359" status: 200 len: 1270 microversion: 2.1 time: 0.139324 Dec 14 13:00:06.119897 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: [pid: 116063|app: 0|req: 202/382] 10.222.0.49 () {58 vars in 1235 bytes} [Tue Dec 14 13:00:05 2021] GET /compute/v2.1/servers/e79e4c5e-a1c6-4f80-9a63-d340231e3359 => generated 1270 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 14 13:00:06.217136 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.api.openstack.wsgi [None req-93cc5cc2-468e-4674-a023-c33b5b6d241c tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116064) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 14 13:00:06.218109 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.compute.api [None req-93cc5cc2-468e-4674-a023-c33b5b6d241c tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] [instance: c8de7730-62f2-4a77-b1e9-cf6a74fa366d] Fetching instance by UUID {{(pid=116064) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 13:00:06.224758 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-93cc5cc2-468e-4674-a023-c33b5b6d241c tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 13:00:06.225275 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-93cc5cc2-468e-4674-a023-c33b5b6d241c tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 13:00:06.226064 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-93cc5cc2-468e-4674-a023-c33b5b6d241c tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 13:00:06.226569 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-93cc5cc2-468e-4674-a023-c33b5b6d241c tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 13:00:06.880450 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.api.openstack.wsgi [None req-00b83c9e-8f98-415b-8f5f-ff7bfa22c070 tempest-ServerRescueNegativeTestJSON-1573931620 tempest-ServerRescueNegativeTestJSON-1573931620-project] Calling method '>' {{(pid=116063) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 13:00:06.881382 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.compute.api [None req-00b83c9e-8f98-415b-8f5f-ff7bfa22c070 tempest-ServerRescueNegativeTestJSON-1573931620 tempest-ServerRescueNegativeTestJSON-1573931620-project] [instance: eb6e04a4-8901-47df-9b51-7c1664bd3f6c] Fetching instance by UUID {{(pid=116063) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 13:00:06.889167 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-00b83c9e-8f98-415b-8f5f-ff7bfa22c070 tempest-ServerRescueNegativeTestJSON-1573931620 tempest-ServerRescueNegativeTestJSON-1573931620-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 13:00:06.889699 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-00b83c9e-8f98-415b-8f5f-ff7bfa22c070 tempest-ServerRescueNegativeTestJSON-1573931620 tempest-ServerRescueNegativeTestJSON-1573931620-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 13:00:06.890613 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-00b83c9e-8f98-415b-8f5f-ff7bfa22c070 tempest-ServerRescueNegativeTestJSON-1573931620 tempest-ServerRescueNegativeTestJSON-1573931620-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 13:00:06.891205 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-00b83c9e-8f98-415b-8f5f-ff7bfa22c070 tempest-ServerRescueNegativeTestJSON-1573931620 tempest-ServerRescueNegativeTestJSON-1573931620-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 13:00:07.024710 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.policy [None req-00b83c9e-8f98-415b-8f5f-ff7bfa22c070 tempest-ServerRescueNegativeTestJSON-1573931620 tempest-ServerRescueNegativeTestJSON-1573931620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '731cbbfe17214ded8ac66299d66dfc45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '010919ea84eb4eb8b936c63153600eba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116063) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 13:00:07.032618 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: INFO nova.api.openstack.requestlog [None req-00b83c9e-8f98-415b-8f5f-ff7bfa22c070 tempest-ServerRescueNegativeTestJSON-1573931620 tempest-ServerRescueNegativeTestJSON-1573931620-project] 10.222.0.49 "GET /compute/v2.1/servers/eb6e04a4-8901-47df-9b51-7c1664bd3f6c" status: 200 len: 1523 microversion: 2.1 time: 0.156531 Dec 14 13:00:07.033242 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: [pid: 116063|app: 0|req: 203/383] 10.222.0.49 () {58 vars in 1235 bytes} [Tue Dec 14 13:00:06 2021] GET /compute/v2.1/servers/eb6e04a4-8901-47df-9b51-7c1664bd3f6c => generated 1523 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 14 13:00:07.141326 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.api.openstack.wsgi [None req-1acd7859-8a45-48c0-8645-5bcecc1c986d tempest-AttachVolumeNegativeTest-1000400951 tempest-AttachVolumeNegativeTest-1000400951-project] Calling method '>' {{(pid=116063) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 13:00:07.142265 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.compute.api [None req-1acd7859-8a45-48c0-8645-5bcecc1c986d tempest-AttachVolumeNegativeTest-1000400951 tempest-AttachVolumeNegativeTest-1000400951-project] [instance: e79e4c5e-a1c6-4f80-9a63-d340231e3359] Fetching instance by UUID {{(pid=116063) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 13:00:07.148945 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-1acd7859-8a45-48c0-8645-5bcecc1c986d tempest-AttachVolumeNegativeTest-1000400951 tempest-AttachVolumeNegativeTest-1000400951-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 13:00:07.149402 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-1acd7859-8a45-48c0-8645-5bcecc1c986d tempest-AttachVolumeNegativeTest-1000400951 tempest-AttachVolumeNegativeTest-1000400951-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 13:00:07.150404 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-1acd7859-8a45-48c0-8645-5bcecc1c986d tempest-AttachVolumeNegativeTest-1000400951 tempest-AttachVolumeNegativeTest-1000400951-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 13:00:07.150836 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-1acd7859-8a45-48c0-8645-5bcecc1c986d tempest-AttachVolumeNegativeTest-1000400951 tempest-AttachVolumeNegativeTest-1000400951-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 13:00:07.215815 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.policy [None req-1acd7859-8a45-48c0-8645-5bcecc1c986d tempest-AttachVolumeNegativeTest-1000400951 tempest-AttachVolumeNegativeTest-1000400951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57d0ec01f0784c8ea87d339980bed3cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad27b8951cae4eeeafa257f45217653a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116063) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 13:00:07.225001 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: INFO nova.api.openstack.requestlog [None req-1acd7859-8a45-48c0-8645-5bcecc1c986d tempest-AttachVolumeNegativeTest-1000400951 tempest-AttachVolumeNegativeTest-1000400951-project] 10.222.0.49 "GET /compute/v2.1/servers/e79e4c5e-a1c6-4f80-9a63-d340231e3359" status: 200 len: 1278 microversion: 2.1 time: 0.087713 Dec 14 13:00:07.225850 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: [pid: 116063|app: 0|req: 204/384] 10.222.0.49 () {58 vars in 1235 bytes} [Tue Dec 14 13:00:07 2021] GET /compute/v2.1/servers/e79e4c5e-a1c6-4f80-9a63-d340231e3359 => generated 1278 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 14 13:00:08.051627 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.api.openstack.wsgi [None req-62692f62-1919-49db-b179-edb30b67ef15 tempest-ServerRescueNegativeTestJSON-1573931620 tempest-ServerRescueNegativeTestJSON-1573931620-project] Calling method '>' {{(pid=116063) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 13:00:08.052518 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.compute.api [None req-62692f62-1919-49db-b179-edb30b67ef15 tempest-ServerRescueNegativeTestJSON-1573931620 tempest-ServerRescueNegativeTestJSON-1573931620-project] [instance: eb6e04a4-8901-47df-9b51-7c1664bd3f6c] Fetching instance by UUID {{(pid=116063) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 13:00:08.059384 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-62692f62-1919-49db-b179-edb30b67ef15 tempest-ServerRescueNegativeTestJSON-1573931620 tempest-ServerRescueNegativeTestJSON-1573931620-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 13:00:08.059834 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-62692f62-1919-49db-b179-edb30b67ef15 tempest-ServerRescueNegativeTestJSON-1573931620 tempest-ServerRescueNegativeTestJSON-1573931620-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 13:00:08.060647 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-62692f62-1919-49db-b179-edb30b67ef15 tempest-ServerRescueNegativeTestJSON-1573931620 tempest-ServerRescueNegativeTestJSON-1573931620-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 13:00:08.061102 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-62692f62-1919-49db-b179-edb30b67ef15 tempest-ServerRescueNegativeTestJSON-1573931620 tempest-ServerRescueNegativeTestJSON-1573931620-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 13:00:08.202819 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.policy [None req-62692f62-1919-49db-b179-edb30b67ef15 tempest-ServerRescueNegativeTestJSON-1573931620 tempest-ServerRescueNegativeTestJSON-1573931620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '731cbbfe17214ded8ac66299d66dfc45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '010919ea84eb4eb8b936c63153600eba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116063) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 13:00:08.212372 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: INFO nova.api.openstack.requestlog [None req-62692f62-1919-49db-b179-edb30b67ef15 tempest-ServerRescueNegativeTestJSON-1573931620 tempest-ServerRescueNegativeTestJSON-1573931620-project] 10.222.0.49 "GET /compute/v2.1/servers/eb6e04a4-8901-47df-9b51-7c1664bd3f6c" status: 200 len: 1523 microversion: 2.1 time: 0.165687 Dec 14 13:00:08.213457 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: [pid: 116063|app: 0|req: 205/385] 10.222.0.49 () {58 vars in 1235 bytes} [Tue Dec 14 13:00:08 2021] GET /compute/v2.1/servers/eb6e04a4-8901-47df-9b51-7c1664bd3f6c => generated 1523 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 14 13:00:08.244682 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.api.openstack.wsgi [None req-332c1295-5ef3-4617-84b0-8fc11e8543f6 tempest-AttachVolumeNegativeTest-1000400951 tempest-AttachVolumeNegativeTest-1000400951-project] Calling method '>' {{(pid=116063) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 13:00:08.245412 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.compute.api [None req-332c1295-5ef3-4617-84b0-8fc11e8543f6 tempest-AttachVolumeNegativeTest-1000400951 tempest-AttachVolumeNegativeTest-1000400951-project] [instance: e79e4c5e-a1c6-4f80-9a63-d340231e3359] Fetching instance by UUID {{(pid=116063) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 13:00:08.251573 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-332c1295-5ef3-4617-84b0-8fc11e8543f6 tempest-AttachVolumeNegativeTest-1000400951 tempest-AttachVolumeNegativeTest-1000400951-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 13:00:08.252393 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-332c1295-5ef3-4617-84b0-8fc11e8543f6 tempest-AttachVolumeNegativeTest-1000400951 tempest-AttachVolumeNegativeTest-1000400951-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 13:00:08.253418 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-332c1295-5ef3-4617-84b0-8fc11e8543f6 tempest-AttachVolumeNegativeTest-1000400951 tempest-AttachVolumeNegativeTest-1000400951-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 13:00:08.254074 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-332c1295-5ef3-4617-84b0-8fc11e8543f6 tempest-AttachVolumeNegativeTest-1000400951 tempest-AttachVolumeNegativeTest-1000400951-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 13:00:08.317365 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.policy [None req-332c1295-5ef3-4617-84b0-8fc11e8543f6 tempest-AttachVolumeNegativeTest-1000400951 tempest-AttachVolumeNegativeTest-1000400951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57d0ec01f0784c8ea87d339980bed3cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad27b8951cae4eeeafa257f45217653a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116063) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 13:00:08.326032 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: INFO nova.api.openstack.requestlog [None req-332c1295-5ef3-4617-84b0-8fc11e8543f6 tempest-AttachVolumeNegativeTest-1000400951 tempest-AttachVolumeNegativeTest-1000400951-project] 10.222.0.49 "GET /compute/v2.1/servers/e79e4c5e-a1c6-4f80-9a63-d340231e3359" status: 200 len: 1278 microversion: 2.1 time: 0.085140 Dec 14 13:00:08.326896 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: [pid: 116063|app: 0|req: 206/386] 10.222.0.49 () {58 vars in 1235 bytes} [Tue Dec 14 13:00:08 2021] GET /compute/v2.1/servers/e79e4c5e-a1c6-4f80-9a63-d340231e3359 => generated 1278 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 14 13:00:09.229810 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.api.openstack.wsgi [None req-dfdf68c1-6c1c-480f-8f07-7126b11754c9 tempest-ServerRescueNegativeTestJSON-1573931620 tempest-ServerRescueNegativeTestJSON-1573931620-project] Calling method '>' {{(pid=116063) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 13:00:09.230624 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.compute.api [None req-dfdf68c1-6c1c-480f-8f07-7126b11754c9 tempest-ServerRescueNegativeTestJSON-1573931620 tempest-ServerRescueNegativeTestJSON-1573931620-project] [instance: eb6e04a4-8901-47df-9b51-7c1664bd3f6c] Fetching instance by UUID {{(pid=116063) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 13:00:09.237509 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-dfdf68c1-6c1c-480f-8f07-7126b11754c9 tempest-ServerRescueNegativeTestJSON-1573931620 tempest-ServerRescueNegativeTestJSON-1573931620-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 13:00:09.238224 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-dfdf68c1-6c1c-480f-8f07-7126b11754c9 tempest-ServerRescueNegativeTestJSON-1573931620 tempest-ServerRescueNegativeTestJSON-1573931620-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 13:00:09.239241 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-dfdf68c1-6c1c-480f-8f07-7126b11754c9 tempest-ServerRescueNegativeTestJSON-1573931620 tempest-ServerRescueNegativeTestJSON-1573931620-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 13:00:09.239914 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-dfdf68c1-6c1c-480f-8f07-7126b11754c9 tempest-ServerRescueNegativeTestJSON-1573931620 tempest-ServerRescueNegativeTestJSON-1573931620-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 13:00:09.363328 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: INFO nova.api.openstack.requestlog [None req-93cc5cc2-468e-4674-a023-c33b5b6d241c tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] 10.222.0.49 "POST /compute/v2.1/servers/c8de7730-62f2-4a77-b1e9-cf6a74fa366d/action" status: 200 len: 38080 microversion: 2.20 time: 3.149544 Dec 14 13:00:09.369412 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: [pid: 116064|app: 0|req: 181/387] 10.222.0.49 () {62 vars in 1318 bytes} [Tue Dec 14 13:00:06 2021] POST /compute/v2.1/servers/c8de7730-62f2-4a77-b1e9-cf6a74fa366d/action => generated 38080 bytes in 3156 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 14 13:00:09.381039 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.api.openstack.wsgi [None req-5ea66ec8-8350-48d5-9cc6-b879901dc559 tempest-AttachVolumeNegativeTest-1000400951 tempest-AttachVolumeNegativeTest-1000400951-project] Calling method '>' {{(pid=116064) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 13:00:09.382010 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.compute.api [None req-5ea66ec8-8350-48d5-9cc6-b879901dc559 tempest-AttachVolumeNegativeTest-1000400951 tempest-AttachVolumeNegativeTest-1000400951-project] [instance: e79e4c5e-a1c6-4f80-9a63-d340231e3359] Fetching instance by UUID {{(pid=116064) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 13:00:09.394030 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-5ea66ec8-8350-48d5-9cc6-b879901dc559 tempest-AttachVolumeNegativeTest-1000400951 tempest-AttachVolumeNegativeTest-1000400951-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 13:00:09.394472 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-5ea66ec8-8350-48d5-9cc6-b879901dc559 tempest-AttachVolumeNegativeTest-1000400951 tempest-AttachVolumeNegativeTest-1000400951-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 13:00:09.395282 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-5ea66ec8-8350-48d5-9cc6-b879901dc559 tempest-AttachVolumeNegativeTest-1000400951 tempest-AttachVolumeNegativeTest-1000400951-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 13:00:09.395711 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-5ea66ec8-8350-48d5-9cc6-b879901dc559 tempest-AttachVolumeNegativeTest-1000400951 tempest-AttachVolumeNegativeTest-1000400951-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 13:00:09.442331 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.policy [None req-dfdf68c1-6c1c-480f-8f07-7126b11754c9 tempest-ServerRescueNegativeTestJSON-1573931620 tempest-ServerRescueNegativeTestJSON-1573931620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '731cbbfe17214ded8ac66299d66dfc45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '010919ea84eb4eb8b936c63153600eba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116063) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 13:00:09.455224 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: INFO nova.api.openstack.requestlog [None req-dfdf68c1-6c1c-480f-8f07-7126b11754c9 tempest-ServerRescueNegativeTestJSON-1573931620 tempest-ServerRescueNegativeTestJSON-1573931620-project] 10.222.0.49 "GET /compute/v2.1/servers/eb6e04a4-8901-47df-9b51-7c1664bd3f6c" status: 200 len: 1523 microversion: 2.1 time: 0.228650 Dec 14 13:00:09.456769 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: [pid: 116063|app: 0|req: 207/388] 10.222.0.49 () {58 vars in 1235 bytes} [Tue Dec 14 13:00:09 2021] GET /compute/v2.1/servers/eb6e04a4-8901-47df-9b51-7c1664bd3f6c => generated 1523 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 14 13:00:09.468558 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.api.openstack.wsgi [None req-d54e37ab-d294-4f2b-b512-29de45bffe76 tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] Calling method '>' {{(pid=116063) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 13:00:09.469168 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.compute.api [None req-d54e37ab-d294-4f2b-b512-29de45bffe76 tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] [instance: c8de7730-62f2-4a77-b1e9-cf6a74fa366d] Fetching instance by UUID {{(pid=116063) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 13:00:09.475739 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-d54e37ab-d294-4f2b-b512-29de45bffe76 tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 13:00:09.476049 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-d54e37ab-d294-4f2b-b512-29de45bffe76 tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 13:00:09.477121 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-d54e37ab-d294-4f2b-b512-29de45bffe76 tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 13:00:09.477716 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-d54e37ab-d294-4f2b-b512-29de45bffe76 tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 13:00:09.504609 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.policy [None req-5ea66ec8-8350-48d5-9cc6-b879901dc559 tempest-AttachVolumeNegativeTest-1000400951 tempest-AttachVolumeNegativeTest-1000400951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57d0ec01f0784c8ea87d339980bed3cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad27b8951cae4eeeafa257f45217653a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116064) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 13:00:09.511856 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: INFO nova.api.openstack.requestlog [None req-d54e37ab-d294-4f2b-b512-29de45bffe76 tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] 10.222.0.49 "GET /compute/v2.1/servers/c8de7730-62f2-4a77-b1e9-cf6a74fa366d/ips" status: 200 len: 152 microversion: 2.20 time: 0.052941 Dec 14 13:00:09.512585 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: [pid: 116063|app: 0|req: 208/389] 10.222.0.49 () {60 vars in 1288 bytes} [Tue Dec 14 13:00:09 2021] GET /compute/v2.1/servers/c8de7730-62f2-4a77-b1e9-cf6a74fa366d/ips => generated 152 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 14 13:00:09.514196 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: INFO nova.api.openstack.requestlog [None req-5ea66ec8-8350-48d5-9cc6-b879901dc559 tempest-AttachVolumeNegativeTest-1000400951 tempest-AttachVolumeNegativeTest-1000400951-project] 10.222.0.49 "GET /compute/v2.1/servers/e79e4c5e-a1c6-4f80-9a63-d340231e3359" status: 200 len: 1288 microversion: 2.1 time: 0.142484 Dec 14 13:00:09.516445 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: [pid: 116064|app: 0|req: 182/390] 10.222.0.49 () {58 vars in 1235 bytes} [Tue Dec 14 13:00:09 2021] GET /compute/v2.1/servers/e79e4c5e-a1c6-4f80-9a63-d340231e3359 => generated 1288 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 14 13:00:10.481261 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.api.openstack.wsgi [None req-a7115e23-cf79-4da4-a63d-9c33e6585fb7 tempest-ServerRescueNegativeTestJSON-1573931620 tempest-ServerRescueNegativeTestJSON-1573931620-project] Calling method '>' {{(pid=116063) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 13:00:10.482575 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.compute.api [None req-a7115e23-cf79-4da4-a63d-9c33e6585fb7 tempest-ServerRescueNegativeTestJSON-1573931620 tempest-ServerRescueNegativeTestJSON-1573931620-project] [instance: eb6e04a4-8901-47df-9b51-7c1664bd3f6c] Fetching instance by UUID {{(pid=116063) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 13:00:10.492021 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-a7115e23-cf79-4da4-a63d-9c33e6585fb7 tempest-ServerRescueNegativeTestJSON-1573931620 tempest-ServerRescueNegativeTestJSON-1573931620-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 13:00:10.492777 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-a7115e23-cf79-4da4-a63d-9c33e6585fb7 tempest-ServerRescueNegativeTestJSON-1573931620 tempest-ServerRescueNegativeTestJSON-1573931620-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 13:00:10.493829 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-a7115e23-cf79-4da4-a63d-9c33e6585fb7 tempest-ServerRescueNegativeTestJSON-1573931620 tempest-ServerRescueNegativeTestJSON-1573931620-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 13:00:10.494449 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-a7115e23-cf79-4da4-a63d-9c33e6585fb7 tempest-ServerRescueNegativeTestJSON-1573931620 tempest-ServerRescueNegativeTestJSON-1573931620-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 13:00:10.535676 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.api.openstack.wsgi [None req-ff9bb845-d99a-4945-8b09-7f0a76b2bb28 tempest-AttachVolumeNegativeTest-1000400951 tempest-AttachVolumeNegativeTest-1000400951-project] Calling method '>' {{(pid=116064) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 13:00:10.537411 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.compute.api [None req-ff9bb845-d99a-4945-8b09-7f0a76b2bb28 tempest-AttachVolumeNegativeTest-1000400951 tempest-AttachVolumeNegativeTest-1000400951-project] [instance: e79e4c5e-a1c6-4f80-9a63-d340231e3359] Fetching instance by UUID {{(pid=116064) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 13:00:10.549386 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-ff9bb845-d99a-4945-8b09-7f0a76b2bb28 tempest-AttachVolumeNegativeTest-1000400951 tempest-AttachVolumeNegativeTest-1000400951-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 13:00:10.550367 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-ff9bb845-d99a-4945-8b09-7f0a76b2bb28 tempest-AttachVolumeNegativeTest-1000400951 tempest-AttachVolumeNegativeTest-1000400951-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 13:00:10.553460 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-ff9bb845-d99a-4945-8b09-7f0a76b2bb28 tempest-AttachVolumeNegativeTest-1000400951 tempest-AttachVolumeNegativeTest-1000400951-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 13:00:10.554122 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-ff9bb845-d99a-4945-8b09-7f0a76b2bb28 tempest-AttachVolumeNegativeTest-1000400951 tempest-AttachVolumeNegativeTest-1000400951-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 13:00:10.669132 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.policy [None req-a7115e23-cf79-4da4-a63d-9c33e6585fb7 tempest-ServerRescueNegativeTestJSON-1573931620 tempest-ServerRescueNegativeTestJSON-1573931620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '731cbbfe17214ded8ac66299d66dfc45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '010919ea84eb4eb8b936c63153600eba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116063) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 13:00:10.678071 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: INFO nova.api.openstack.requestlog [None req-a7115e23-cf79-4da4-a63d-9c33e6585fb7 tempest-ServerRescueNegativeTestJSON-1573931620 tempest-ServerRescueNegativeTestJSON-1573931620-project] 10.222.0.49 "GET /compute/v2.1/servers/eb6e04a4-8901-47df-9b51-7c1664bd3f6c" status: 200 len: 1523 microversion: 2.1 time: 0.208823 Dec 14 13:00:10.678967 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: [pid: 116063|app: 0|req: 209/391] 10.222.0.49 () {58 vars in 1235 bytes} [Tue Dec 14 13:00:10 2021] GET /compute/v2.1/servers/eb6e04a4-8901-47df-9b51-7c1664bd3f6c => generated 1523 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 14 13:00:10.758273 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.policy [None req-ff9bb845-d99a-4945-8b09-7f0a76b2bb28 tempest-AttachVolumeNegativeTest-1000400951 tempest-AttachVolumeNegativeTest-1000400951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57d0ec01f0784c8ea87d339980bed3cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad27b8951cae4eeeafa257f45217653a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116064) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 13:00:10.769214 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: INFO nova.api.openstack.requestlog [None req-ff9bb845-d99a-4945-8b09-7f0a76b2bb28 tempest-AttachVolumeNegativeTest-1000400951 tempest-AttachVolumeNegativeTest-1000400951-project] 10.222.0.49 "GET /compute/v2.1/servers/e79e4c5e-a1c6-4f80-9a63-d340231e3359" status: 200 len: 1318 microversion: 2.1 time: 0.237840 Dec 14 13:00:10.778723 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: [pid: 116064|app: 0|req: 183/392] 10.222.0.49 () {58 vars in 1235 bytes} [Tue Dec 14 13:00:10 2021] GET /compute/v2.1/servers/e79e4c5e-a1c6-4f80-9a63-d340231e3359 => generated 1318 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 14 13:00:11.009930 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.api.openstack.wsgi [req-b0456305-cf83-405a-9dfc-1e173dafe03c req-3b362160-bb40-4316-9120-694363b6787a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e79e4c5e-a1c6-4f80-9a63-d340231e3359", "tag": "bf021cb5-24d6-405a-94a5-01c51e16436f"}]} {{(pid=116063) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 14 13:00:11.010375 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 14 13:00:11.010375 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: warnings.warn(msg) Dec 14 13:00:11.017966 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [req-b0456305-cf83-405a-9dfc-1e173dafe03c req-3b362160-bb40-4316-9120-694363b6787a service nova] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 13:00:11.018823 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [req-b0456305-cf83-405a-9dfc-1e173dafe03c req-3b362160-bb40-4316-9120-694363b6787a service nova] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 13:00:11.031461 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: INFO nova.api.openstack.compute.server_external_events [req-b0456305-cf83-405a-9dfc-1e173dafe03c req-3b362160-bb40-4316-9120-694363b6787a service nova] Creating event network-changed:bf021cb5-24d6-405a-94a5-01c51e16436f for instance e79e4c5e-a1c6-4f80-9a63-d340231e3359 on hv-cinder-78447 Dec 14 13:00:11.037045 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: INFO nova.api.openstack.requestlog [req-b0456305-cf83-405a-9dfc-1e173dafe03c req-3b362160-bb40-4316-9120-694363b6787a service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032468 Dec 14 13:00:11.038272 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: [pid: 116063|app: 0|req: 210/393] 10.222.0.49 () {64 vars in 1317 bytes} [Tue Dec 14 13:00:11 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 14 13:00:11.698690 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.api.openstack.wsgi [None req-49c769b8-ce4c-44f8-9235-8eda99da0ca9 tempest-ServerRescueNegativeTestJSON-1573931620 tempest-ServerRescueNegativeTestJSON-1573931620-project] Calling method '>' {{(pid=116064) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 13:00:11.699372 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.compute.api [None req-49c769b8-ce4c-44f8-9235-8eda99da0ca9 tempest-ServerRescueNegativeTestJSON-1573931620 tempest-ServerRescueNegativeTestJSON-1573931620-project] [instance: eb6e04a4-8901-47df-9b51-7c1664bd3f6c] Fetching instance by UUID {{(pid=116064) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 13:00:11.706499 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-49c769b8-ce4c-44f8-9235-8eda99da0ca9 tempest-ServerRescueNegativeTestJSON-1573931620 tempest-ServerRescueNegativeTestJSON-1573931620-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 13:00:11.707304 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-49c769b8-ce4c-44f8-9235-8eda99da0ca9 tempest-ServerRescueNegativeTestJSON-1573931620 tempest-ServerRescueNegativeTestJSON-1573931620-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 13:00:11.708319 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-49c769b8-ce4c-44f8-9235-8eda99da0ca9 tempest-ServerRescueNegativeTestJSON-1573931620 tempest-ServerRescueNegativeTestJSON-1573931620-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 13:00:11.708965 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-49c769b8-ce4c-44f8-9235-8eda99da0ca9 tempest-ServerRescueNegativeTestJSON-1573931620 tempest-ServerRescueNegativeTestJSON-1573931620-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 13:00:11.787090 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.api.openstack.wsgi [None req-f4dd57af-85f2-48fb-9d63-ab5552e801b5 tempest-AttachVolumeNegativeTest-1000400951 tempest-AttachVolumeNegativeTest-1000400951-project] Calling method '>' {{(pid=116063) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 13:00:11.787777 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.compute.api [None req-f4dd57af-85f2-48fb-9d63-ab5552e801b5 tempest-AttachVolumeNegativeTest-1000400951 tempest-AttachVolumeNegativeTest-1000400951-project] [instance: e79e4c5e-a1c6-4f80-9a63-d340231e3359] Fetching instance by UUID {{(pid=116063) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 13:00:11.795060 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-f4dd57af-85f2-48fb-9d63-ab5552e801b5 tempest-AttachVolumeNegativeTest-1000400951 tempest-AttachVolumeNegativeTest-1000400951-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 13:00:11.795583 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-f4dd57af-85f2-48fb-9d63-ab5552e801b5 tempest-AttachVolumeNegativeTest-1000400951 tempest-AttachVolumeNegativeTest-1000400951-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 13:00:11.796315 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-f4dd57af-85f2-48fb-9d63-ab5552e801b5 tempest-AttachVolumeNegativeTest-1000400951 tempest-AttachVolumeNegativeTest-1000400951-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 13:00:11.797161 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-f4dd57af-85f2-48fb-9d63-ab5552e801b5 tempest-AttachVolumeNegativeTest-1000400951 tempest-AttachVolumeNegativeTest-1000400951-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 13:00:11.951204 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.policy [None req-49c769b8-ce4c-44f8-9235-8eda99da0ca9 tempest-ServerRescueNegativeTestJSON-1573931620 tempest-ServerRescueNegativeTestJSON-1573931620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '731cbbfe17214ded8ac66299d66dfc45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '010919ea84eb4eb8b936c63153600eba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116064) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 13:00:11.973290 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: INFO nova.api.openstack.requestlog [None req-49c769b8-ce4c-44f8-9235-8eda99da0ca9 tempest-ServerRescueNegativeTestJSON-1573931620 tempest-ServerRescueNegativeTestJSON-1573931620-project] 10.222.0.49 "GET /compute/v2.1/servers/eb6e04a4-8901-47df-9b51-7c1664bd3f6c" status: 200 len: 1523 microversion: 2.1 time: 0.277760 Dec 14 13:00:11.974383 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: [pid: 116064|app: 0|req: 184/394] 10.222.0.49 () {58 vars in 1235 bytes} [Tue Dec 14 13:00:11 2021] GET /compute/v2.1/servers/eb6e04a4-8901-47df-9b51-7c1664bd3f6c => generated 1523 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 14 13:00:12.042986 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.policy [None req-f4dd57af-85f2-48fb-9d63-ab5552e801b5 tempest-AttachVolumeNegativeTest-1000400951 tempest-AttachVolumeNegativeTest-1000400951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57d0ec01f0784c8ea87d339980bed3cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad27b8951cae4eeeafa257f45217653a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116063) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 13:00:12.052296 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: INFO nova.api.openstack.requestlog [None req-f4dd57af-85f2-48fb-9d63-ab5552e801b5 tempest-AttachVolumeNegativeTest-1000400951 tempest-AttachVolumeNegativeTest-1000400951-project] 10.222.0.49 "GET /compute/v2.1/servers/e79e4c5e-a1c6-4f80-9a63-d340231e3359" status: 200 len: 1318 microversion: 2.1 time: 0.269199 Dec 14 13:00:12.053413 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: [pid: 116063|app: 0|req: 211/395] 10.222.0.49 () {58 vars in 1235 bytes} [Tue Dec 14 13:00:11 2021] GET /compute/v2.1/servers/e79e4c5e-a1c6-4f80-9a63-d340231e3359 => generated 1318 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 14 13:00:12.392350 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.api.openstack.wsgi [None req-6cb57c6c-ee65-497b-89c0-740116cfd559 tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=116064) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 14 13:00:12.393747 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.compute.api [None req-6cb57c6c-ee65-497b-89c0-740116cfd559 tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] [instance: c8de7730-62f2-4a77-b1e9-cf6a74fa366d] Fetching instance by UUID {{(pid=116064) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 13:00:12.401403 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-6cb57c6c-ee65-497b-89c0-740116cfd559 tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 13:00:12.402210 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-6cb57c6c-ee65-497b-89c0-740116cfd559 tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 13:00:12.403340 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-6cb57c6c-ee65-497b-89c0-740116cfd559 tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 13:00:12.404283 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-6cb57c6c-ee65-497b-89c0-740116cfd559 tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 13:00:12.444657 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.objects.instance [None req-6cb57c6c-ee65-497b-89c0-740116cfd559 tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] Lazy-loading 'flavor' on Instance uuid c8de7730-62f2-4a77-b1e9-cf6a74fa366d {{(pid=116064) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Dec 14 13:00:12.874997 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: INFO nova.api.openstack.requestlog [None req-6cb57c6c-ee65-497b-89c0-740116cfd559 tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] 10.222.0.49 "POST /compute/v2.1/servers/c8de7730-62f2-4a77-b1e9-cf6a74fa366d/action" status: 202 len: 0 microversion: 2.20 time: 0.486561 Dec 14 13:00:12.880324 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: [pid: 116064|app: 0|req: 185/396] 10.222.0.49 () {62 vars in 1318 bytes} [Tue Dec 14 13:00:12 2021] POST /compute/v2.1/servers/c8de7730-62f2-4a77-b1e9-cf6a74fa366d/action => generated 0 bytes in 493 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Dec 14 13:00:12.886048 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.api.openstack.wsgi [None req-85d31f30-f7a1-4f8b-9ad2-d0a8ba54ed5f tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] Calling method '>' {{(pid=116063) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 13:00:12.886597 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.compute.api [None req-85d31f30-f7a1-4f8b-9ad2-d0a8ba54ed5f tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] [instance: c8de7730-62f2-4a77-b1e9-cf6a74fa366d] Fetching instance by UUID {{(pid=116063) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 13:00:12.894533 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-85d31f30-f7a1-4f8b-9ad2-d0a8ba54ed5f tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 13:00:12.895200 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-85d31f30-f7a1-4f8b-9ad2-d0a8ba54ed5f tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 13:00:12.896176 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-85d31f30-f7a1-4f8b-9ad2-d0a8ba54ed5f tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 13:00:12.896762 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-85d31f30-f7a1-4f8b-9ad2-d0a8ba54ed5f tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 13:00:12.992431 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.api.openstack.wsgi [None req-5b962790-9bc7-4837-92bd-fd45e7619596 tempest-ServerRescueNegativeTestJSON-1573931620 tempest-ServerRescueNegativeTestJSON-1573931620-project] Calling method '>' {{(pid=116064) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 13:00:13.006258 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.compute.api [None req-5b962790-9bc7-4837-92bd-fd45e7619596 tempest-ServerRescueNegativeTestJSON-1573931620 tempest-ServerRescueNegativeTestJSON-1573931620-project] [instance: eb6e04a4-8901-47df-9b51-7c1664bd3f6c] Fetching instance by UUID {{(pid=116064) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 13:00:13.018849 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-5b962790-9bc7-4837-92bd-fd45e7619596 tempest-ServerRescueNegativeTestJSON-1573931620 tempest-ServerRescueNegativeTestJSON-1573931620-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 13:00:13.021824 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-5b962790-9bc7-4837-92bd-fd45e7619596 tempest-ServerRescueNegativeTestJSON-1573931620 tempest-ServerRescueNegativeTestJSON-1573931620-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 13:00:13.025272 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-5b962790-9bc7-4837-92bd-fd45e7619596 tempest-ServerRescueNegativeTestJSON-1573931620 tempest-ServerRescueNegativeTestJSON-1573931620-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 13:00:13.026359 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-5b962790-9bc7-4837-92bd-fd45e7619596 tempest-ServerRescueNegativeTestJSON-1573931620 tempest-ServerRescueNegativeTestJSON-1573931620-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 13:00:13.079437 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.policy [None req-85d31f30-f7a1-4f8b-9ad2-d0a8ba54ed5f tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79d74a2ea1e541d28d085c15cec34032', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68a8770b8dbe489a8119016fbee64eb5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116063) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 13:00:13.105863 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.policy [None req-85d31f30-f7a1-4f8b-9ad2-d0a8ba54ed5f tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '79d74a2ea1e541d28d085c15cec34032', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68a8770b8dbe489a8119016fbee64eb5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116063) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 13:00:13.110482 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.policy [None req-85d31f30-f7a1-4f8b-9ad2-d0a8ba54ed5f tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '79d74a2ea1e541d28d085c15cec34032', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68a8770b8dbe489a8119016fbee64eb5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116063) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 13:00:13.114347 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: INFO nova.api.openstack.requestlog [None req-85d31f30-f7a1-4f8b-9ad2-d0a8ba54ed5f tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] 10.222.0.49 "GET /compute/v2.1/servers/c8de7730-62f2-4a77-b1e9-cf6a74fa366d" status: 200 len: 1724 microversion: 2.20 time: 0.232008 Dec 14 13:00:13.115177 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: [pid: 116063|app: 0|req: 212/397] 10.222.0.49 () {60 vars in 1276 bytes} [Tue Dec 14 13:00:12 2021] GET /compute/v2.1/servers/c8de7730-62f2-4a77-b1e9-cf6a74fa366d => generated 1724 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 14 13:00:13.150055 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.api.openstack.wsgi [None req-9912a5de-9a9e-4b99-8f19-cc9a7deeae89 tempest-AttachVolumeNegativeTest-1000400951 tempest-AttachVolumeNegativeTest-1000400951-project] Calling method '>' {{(pid=116063) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 13:00:13.156218 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.compute.api [None req-9912a5de-9a9e-4b99-8f19-cc9a7deeae89 tempest-AttachVolumeNegativeTest-1000400951 tempest-AttachVolumeNegativeTest-1000400951-project] [instance: e79e4c5e-a1c6-4f80-9a63-d340231e3359] Fetching instance by UUID {{(pid=116063) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 13:00:13.175339 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-9912a5de-9a9e-4b99-8f19-cc9a7deeae89 tempest-AttachVolumeNegativeTest-1000400951 tempest-AttachVolumeNegativeTest-1000400951-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 13:00:13.177819 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-9912a5de-9a9e-4b99-8f19-cc9a7deeae89 tempest-AttachVolumeNegativeTest-1000400951 tempest-AttachVolumeNegativeTest-1000400951-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 13:00:13.179133 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-9912a5de-9a9e-4b99-8f19-cc9a7deeae89 tempest-AttachVolumeNegativeTest-1000400951 tempest-AttachVolumeNegativeTest-1000400951-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 13:00:13.179536 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-9912a5de-9a9e-4b99-8f19-cc9a7deeae89 tempest-AttachVolumeNegativeTest-1000400951 tempest-AttachVolumeNegativeTest-1000400951-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 13:00:13.475562 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.policy [None req-5b962790-9bc7-4837-92bd-fd45e7619596 tempest-ServerRescueNegativeTestJSON-1573931620 tempest-ServerRescueNegativeTestJSON-1573931620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '731cbbfe17214ded8ac66299d66dfc45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '010919ea84eb4eb8b936c63153600eba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116064) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 13:00:13.483440 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: INFO nova.api.openstack.requestlog [None req-5b962790-9bc7-4837-92bd-fd45e7619596 tempest-ServerRescueNegativeTestJSON-1573931620 tempest-ServerRescueNegativeTestJSON-1573931620-project] 10.222.0.49 "GET /compute/v2.1/servers/eb6e04a4-8901-47df-9b51-7c1664bd3f6c" status: 200 len: 1523 microversion: 2.1 time: 0.495336 Dec 14 13:00:13.488103 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: [pid: 116064|app: 0|req: 186/398] 10.222.0.49 () {58 vars in 1235 bytes} [Tue Dec 14 13:00:12 2021] GET /compute/v2.1/servers/eb6e04a4-8901-47df-9b51-7c1664bd3f6c => generated 1523 bytes in 501 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 14 13:00:13.513122 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.policy [None req-9912a5de-9a9e-4b99-8f19-cc9a7deeae89 tempest-AttachVolumeNegativeTest-1000400951 tempest-AttachVolumeNegativeTest-1000400951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57d0ec01f0784c8ea87d339980bed3cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad27b8951cae4eeeafa257f45217653a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116063) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 13:00:13.523503 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: INFO nova.api.openstack.requestlog [None req-9912a5de-9a9e-4b99-8f19-cc9a7deeae89 tempest-AttachVolumeNegativeTest-1000400951 tempest-AttachVolumeNegativeTest-1000400951-project] 10.222.0.49 "GET /compute/v2.1/servers/e79e4c5e-a1c6-4f80-9a63-d340231e3359" status: 200 len: 1318 microversion: 2.1 time: 0.402729 Dec 14 13:00:13.524572 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: [pid: 116063|app: 0|req: 213/399] 10.222.0.49 () {58 vars in 1235 bytes} [Tue Dec 14 13:00:13 2021] GET /compute/v2.1/servers/e79e4c5e-a1c6-4f80-9a63-d340231e3359 => generated 1318 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 14 13:00:14.134863 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.api.openstack.wsgi [None req-355ffd1e-adb3-47f0-bfdb-efac4d40f67d tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] Calling method '>' {{(pid=116064) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 13:00:14.136085 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.compute.api [None req-355ffd1e-adb3-47f0-bfdb-efac4d40f67d tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] [instance: c8de7730-62f2-4a77-b1e9-cf6a74fa366d] Fetching instance by UUID {{(pid=116064) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 13:00:14.142393 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-355ffd1e-adb3-47f0-bfdb-efac4d40f67d tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 13:00:14.142881 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-355ffd1e-adb3-47f0-bfdb-efac4d40f67d tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 13:00:14.143698 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-355ffd1e-adb3-47f0-bfdb-efac4d40f67d tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 13:00:14.144136 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-355ffd1e-adb3-47f0-bfdb-efac4d40f67d tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 13:00:14.506023 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.api.openstack.wsgi [None req-dc962d2d-a1f5-4bad-865c-8f50a37b3d35 tempest-ServerRescueNegativeTestJSON-1573931620 tempest-ServerRescueNegativeTestJSON-1573931620-project] Calling method '>' {{(pid=116063) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 13:00:14.506835 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.compute.api [None req-dc962d2d-a1f5-4bad-865c-8f50a37b3d35 tempest-ServerRescueNegativeTestJSON-1573931620 tempest-ServerRescueNegativeTestJSON-1573931620-project] [instance: eb6e04a4-8901-47df-9b51-7c1664bd3f6c] Fetching instance by UUID {{(pid=116063) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 13:00:14.518115 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-dc962d2d-a1f5-4bad-865c-8f50a37b3d35 tempest-ServerRescueNegativeTestJSON-1573931620 tempest-ServerRescueNegativeTestJSON-1573931620-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 13:00:14.518576 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-dc962d2d-a1f5-4bad-865c-8f50a37b3d35 tempest-ServerRescueNegativeTestJSON-1573931620 tempest-ServerRescueNegativeTestJSON-1573931620-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 13:00:14.519892 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-dc962d2d-a1f5-4bad-865c-8f50a37b3d35 tempest-ServerRescueNegativeTestJSON-1573931620 tempest-ServerRescueNegativeTestJSON-1573931620-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 13:00:14.520963 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-dc962d2d-a1f5-4bad-865c-8f50a37b3d35 tempest-ServerRescueNegativeTestJSON-1573931620 tempest-ServerRescueNegativeTestJSON-1573931620-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 13:00:14.571014 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.policy [None req-355ffd1e-adb3-47f0-bfdb-efac4d40f67d tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79d74a2ea1e541d28d085c15cec34032', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68a8770b8dbe489a8119016fbee64eb5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116064) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 13:00:14.589261 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.policy [None req-355ffd1e-adb3-47f0-bfdb-efac4d40f67d tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '79d74a2ea1e541d28d085c15cec34032', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68a8770b8dbe489a8119016fbee64eb5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116064) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 13:00:14.591641 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.policy [None req-355ffd1e-adb3-47f0-bfdb-efac4d40f67d tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '79d74a2ea1e541d28d085c15cec34032', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68a8770b8dbe489a8119016fbee64eb5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116064) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 13:00:14.593031 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: INFO nova.api.openstack.requestlog [None req-355ffd1e-adb3-47f0-bfdb-efac4d40f67d tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] 10.222.0.49 "GET /compute/v2.1/servers/c8de7730-62f2-4a77-b1e9-cf6a74fa366d" status: 200 len: 1724 microversion: 2.20 time: 0.463049 Dec 14 13:00:14.595173 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: [pid: 116064|app: 0|req: 187/400] 10.222.0.49 () {60 vars in 1276 bytes} [Tue Dec 14 13:00:14 2021] GET /compute/v2.1/servers/c8de7730-62f2-4a77-b1e9-cf6a74fa366d => generated 1724 bytes in 466 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 14 13:00:14.601555 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.api.openstack.wsgi [None req-c3f63a6b-b591-4d3b-886c-724a4d43c30c tempest-AttachVolumeNegativeTest-1000400951 tempest-AttachVolumeNegativeTest-1000400951-project] Calling method '>' {{(pid=116064) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 13:00:14.603235 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.compute.api [None req-c3f63a6b-b591-4d3b-886c-724a4d43c30c tempest-AttachVolumeNegativeTest-1000400951 tempest-AttachVolumeNegativeTest-1000400951-project] [instance: e79e4c5e-a1c6-4f80-9a63-d340231e3359] Fetching instance by UUID {{(pid=116064) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 13:00:14.615113 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-c3f63a6b-b591-4d3b-886c-724a4d43c30c tempest-AttachVolumeNegativeTest-1000400951 tempest-AttachVolumeNegativeTest-1000400951-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 13:00:14.616220 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-c3f63a6b-b591-4d3b-886c-724a4d43c30c tempest-AttachVolumeNegativeTest-1000400951 tempest-AttachVolumeNegativeTest-1000400951-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 13:00:14.617784 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-c3f63a6b-b591-4d3b-886c-724a4d43c30c tempest-AttachVolumeNegativeTest-1000400951 tempest-AttachVolumeNegativeTest-1000400951-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 13:00:14.619541 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-c3f63a6b-b591-4d3b-886c-724a4d43c30c tempest-AttachVolumeNegativeTest-1000400951 tempest-AttachVolumeNegativeTest-1000400951-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 13:00:14.876385 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.policy [None req-c3f63a6b-b591-4d3b-886c-724a4d43c30c tempest-AttachVolumeNegativeTest-1000400951 tempest-AttachVolumeNegativeTest-1000400951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57d0ec01f0784c8ea87d339980bed3cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad27b8951cae4eeeafa257f45217653a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116064) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 13:00:14.884028 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.policy [None req-dc962d2d-a1f5-4bad-865c-8f50a37b3d35 tempest-ServerRescueNegativeTestJSON-1573931620 tempest-ServerRescueNegativeTestJSON-1573931620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '731cbbfe17214ded8ac66299d66dfc45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '010919ea84eb4eb8b936c63153600eba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116063) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 13:00:14.891827 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: INFO nova.api.openstack.requestlog [None req-dc962d2d-a1f5-4bad-865c-8f50a37b3d35 tempest-ServerRescueNegativeTestJSON-1573931620 tempest-ServerRescueNegativeTestJSON-1573931620-project] 10.222.0.49 "GET /compute/v2.1/servers/eb6e04a4-8901-47df-9b51-7c1664bd3f6c" status: 200 len: 1523 microversion: 2.1 time: 0.391567 Dec 14 13:00:14.893981 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: [pid: 116063|app: 0|req: 214/401] 10.222.0.49 () {58 vars in 1235 bytes} [Tue Dec 14 13:00:14 2021] GET /compute/v2.1/servers/eb6e04a4-8901-47df-9b51-7c1664bd3f6c => generated 1523 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 14 13:00:14.898284 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: INFO nova.api.openstack.requestlog [None req-c3f63a6b-b591-4d3b-886c-724a4d43c30c tempest-AttachVolumeNegativeTest-1000400951 tempest-AttachVolumeNegativeTest-1000400951-project] 10.222.0.49 "GET /compute/v2.1/servers/e79e4c5e-a1c6-4f80-9a63-d340231e3359" status: 200 len: 1318 microversion: 2.1 time: 0.301463 Dec 14 13:00:14.900950 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: [pid: 116064|app: 0|req: 188/402] 10.222.0.49 () {58 vars in 1235 bytes} [Tue Dec 14 13:00:14 2021] GET /compute/v2.1/servers/e79e4c5e-a1c6-4f80-9a63-d340231e3359 => generated 1318 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 14 13:00:15.614247 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.api.openstack.wsgi [None req-43a7ab8e-f7b4-4dd7-bb29-d602581a8fee tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] Calling method '>' {{(pid=116063) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 13:00:15.615855 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.compute.api [None req-43a7ab8e-f7b4-4dd7-bb29-d602581a8fee tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] [instance: c8de7730-62f2-4a77-b1e9-cf6a74fa366d] Fetching instance by UUID {{(pid=116063) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 13:00:15.623862 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-43a7ab8e-f7b4-4dd7-bb29-d602581a8fee tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 13:00:15.624549 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-43a7ab8e-f7b4-4dd7-bb29-d602581a8fee tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 13:00:15.625886 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-43a7ab8e-f7b4-4dd7-bb29-d602581a8fee tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 13:00:15.626751 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-43a7ab8e-f7b4-4dd7-bb29-d602581a8fee tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 13:00:15.776073 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.policy [None req-43a7ab8e-f7b4-4dd7-bb29-d602581a8fee tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79d74a2ea1e541d28d085c15cec34032', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68a8770b8dbe489a8119016fbee64eb5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116063) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 13:00:15.789246 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.policy [None req-43a7ab8e-f7b4-4dd7-bb29-d602581a8fee tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '79d74a2ea1e541d28d085c15cec34032', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68a8770b8dbe489a8119016fbee64eb5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116063) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 13:00:15.793141 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.policy [None req-43a7ab8e-f7b4-4dd7-bb29-d602581a8fee tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '79d74a2ea1e541d28d085c15cec34032', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68a8770b8dbe489a8119016fbee64eb5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116063) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 13:00:15.794641 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: INFO nova.api.openstack.requestlog [None req-43a7ab8e-f7b4-4dd7-bb29-d602581a8fee tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] 10.222.0.49 "GET /compute/v2.1/servers/c8de7730-62f2-4a77-b1e9-cf6a74fa366d" status: 200 len: 1724 microversion: 2.20 time: 0.185695 Dec 14 13:00:15.808035 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: [pid: 116063|app: 0|req: 215/403] 10.222.0.49 () {60 vars in 1276 bytes} [Tue Dec 14 13:00:15 2021] GET /compute/v2.1/servers/c8de7730-62f2-4a77-b1e9-cf6a74fa366d => generated 1724 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 14 13:00:15.916953 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.api.openstack.wsgi [None req-c49016d8-f448-47e8-965c-6d1eac79a624 tempest-ServerRescueNegativeTestJSON-1573931620 tempest-ServerRescueNegativeTestJSON-1573931620-project] Calling method '>' {{(pid=116064) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 13:00:15.917590 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.api.openstack.wsgi [None req-cc5bd43a-63ff-430d-883b-6307cf90b89a tempest-AttachVolumeNegativeTest-1000400951 tempest-AttachVolumeNegativeTest-1000400951-project] Calling method '>' {{(pid=116063) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 13:00:15.918363 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.compute.api [None req-cc5bd43a-63ff-430d-883b-6307cf90b89a tempest-AttachVolumeNegativeTest-1000400951 tempest-AttachVolumeNegativeTest-1000400951-project] [instance: e79e4c5e-a1c6-4f80-9a63-d340231e3359] Fetching instance by UUID {{(pid=116063) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 13:00:15.919130 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.compute.api [None req-c49016d8-f448-47e8-965c-6d1eac79a624 tempest-ServerRescueNegativeTestJSON-1573931620 tempest-ServerRescueNegativeTestJSON-1573931620-project] [instance: eb6e04a4-8901-47df-9b51-7c1664bd3f6c] Fetching instance by UUID {{(pid=116064) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 13:00:15.926695 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-cc5bd43a-63ff-430d-883b-6307cf90b89a tempest-AttachVolumeNegativeTest-1000400951 tempest-AttachVolumeNegativeTest-1000400951-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 13:00:15.927279 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-cc5bd43a-63ff-430d-883b-6307cf90b89a tempest-AttachVolumeNegativeTest-1000400951 tempest-AttachVolumeNegativeTest-1000400951-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 13:00:15.928168 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-cc5bd43a-63ff-430d-883b-6307cf90b89a tempest-AttachVolumeNegativeTest-1000400951 tempest-AttachVolumeNegativeTest-1000400951-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 13:00:15.928320 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-c49016d8-f448-47e8-965c-6d1eac79a624 tempest-ServerRescueNegativeTestJSON-1573931620 tempest-ServerRescueNegativeTestJSON-1573931620-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 13:00:15.928725 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-cc5bd43a-63ff-430d-883b-6307cf90b89a tempest-AttachVolumeNegativeTest-1000400951 tempest-AttachVolumeNegativeTest-1000400951-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 13:00:15.928957 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-c49016d8-f448-47e8-965c-6d1eac79a624 tempest-ServerRescueNegativeTestJSON-1573931620 tempest-ServerRescueNegativeTestJSON-1573931620-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 13:00:15.929581 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-c49016d8-f448-47e8-965c-6d1eac79a624 tempest-ServerRescueNegativeTestJSON-1573931620 tempest-ServerRescueNegativeTestJSON-1573931620-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 13:00:15.930011 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-c49016d8-f448-47e8-965c-6d1eac79a624 tempest-ServerRescueNegativeTestJSON-1573931620 tempest-ServerRescueNegativeTestJSON-1573931620-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 13:00:16.130444 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.policy [None req-c49016d8-f448-47e8-965c-6d1eac79a624 tempest-ServerRescueNegativeTestJSON-1573931620 tempest-ServerRescueNegativeTestJSON-1573931620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '731cbbfe17214ded8ac66299d66dfc45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '010919ea84eb4eb8b936c63153600eba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116064) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 13:00:16.137885 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.policy [None req-cc5bd43a-63ff-430d-883b-6307cf90b89a tempest-AttachVolumeNegativeTest-1000400951 tempest-AttachVolumeNegativeTest-1000400951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57d0ec01f0784c8ea87d339980bed3cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad27b8951cae4eeeafa257f45217653a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116063) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 13:00:16.139650 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: INFO nova.api.openstack.requestlog [None req-c49016d8-f448-47e8-965c-6d1eac79a624 tempest-ServerRescueNegativeTestJSON-1573931620 tempest-ServerRescueNegativeTestJSON-1573931620-project] 10.222.0.49 "GET /compute/v2.1/servers/eb6e04a4-8901-47df-9b51-7c1664bd3f6c" status: 200 len: 1523 microversion: 2.1 time: 0.231653 Dec 14 13:00:16.149192 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: [pid: 116064|app: 0|req: 189/404] 10.222.0.49 () {58 vars in 1235 bytes} [Tue Dec 14 13:00:15 2021] GET /compute/v2.1/servers/eb6e04a4-8901-47df-9b51-7c1664bd3f6c => generated 1523 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 14 13:00:16.149405 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: INFO nova.api.openstack.requestlog [None req-cc5bd43a-63ff-430d-883b-6307cf90b89a tempest-AttachVolumeNegativeTest-1000400951 tempest-AttachVolumeNegativeTest-1000400951-project] 10.222.0.49 "GET /compute/v2.1/servers/e79e4c5e-a1c6-4f80-9a63-d340231e3359" status: 200 len: 1318 microversion: 2.1 time: 0.235688 Dec 14 13:00:16.155454 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: [pid: 116063|app: 0|req: 216/405] 10.222.0.49 () {58 vars in 1235 bytes} [Tue Dec 14 13:00:15 2021] GET /compute/v2.1/servers/e79e4c5e-a1c6-4f80-9a63-d340231e3359 => generated 1318 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 14 13:00:16.815221 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.api.openstack.wsgi [None req-2ff21464-b820-4d4c-ae80-8bdd9eb3ce41 tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] Calling method '>' {{(pid=116064) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 13:00:16.815956 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.compute.api [None req-2ff21464-b820-4d4c-ae80-8bdd9eb3ce41 tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] [instance: c8de7730-62f2-4a77-b1e9-cf6a74fa366d] Fetching instance by UUID {{(pid=116064) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 13:00:16.822565 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-2ff21464-b820-4d4c-ae80-8bdd9eb3ce41 tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 13:00:16.822832 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-2ff21464-b820-4d4c-ae80-8bdd9eb3ce41 tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 13:00:16.823619 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-2ff21464-b820-4d4c-ae80-8bdd9eb3ce41 tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 13:00:16.824058 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-2ff21464-b820-4d4c-ae80-8bdd9eb3ce41 tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 13:00:16.955200 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.policy [None req-2ff21464-b820-4d4c-ae80-8bdd9eb3ce41 tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79d74a2ea1e541d28d085c15cec34032', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68a8770b8dbe489a8119016fbee64eb5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116064) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 13:00:16.963624 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.policy [None req-2ff21464-b820-4d4c-ae80-8bdd9eb3ce41 tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '79d74a2ea1e541d28d085c15cec34032', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68a8770b8dbe489a8119016fbee64eb5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116064) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 13:00:16.965160 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.policy [None req-2ff21464-b820-4d4c-ae80-8bdd9eb3ce41 tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '79d74a2ea1e541d28d085c15cec34032', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68a8770b8dbe489a8119016fbee64eb5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116064) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 13:00:16.966357 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: INFO nova.api.openstack.requestlog [None req-2ff21464-b820-4d4c-ae80-8bdd9eb3ce41 tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] 10.222.0.49 "GET /compute/v2.1/servers/c8de7730-62f2-4a77-b1e9-cf6a74fa366d" status: 200 len: 1724 microversion: 2.20 time: 0.154887 Dec 14 13:00:16.966907 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: [pid: 116064|app: 0|req: 190/406] 10.222.0.49 () {60 vars in 1276 bytes} [Tue Dec 14 13:00:16 2021] GET /compute/v2.1/servers/c8de7730-62f2-4a77-b1e9-cf6a74fa366d => generated 1724 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 14 13:00:17.160335 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.api.openstack.wsgi [None req-611ea86c-5e40-48ac-956a-bfcc2cd42574 tempest-ServerRescueNegativeTestJSON-1573931620 tempest-ServerRescueNegativeTestJSON-1573931620-project] Calling method '>' {{(pid=116063) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 13:00:17.161013 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.compute.api [None req-611ea86c-5e40-48ac-956a-bfcc2cd42574 tempest-ServerRescueNegativeTestJSON-1573931620 tempest-ServerRescueNegativeTestJSON-1573931620-project] [instance: eb6e04a4-8901-47df-9b51-7c1664bd3f6c] Fetching instance by UUID {{(pid=116063) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 13:00:17.164135 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.api.openstack.wsgi [None req-53c67b97-4007-4dbf-aed0-4972faf7912b tempest-AttachVolumeNegativeTest-1000400951 tempest-AttachVolumeNegativeTest-1000400951-project] Calling method '>' {{(pid=116064) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 13:00:17.169195 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.compute.api [None req-53c67b97-4007-4dbf-aed0-4972faf7912b tempest-AttachVolumeNegativeTest-1000400951 tempest-AttachVolumeNegativeTest-1000400951-project] [instance: e79e4c5e-a1c6-4f80-9a63-d340231e3359] Fetching instance by UUID {{(pid=116064) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 13:00:17.169388 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-611ea86c-5e40-48ac-956a-bfcc2cd42574 tempest-ServerRescueNegativeTestJSON-1573931620 tempest-ServerRescueNegativeTestJSON-1573931620-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 13:00:17.169388 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-611ea86c-5e40-48ac-956a-bfcc2cd42574 tempest-ServerRescueNegativeTestJSON-1573931620 tempest-ServerRescueNegativeTestJSON-1573931620-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 13:00:17.170274 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-611ea86c-5e40-48ac-956a-bfcc2cd42574 tempest-ServerRescueNegativeTestJSON-1573931620 tempest-ServerRescueNegativeTestJSON-1573931620-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 13:00:17.170822 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-611ea86c-5e40-48ac-956a-bfcc2cd42574 tempest-ServerRescueNegativeTestJSON-1573931620 tempest-ServerRescueNegativeTestJSON-1573931620-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 13:00:17.172727 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-53c67b97-4007-4dbf-aed0-4972faf7912b tempest-AttachVolumeNegativeTest-1000400951 tempest-AttachVolumeNegativeTest-1000400951-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 13:00:17.173335 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-53c67b97-4007-4dbf-aed0-4972faf7912b tempest-AttachVolumeNegativeTest-1000400951 tempest-AttachVolumeNegativeTest-1000400951-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 13:00:17.174344 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-53c67b97-4007-4dbf-aed0-4972faf7912b tempest-AttachVolumeNegativeTest-1000400951 tempest-AttachVolumeNegativeTest-1000400951-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 13:00:17.174889 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-53c67b97-4007-4dbf-aed0-4972faf7912b tempest-AttachVolumeNegativeTest-1000400951 tempest-AttachVolumeNegativeTest-1000400951-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 13:00:17.368380 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.policy [None req-53c67b97-4007-4dbf-aed0-4972faf7912b tempest-AttachVolumeNegativeTest-1000400951 tempest-AttachVolumeNegativeTest-1000400951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57d0ec01f0784c8ea87d339980bed3cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad27b8951cae4eeeafa257f45217653a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116064) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 13:00:17.372689 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.policy [None req-611ea86c-5e40-48ac-956a-bfcc2cd42574 tempest-ServerRescueNegativeTestJSON-1573931620 tempest-ServerRescueNegativeTestJSON-1573931620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '731cbbfe17214ded8ac66299d66dfc45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '010919ea84eb4eb8b936c63153600eba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116063) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 13:00:17.378293 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: INFO nova.api.openstack.requestlog [None req-53c67b97-4007-4dbf-aed0-4972faf7912b tempest-AttachVolumeNegativeTest-1000400951 tempest-AttachVolumeNegativeTest-1000400951-project] 10.222.0.49 "GET /compute/v2.1/servers/e79e4c5e-a1c6-4f80-9a63-d340231e3359" status: 200 len: 1318 microversion: 2.1 time: 0.218343 Dec 14 13:00:17.379029 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: [pid: 116064|app: 0|req: 191/407] 10.222.0.49 () {58 vars in 1235 bytes} [Tue Dec 14 13:00:17 2021] GET /compute/v2.1/servers/e79e4c5e-a1c6-4f80-9a63-d340231e3359 => generated 1318 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 14 13:00:17.382868 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: INFO nova.api.openstack.requestlog [None req-611ea86c-5e40-48ac-956a-bfcc2cd42574 tempest-ServerRescueNegativeTestJSON-1573931620 tempest-ServerRescueNegativeTestJSON-1573931620-project] 10.222.0.49 "GET /compute/v2.1/servers/eb6e04a4-8901-47df-9b51-7c1664bd3f6c" status: 200 len: 1523 microversion: 2.1 time: 0.228310 Dec 14 13:00:17.383657 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: [pid: 116063|app: 0|req: 217/408] 10.222.0.49 () {58 vars in 1235 bytes} [Tue Dec 14 13:00:17 2021] GET /compute/v2.1/servers/eb6e04a4-8901-47df-9b51-7c1664bd3f6c => generated 1523 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 14 13:00:17.988541 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.api.openstack.wsgi [None req-8ca1e7a8-d650-4fb9-8733-30de9452cc41 tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] Calling method '>' {{(pid=116064) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 13:00:17.989387 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.compute.api [None req-8ca1e7a8-d650-4fb9-8733-30de9452cc41 tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] [instance: c8de7730-62f2-4a77-b1e9-cf6a74fa366d] Fetching instance by UUID {{(pid=116064) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 13:00:18.000094 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-8ca1e7a8-d650-4fb9-8733-30de9452cc41 tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 13:00:18.000839 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-8ca1e7a8-d650-4fb9-8733-30de9452cc41 tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 13:00:18.001900 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-8ca1e7a8-d650-4fb9-8733-30de9452cc41 tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 13:00:18.002331 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-8ca1e7a8-d650-4fb9-8733-30de9452cc41 tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 13:00:18.143295 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.policy [None req-8ca1e7a8-d650-4fb9-8733-30de9452cc41 tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79d74a2ea1e541d28d085c15cec34032', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68a8770b8dbe489a8119016fbee64eb5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116064) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 13:00:18.151742 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.policy [None req-8ca1e7a8-d650-4fb9-8733-30de9452cc41 tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '79d74a2ea1e541d28d085c15cec34032', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68a8770b8dbe489a8119016fbee64eb5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116064) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 13:00:18.153319 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.policy [None req-8ca1e7a8-d650-4fb9-8733-30de9452cc41 tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '79d74a2ea1e541d28d085c15cec34032', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68a8770b8dbe489a8119016fbee64eb5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116064) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 13:00:18.154470 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: INFO nova.api.openstack.requestlog [None req-8ca1e7a8-d650-4fb9-8733-30de9452cc41 tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] 10.222.0.49 "GET /compute/v2.1/servers/c8de7730-62f2-4a77-b1e9-cf6a74fa366d" status: 200 len: 1724 microversion: 2.20 time: 0.172209 Dec 14 13:00:18.155070 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: [pid: 116064|app: 0|req: 192/409] 10.222.0.49 () {60 vars in 1276 bytes} [Tue Dec 14 13:00:17 2021] GET /compute/v2.1/servers/c8de7730-62f2-4a77-b1e9-cf6a74fa366d => generated 1724 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 14 13:00:18.399831 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.api.openstack.wsgi [None req-c6bf8a85-812d-4356-8baf-5e069746b368 tempest-AttachVolumeNegativeTest-1000400951 tempest-AttachVolumeNegativeTest-1000400951-project] Calling method '>' {{(pid=116063) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 13:00:18.400434 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.compute.api [None req-c6bf8a85-812d-4356-8baf-5e069746b368 tempest-AttachVolumeNegativeTest-1000400951 tempest-AttachVolumeNegativeTest-1000400951-project] [instance: e79e4c5e-a1c6-4f80-9a63-d340231e3359] Fetching instance by UUID {{(pid=116063) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 13:00:18.402423 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.api.openstack.wsgi [None req-b2ccc64a-79eb-4901-8dd6-bd7e1b8d88e2 tempest-ServerRescueNegativeTestJSON-1573931620 tempest-ServerRescueNegativeTestJSON-1573931620-project] Calling method '>' {{(pid=116064) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 13:00:18.403035 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.compute.api [None req-b2ccc64a-79eb-4901-8dd6-bd7e1b8d88e2 tempest-ServerRescueNegativeTestJSON-1573931620 tempest-ServerRescueNegativeTestJSON-1573931620-project] [instance: eb6e04a4-8901-47df-9b51-7c1664bd3f6c] Fetching instance by UUID {{(pid=116064) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 13:00:18.407030 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-c6bf8a85-812d-4356-8baf-5e069746b368 tempest-AttachVolumeNegativeTest-1000400951 tempest-AttachVolumeNegativeTest-1000400951-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 13:00:18.407528 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-c6bf8a85-812d-4356-8baf-5e069746b368 tempest-AttachVolumeNegativeTest-1000400951 tempest-AttachVolumeNegativeTest-1000400951-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 13:00:18.408315 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-c6bf8a85-812d-4356-8baf-5e069746b368 tempest-AttachVolumeNegativeTest-1000400951 tempest-AttachVolumeNegativeTest-1000400951-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 13:00:18.408754 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-c6bf8a85-812d-4356-8baf-5e069746b368 tempest-AttachVolumeNegativeTest-1000400951 tempest-AttachVolumeNegativeTest-1000400951-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 13:00:18.409162 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-b2ccc64a-79eb-4901-8dd6-bd7e1b8d88e2 tempest-ServerRescueNegativeTestJSON-1573931620 tempest-ServerRescueNegativeTestJSON-1573931620-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 13:00:18.409613 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-b2ccc64a-79eb-4901-8dd6-bd7e1b8d88e2 tempest-ServerRescueNegativeTestJSON-1573931620 tempest-ServerRescueNegativeTestJSON-1573931620-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 13:00:18.410378 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-b2ccc64a-79eb-4901-8dd6-bd7e1b8d88e2 tempest-ServerRescueNegativeTestJSON-1573931620 tempest-ServerRescueNegativeTestJSON-1573931620-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 13:00:18.410810 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-b2ccc64a-79eb-4901-8dd6-bd7e1b8d88e2 tempest-ServerRescueNegativeTestJSON-1573931620 tempest-ServerRescueNegativeTestJSON-1573931620-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 13:00:18.599733 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.policy [None req-b2ccc64a-79eb-4901-8dd6-bd7e1b8d88e2 tempest-ServerRescueNegativeTestJSON-1573931620 tempest-ServerRescueNegativeTestJSON-1573931620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '731cbbfe17214ded8ac66299d66dfc45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '010919ea84eb4eb8b936c63153600eba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116064) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 13:00:18.603573 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.policy [None req-c6bf8a85-812d-4356-8baf-5e069746b368 tempest-AttachVolumeNegativeTest-1000400951 tempest-AttachVolumeNegativeTest-1000400951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57d0ec01f0784c8ea87d339980bed3cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad27b8951cae4eeeafa257f45217653a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116063) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 13:00:18.608136 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: INFO nova.api.openstack.requestlog [None req-b2ccc64a-79eb-4901-8dd6-bd7e1b8d88e2 tempest-ServerRescueNegativeTestJSON-1573931620 tempest-ServerRescueNegativeTestJSON-1573931620-project] 10.222.0.49 "GET /compute/v2.1/servers/eb6e04a4-8901-47df-9b51-7c1664bd3f6c" status: 200 len: 1523 microversion: 2.1 time: 0.209311 Dec 14 13:00:18.608711 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: [pid: 116064|app: 0|req: 193/410] 10.222.0.49 () {58 vars in 1235 bytes} [Tue Dec 14 13:00:18 2021] GET /compute/v2.1/servers/eb6e04a4-8901-47df-9b51-7c1664bd3f6c => generated 1523 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 14 13:00:18.611042 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: INFO nova.api.openstack.requestlog [None req-c6bf8a85-812d-4356-8baf-5e069746b368 tempest-AttachVolumeNegativeTest-1000400951 tempest-AttachVolumeNegativeTest-1000400951-project] 10.222.0.49 "GET /compute/v2.1/servers/e79e4c5e-a1c6-4f80-9a63-d340231e3359" status: 200 len: 1318 microversion: 2.1 time: 0.214875 Dec 14 13:00:18.611600 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: [pid: 116063|app: 0|req: 218/411] 10.222.0.49 () {58 vars in 1235 bytes} [Tue Dec 14 13:00:18 2021] GET /compute/v2.1/servers/e79e4c5e-a1c6-4f80-9a63-d340231e3359 => generated 1318 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 14 13:00:19.183088 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.api.openstack.wsgi [None req-942af688-9d55-4043-b6fb-97f60a35e3ab tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] Calling method '>' {{(pid=116064) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 13:00:19.183730 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.compute.api [None req-942af688-9d55-4043-b6fb-97f60a35e3ab tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] [instance: c8de7730-62f2-4a77-b1e9-cf6a74fa366d] Fetching instance by UUID {{(pid=116064) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 13:00:19.191224 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-942af688-9d55-4043-b6fb-97f60a35e3ab tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 13:00:19.191685 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-942af688-9d55-4043-b6fb-97f60a35e3ab tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 13:00:19.192499 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-942af688-9d55-4043-b6fb-97f60a35e3ab tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 13:00:19.192953 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-942af688-9d55-4043-b6fb-97f60a35e3ab tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 13:00:19.337650 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.policy [None req-942af688-9d55-4043-b6fb-97f60a35e3ab tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79d74a2ea1e541d28d085c15cec34032', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68a8770b8dbe489a8119016fbee64eb5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116064) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 13:00:19.345941 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.policy [None req-942af688-9d55-4043-b6fb-97f60a35e3ab tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '79d74a2ea1e541d28d085c15cec34032', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68a8770b8dbe489a8119016fbee64eb5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116064) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 13:00:19.347468 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.policy [None req-942af688-9d55-4043-b6fb-97f60a35e3ab tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '79d74a2ea1e541d28d085c15cec34032', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68a8770b8dbe489a8119016fbee64eb5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116064) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 13:00:19.348629 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: INFO nova.api.openstack.requestlog [None req-942af688-9d55-4043-b6fb-97f60a35e3ab tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] 10.222.0.49 "GET /compute/v2.1/servers/c8de7730-62f2-4a77-b1e9-cf6a74fa366d" status: 200 len: 1724 microversion: 2.20 time: 0.171858 Dec 14 13:00:19.349219 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: [pid: 116064|app: 0|req: 194/412] 10.222.0.49 () {60 vars in 1276 bytes} [Tue Dec 14 13:00:19 2021] GET /compute/v2.1/servers/c8de7730-62f2-4a77-b1e9-cf6a74fa366d => generated 1724 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 14 13:00:19.625664 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.api.openstack.wsgi [None req-05a96e56-6f75-4f2a-8450-d42ad19f85a9 tempest-ServerRescueNegativeTestJSON-1573931620 tempest-ServerRescueNegativeTestJSON-1573931620-project] Calling method '>' {{(pid=116063) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 13:00:19.626215 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.compute.api [None req-05a96e56-6f75-4f2a-8450-d42ad19f85a9 tempest-ServerRescueNegativeTestJSON-1573931620 tempest-ServerRescueNegativeTestJSON-1573931620-project] [instance: eb6e04a4-8901-47df-9b51-7c1664bd3f6c] Fetching instance by UUID {{(pid=116063) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 13:00:19.627959 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.api.openstack.wsgi [None req-b5cb234b-b6b7-45b4-955c-272f596a33e9 tempest-AttachVolumeNegativeTest-1000400951 tempest-AttachVolumeNegativeTest-1000400951-project] Calling method '>' {{(pid=116064) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 13:00:19.628581 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.compute.api [None req-b5cb234b-b6b7-45b4-955c-272f596a33e9 tempest-AttachVolumeNegativeTest-1000400951 tempest-AttachVolumeNegativeTest-1000400951-project] [instance: e79e4c5e-a1c6-4f80-9a63-d340231e3359] Fetching instance by UUID {{(pid=116064) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 13:00:19.633258 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-05a96e56-6f75-4f2a-8450-d42ad19f85a9 tempest-ServerRescueNegativeTestJSON-1573931620 tempest-ServerRescueNegativeTestJSON-1573931620-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 13:00:19.633710 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-05a96e56-6f75-4f2a-8450-d42ad19f85a9 tempest-ServerRescueNegativeTestJSON-1573931620 tempest-ServerRescueNegativeTestJSON-1573931620-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 13:00:19.634489 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-05a96e56-6f75-4f2a-8450-d42ad19f85a9 tempest-ServerRescueNegativeTestJSON-1573931620 tempest-ServerRescueNegativeTestJSON-1573931620-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 13:00:19.634653 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-b5cb234b-b6b7-45b4-955c-272f596a33e9 tempest-AttachVolumeNegativeTest-1000400951 tempest-AttachVolumeNegativeTest-1000400951-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 13:00:19.634923 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-05a96e56-6f75-4f2a-8450-d42ad19f85a9 tempest-ServerRescueNegativeTestJSON-1573931620 tempest-ServerRescueNegativeTestJSON-1573931620-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 13:00:19.635091 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-b5cb234b-b6b7-45b4-955c-272f596a33e9 tempest-AttachVolumeNegativeTest-1000400951 tempest-AttachVolumeNegativeTest-1000400951-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 13:00:19.635892 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-b5cb234b-b6b7-45b4-955c-272f596a33e9 tempest-AttachVolumeNegativeTest-1000400951 tempest-AttachVolumeNegativeTest-1000400951-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 13:00:19.636326 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-b5cb234b-b6b7-45b4-955c-272f596a33e9 tempest-AttachVolumeNegativeTest-1000400951 tempest-AttachVolumeNegativeTest-1000400951-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 13:00:19.837237 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.policy [None req-05a96e56-6f75-4f2a-8450-d42ad19f85a9 tempest-ServerRescueNegativeTestJSON-1573931620 tempest-ServerRescueNegativeTestJSON-1573931620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '731cbbfe17214ded8ac66299d66dfc45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '010919ea84eb4eb8b936c63153600eba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116063) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 13:00:19.844503 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.policy [None req-b5cb234b-b6b7-45b4-955c-272f596a33e9 tempest-AttachVolumeNegativeTest-1000400951 tempest-AttachVolumeNegativeTest-1000400951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57d0ec01f0784c8ea87d339980bed3cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad27b8951cae4eeeafa257f45217653a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116064) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 13:00:19.844897 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: INFO nova.api.openstack.requestlog [None req-05a96e56-6f75-4f2a-8450-d42ad19f85a9 tempest-ServerRescueNegativeTestJSON-1573931620 tempest-ServerRescueNegativeTestJSON-1573931620-project] 10.222.0.49 "GET /compute/v2.1/servers/eb6e04a4-8901-47df-9b51-7c1664bd3f6c" status: 200 len: 1523 microversion: 2.1 time: 0.223004 Dec 14 13:00:19.845519 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: [pid: 116063|app: 0|req: 219/413] 10.222.0.49 () {58 vars in 1235 bytes} [Tue Dec 14 13:00:19 2021] GET /compute/v2.1/servers/eb6e04a4-8901-47df-9b51-7c1664bd3f6c => generated 1523 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 14 13:00:19.852088 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: INFO nova.api.openstack.requestlog [None req-b5cb234b-b6b7-45b4-955c-272f596a33e9 tempest-AttachVolumeNegativeTest-1000400951 tempest-AttachVolumeNegativeTest-1000400951-project] 10.222.0.49 "GET /compute/v2.1/servers/e79e4c5e-a1c6-4f80-9a63-d340231e3359" status: 200 len: 1318 microversion: 2.1 time: 0.227734 Dec 14 13:00:19.862913 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: [pid: 116064|app: 0|req: 195/414] 10.222.0.49 () {58 vars in 1235 bytes} [Tue Dec 14 13:00:19 2021] GET /compute/v2.1/servers/e79e4c5e-a1c6-4f80-9a63-d340231e3359 => generated 1318 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 14 13:00:20.367217 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.api.openstack.wsgi [None req-01ddf9b0-8c9b-4216-a311-eb1134afc8ac tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] Calling method '>' {{(pid=116063) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 13:00:20.367829 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.compute.api [None req-01ddf9b0-8c9b-4216-a311-eb1134afc8ac tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] [instance: c8de7730-62f2-4a77-b1e9-cf6a74fa366d] Fetching instance by UUID {{(pid=116063) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 13:00:20.374022 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-01ddf9b0-8c9b-4216-a311-eb1134afc8ac tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 13:00:20.374471 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-01ddf9b0-8c9b-4216-a311-eb1134afc8ac tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 13:00:20.375256 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-01ddf9b0-8c9b-4216-a311-eb1134afc8ac tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 13:00:20.375690 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-01ddf9b0-8c9b-4216-a311-eb1134afc8ac tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 13:00:20.500521 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.api.openstack.wsgi [None req-0d6a86f1-2892-49c9-9006-91a5e5e20123 tempest-VolumesSnapshotTestJSON-1649574085 tempest-VolumesSnapshotTestJSON-1649574085-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "47100da6-3e7d-4101-88b1-56d05d9a7dd3", "device": "/dev/sdb"}} {{(pid=116064) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 14 13:00:20.502418 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.compute.api [None req-0d6a86f1-2892-49c9-9006-91a5e5e20123 tempest-VolumesSnapshotTestJSON-1649574085 tempest-VolumesSnapshotTestJSON-1649574085-project] [instance: c48d3c23-3b4b-4220-8ead-d04a670ec64f] Fetching instance by UUID {{(pid=116064) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 13:00:20.509385 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-0d6a86f1-2892-49c9-9006-91a5e5e20123 tempest-VolumesSnapshotTestJSON-1649574085 tempest-VolumesSnapshotTestJSON-1649574085-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 13:00:20.510032 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-0d6a86f1-2892-49c9-9006-91a5e5e20123 tempest-VolumesSnapshotTestJSON-1649574085 tempest-VolumesSnapshotTestJSON-1649574085-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 13:00:20.511771 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-0d6a86f1-2892-49c9-9006-91a5e5e20123 tempest-VolumesSnapshotTestJSON-1649574085 tempest-VolumesSnapshotTestJSON-1649574085-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 13:00:20.512308 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-0d6a86f1-2892-49c9-9006-91a5e5e20123 tempest-VolumesSnapshotTestJSON-1649574085 tempest-VolumesSnapshotTestJSON-1649574085-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 13:00:20.543967 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.policy [None req-01ddf9b0-8c9b-4216-a311-eb1134afc8ac tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79d74a2ea1e541d28d085c15cec34032', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68a8770b8dbe489a8119016fbee64eb5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116063) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 13:00:20.552920 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.policy [None req-01ddf9b0-8c9b-4216-a311-eb1134afc8ac tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '79d74a2ea1e541d28d085c15cec34032', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68a8770b8dbe489a8119016fbee64eb5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116063) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 13:00:20.554430 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.policy [None req-01ddf9b0-8c9b-4216-a311-eb1134afc8ac tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '79d74a2ea1e541d28d085c15cec34032', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68a8770b8dbe489a8119016fbee64eb5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116063) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 13:00:20.555584 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: INFO nova.api.openstack.requestlog [None req-01ddf9b0-8c9b-4216-a311-eb1134afc8ac tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] 10.222.0.49 "GET /compute/v2.1/servers/c8de7730-62f2-4a77-b1e9-cf6a74fa366d" status: 200 len: 1724 microversion: 2.20 time: 0.192274 Dec 14 13:00:20.556743 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: [pid: 116063|app: 0|req: 220/415] 10.222.0.49 () {60 vars in 1276 bytes} [Tue Dec 14 13:00:20 2021] GET /compute/v2.1/servers/c8de7730-62f2-4a77-b1e9-cf6a74fa366d => generated 1724 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 14 13:00:20.813698 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: INFO nova.api.openstack.requestlog [None req-0d6a86f1-2892-49c9-9006-91a5e5e20123 tempest-VolumesSnapshotTestJSON-1649574085 tempest-VolumesSnapshotTestJSON-1649574085-project] 10.222.0.49 "POST /compute/v2.1/servers/c48d3c23-3b4b-4220-8ead-d04a670ec64f/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.316436 Dec 14 13:00:20.814436 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: [pid: 116064|app: 0|req: 196/416] 10.222.0.49 () {60 vars in 1322 bytes} [Tue Dec 14 13:00:20 2021] POST /compute/v2.1/servers/c48d3c23-3b4b-4220-8ead-d04a670ec64f/os-volume_attachments => generated 194 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 14 13:00:20.862751 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.api.openstack.wsgi [None req-c14a7e99-82f3-4d92-9539-9de4652f5fc2 tempest-ServerRescueNegativeTestJSON-1573931620 tempest-ServerRescueNegativeTestJSON-1573931620-project] Calling method '>' {{(pid=116063) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 13:00:20.864289 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.compute.api [None req-c14a7e99-82f3-4d92-9539-9de4652f5fc2 tempest-ServerRescueNegativeTestJSON-1573931620 tempest-ServerRescueNegativeTestJSON-1573931620-project] [instance: eb6e04a4-8901-47df-9b51-7c1664bd3f6c] Fetching instance by UUID {{(pid=116063) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 13:00:20.871776 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.api.openstack.wsgi [None req-fb66f816-39f4-40c2-a96b-63df7fad54bb tempest-AttachVolumeNegativeTest-1000400951 tempest-AttachVolumeNegativeTest-1000400951-project] Calling method '>' {{(pid=116064) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 13:00:20.874760 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.compute.api [None req-fb66f816-39f4-40c2-a96b-63df7fad54bb tempest-AttachVolumeNegativeTest-1000400951 tempest-AttachVolumeNegativeTest-1000400951-project] [instance: e79e4c5e-a1c6-4f80-9a63-d340231e3359] Fetching instance by UUID {{(pid=116064) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 13:00:20.885285 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-c14a7e99-82f3-4d92-9539-9de4652f5fc2 tempest-ServerRescueNegativeTestJSON-1573931620 tempest-ServerRescueNegativeTestJSON-1573931620-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 13:00:20.885285 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-c14a7e99-82f3-4d92-9539-9de4652f5fc2 tempest-ServerRescueNegativeTestJSON-1573931620 tempest-ServerRescueNegativeTestJSON-1573931620-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 13:00:20.885285 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-c14a7e99-82f3-4d92-9539-9de4652f5fc2 tempest-ServerRescueNegativeTestJSON-1573931620 tempest-ServerRescueNegativeTestJSON-1573931620-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 13:00:20.885285 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-c14a7e99-82f3-4d92-9539-9de4652f5fc2 tempest-ServerRescueNegativeTestJSON-1573931620 tempest-ServerRescueNegativeTestJSON-1573931620-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 13:00:20.890770 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-fb66f816-39f4-40c2-a96b-63df7fad54bb tempest-AttachVolumeNegativeTest-1000400951 tempest-AttachVolumeNegativeTest-1000400951-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 13:00:20.891322 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-fb66f816-39f4-40c2-a96b-63df7fad54bb tempest-AttachVolumeNegativeTest-1000400951 tempest-AttachVolumeNegativeTest-1000400951-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 13:00:20.892188 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-fb66f816-39f4-40c2-a96b-63df7fad54bb tempest-AttachVolumeNegativeTest-1000400951 tempest-AttachVolumeNegativeTest-1000400951-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 13:00:20.892692 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-fb66f816-39f4-40c2-a96b-63df7fad54bb tempest-AttachVolumeNegativeTest-1000400951 tempest-AttachVolumeNegativeTest-1000400951-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 13:00:21.179996 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.policy [None req-fb66f816-39f4-40c2-a96b-63df7fad54bb tempest-AttachVolumeNegativeTest-1000400951 tempest-AttachVolumeNegativeTest-1000400951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57d0ec01f0784c8ea87d339980bed3cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad27b8951cae4eeeafa257f45217653a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116064) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 13:00:21.188607 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: INFO nova.api.openstack.requestlog [None req-fb66f816-39f4-40c2-a96b-63df7fad54bb tempest-AttachVolumeNegativeTest-1000400951 tempest-AttachVolumeNegativeTest-1000400951-project] 10.222.0.49 "GET /compute/v2.1/servers/e79e4c5e-a1c6-4f80-9a63-d340231e3359" status: 200 len: 1318 microversion: 2.1 time: 0.322242 Dec 14 13:00:21.200062 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: [pid: 116064|app: 0|req: 197/417] 10.222.0.49 () {58 vars in 1235 bytes} [Tue Dec 14 13:00:20 2021] GET /compute/v2.1/servers/e79e4c5e-a1c6-4f80-9a63-d340231e3359 => generated 1318 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 14 13:00:21.202190 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.policy [None req-c14a7e99-82f3-4d92-9539-9de4652f5fc2 tempest-ServerRescueNegativeTestJSON-1573931620 tempest-ServerRescueNegativeTestJSON-1573931620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '731cbbfe17214ded8ac66299d66dfc45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '010919ea84eb4eb8b936c63153600eba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116063) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 13:00:21.223263 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: INFO nova.api.openstack.requestlog [None req-c14a7e99-82f3-4d92-9539-9de4652f5fc2 tempest-ServerRescueNegativeTestJSON-1573931620 tempest-ServerRescueNegativeTestJSON-1573931620-project] 10.222.0.49 "GET /compute/v2.1/servers/eb6e04a4-8901-47df-9b51-7c1664bd3f6c" status: 200 len: 1523 microversion: 2.1 time: 0.364431 Dec 14 13:00:21.224885 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: [pid: 116063|app: 0|req: 221/418] 10.222.0.49 () {58 vars in 1235 bytes} [Tue Dec 14 13:00:20 2021] GET /compute/v2.1/servers/eb6e04a4-8901-47df-9b51-7c1664bd3f6c => generated 1523 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 14 13:00:21.574132 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.api.openstack.wsgi [None req-e096152a-f504-4127-85fe-bb231dffe690 tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] Calling method '>' {{(pid=116064) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 13:00:21.575379 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.compute.api [None req-e096152a-f504-4127-85fe-bb231dffe690 tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] [instance: c8de7730-62f2-4a77-b1e9-cf6a74fa366d] Fetching instance by UUID {{(pid=116064) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 13:00:21.587501 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-e096152a-f504-4127-85fe-bb231dffe690 tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 13:00:21.588060 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-e096152a-f504-4127-85fe-bb231dffe690 tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 13:00:21.588887 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-e096152a-f504-4127-85fe-bb231dffe690 tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 13:00:21.589489 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-e096152a-f504-4127-85fe-bb231dffe690 tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 13:00:21.725634 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.policy [None req-e096152a-f504-4127-85fe-bb231dffe690 tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79d74a2ea1e541d28d085c15cec34032', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68a8770b8dbe489a8119016fbee64eb5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116064) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 13:00:21.733469 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.policy [None req-e096152a-f504-4127-85fe-bb231dffe690 tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '79d74a2ea1e541d28d085c15cec34032', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68a8770b8dbe489a8119016fbee64eb5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116064) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 13:00:21.734959 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.policy [None req-e096152a-f504-4127-85fe-bb231dffe690 tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '79d74a2ea1e541d28d085c15cec34032', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68a8770b8dbe489a8119016fbee64eb5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116064) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 13:00:21.736161 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: INFO nova.api.openstack.requestlog [None req-e096152a-f504-4127-85fe-bb231dffe690 tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] 10.222.0.49 "GET /compute/v2.1/servers/c8de7730-62f2-4a77-b1e9-cf6a74fa366d" status: 200 len: 1724 microversion: 2.20 time: 0.165764 Dec 14 13:00:21.736932 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: [pid: 116064|app: 0|req: 198/419] 10.222.0.49 () {60 vars in 1276 bytes} [Tue Dec 14 13:00:21 2021] GET /compute/v2.1/servers/c8de7730-62f2-4a77-b1e9-cf6a74fa366d => generated 1724 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 14 13:00:22.215723 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.api.openstack.wsgi [None req-3299c88d-3003-419f-934d-fcefff0d2729 tempest-AttachVolumeNegativeTest-1000400951 tempest-AttachVolumeNegativeTest-1000400951-project] Calling method '>' {{(pid=116063) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 13:00:22.216402 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.compute.api [None req-3299c88d-3003-419f-934d-fcefff0d2729 tempest-AttachVolumeNegativeTest-1000400951 tempest-AttachVolumeNegativeTest-1000400951-project] [instance: e79e4c5e-a1c6-4f80-9a63-d340231e3359] Fetching instance by UUID {{(pid=116063) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 13:00:22.223471 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-3299c88d-3003-419f-934d-fcefff0d2729 tempest-AttachVolumeNegativeTest-1000400951 tempest-AttachVolumeNegativeTest-1000400951-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 13:00:22.223992 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-3299c88d-3003-419f-934d-fcefff0d2729 tempest-AttachVolumeNegativeTest-1000400951 tempest-AttachVolumeNegativeTest-1000400951-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 13:00:22.224864 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-3299c88d-3003-419f-934d-fcefff0d2729 tempest-AttachVolumeNegativeTest-1000400951 tempest-AttachVolumeNegativeTest-1000400951-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 13:00:22.225389 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-3299c88d-3003-419f-934d-fcefff0d2729 tempest-AttachVolumeNegativeTest-1000400951 tempest-AttachVolumeNegativeTest-1000400951-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 13:00:22.241823 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.api.openstack.wsgi [None req-f6fba255-58e6-4625-9734-0cf157e3c3a8 tempest-ServerRescueNegativeTestJSON-1573931620 tempest-ServerRescueNegativeTestJSON-1573931620-project] Calling method '>' {{(pid=116064) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 13:00:22.243161 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.compute.api [None req-f6fba255-58e6-4625-9734-0cf157e3c3a8 tempest-ServerRescueNegativeTestJSON-1573931620 tempest-ServerRescueNegativeTestJSON-1573931620-project] [instance: eb6e04a4-8901-47df-9b51-7c1664bd3f6c] Fetching instance by UUID {{(pid=116064) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 13:00:22.249971 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-f6fba255-58e6-4625-9734-0cf157e3c3a8 tempest-ServerRescueNegativeTestJSON-1573931620 tempest-ServerRescueNegativeTestJSON-1573931620-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 13:00:22.250404 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-f6fba255-58e6-4625-9734-0cf157e3c3a8 tempest-ServerRescueNegativeTestJSON-1573931620 tempest-ServerRescueNegativeTestJSON-1573931620-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 13:00:22.251197 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-f6fba255-58e6-4625-9734-0cf157e3c3a8 tempest-ServerRescueNegativeTestJSON-1573931620 tempest-ServerRescueNegativeTestJSON-1573931620-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 13:00:22.251633 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-f6fba255-58e6-4625-9734-0cf157e3c3a8 tempest-ServerRescueNegativeTestJSON-1573931620 tempest-ServerRescueNegativeTestJSON-1573931620-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 13:00:22.458924 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.policy [None req-3299c88d-3003-419f-934d-fcefff0d2729 tempest-AttachVolumeNegativeTest-1000400951 tempest-AttachVolumeNegativeTest-1000400951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57d0ec01f0784c8ea87d339980bed3cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad27b8951cae4eeeafa257f45217653a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116063) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 13:00:22.463923 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.policy [None req-f6fba255-58e6-4625-9734-0cf157e3c3a8 tempest-ServerRescueNegativeTestJSON-1573931620 tempest-ServerRescueNegativeTestJSON-1573931620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '731cbbfe17214ded8ac66299d66dfc45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '010919ea84eb4eb8b936c63153600eba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116064) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 13:00:22.467726 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: INFO nova.api.openstack.requestlog [None req-3299c88d-3003-419f-934d-fcefff0d2729 tempest-AttachVolumeNegativeTest-1000400951 tempest-AttachVolumeNegativeTest-1000400951-project] 10.222.0.49 "GET /compute/v2.1/servers/e79e4c5e-a1c6-4f80-9a63-d340231e3359" status: 200 len: 1318 microversion: 2.1 time: 0.255963 Dec 14 13:00:22.468422 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: [pid: 116063|app: 0|req: 222/420] 10.222.0.49 () {58 vars in 1235 bytes} [Tue Dec 14 13:00:22 2021] GET /compute/v2.1/servers/e79e4c5e-a1c6-4f80-9a63-d340231e3359 => generated 1318 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 14 13:00:22.472189 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: INFO nova.api.openstack.requestlog [None req-f6fba255-58e6-4625-9734-0cf157e3c3a8 tempest-ServerRescueNegativeTestJSON-1573931620 tempest-ServerRescueNegativeTestJSON-1573931620-project] 10.222.0.49 "GET /compute/v2.1/servers/eb6e04a4-8901-47df-9b51-7c1664bd3f6c" status: 200 len: 1523 microversion: 2.1 time: 0.234105 Dec 14 13:00:22.472928 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: [pid: 116064|app: 0|req: 199/421] 10.222.0.49 () {58 vars in 1235 bytes} [Tue Dec 14 13:00:22 2021] GET /compute/v2.1/servers/eb6e04a4-8901-47df-9b51-7c1664bd3f6c => generated 1523 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 14 13:00:22.754933 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.api.openstack.wsgi [None req-d2839751-d87a-4b01-81b5-5d8d4d9bad9e tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] Calling method '>' {{(pid=116063) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 13:00:22.755463 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.compute.api [None req-d2839751-d87a-4b01-81b5-5d8d4d9bad9e tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] [instance: c8de7730-62f2-4a77-b1e9-cf6a74fa366d] Fetching instance by UUID {{(pid=116063) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 13:00:22.761792 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-d2839751-d87a-4b01-81b5-5d8d4d9bad9e tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 13:00:22.762252 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-d2839751-d87a-4b01-81b5-5d8d4d9bad9e tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 13:00:22.763088 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-d2839751-d87a-4b01-81b5-5d8d4d9bad9e tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 13:00:22.763522 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-d2839751-d87a-4b01-81b5-5d8d4d9bad9e tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 13:00:22.903558 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.policy [None req-d2839751-d87a-4b01-81b5-5d8d4d9bad9e tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79d74a2ea1e541d28d085c15cec34032', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68a8770b8dbe489a8119016fbee64eb5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116063) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 13:00:22.912033 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.policy [None req-d2839751-d87a-4b01-81b5-5d8d4d9bad9e tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '79d74a2ea1e541d28d085c15cec34032', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68a8770b8dbe489a8119016fbee64eb5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116063) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 13:00:22.913628 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.policy [None req-d2839751-d87a-4b01-81b5-5d8d4d9bad9e tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '79d74a2ea1e541d28d085c15cec34032', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68a8770b8dbe489a8119016fbee64eb5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116063) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 13:00:22.914767 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: INFO nova.api.openstack.requestlog [None req-d2839751-d87a-4b01-81b5-5d8d4d9bad9e tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] 10.222.0.49 "GET /compute/v2.1/servers/c8de7730-62f2-4a77-b1e9-cf6a74fa366d" status: 200 len: 1724 microversion: 2.20 time: 0.163826 Dec 14 13:00:22.915951 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: [pid: 116063|app: 0|req: 223/422] 10.222.0.49 () {60 vars in 1276 bytes} [Tue Dec 14 13:00:22 2021] GET /compute/v2.1/servers/c8de7730-62f2-4a77-b1e9-cf6a74fa366d => generated 1724 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 14 13:00:23.132193 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.api.openstack.wsgi [req-34a4b10a-15be-43a3-9750-a4576056ab0b req-5de49fdf-ca04-4d0b-8953-d0df12313b1e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e79e4c5e-a1c6-4f80-9a63-d340231e3359", "name": "network-vif-plugged", "status": "completed", "tag": "bf021cb5-24d6-405a-94a5-01c51e16436f"}]} {{(pid=116064) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 14 13:00:23.134438 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 14 13:00:23.134438 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: warnings.warn(msg) Dec 14 13:00:23.147659 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [req-34a4b10a-15be-43a3-9750-a4576056ab0b req-5de49fdf-ca04-4d0b-8953-d0df12313b1e service nova] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 13:00:23.148959 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [req-34a4b10a-15be-43a3-9750-a4576056ab0b req-5de49fdf-ca04-4d0b-8953-d0df12313b1e service nova] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 13:00:23.161917 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: INFO nova.api.openstack.compute.server_external_events [req-34a4b10a-15be-43a3-9750-a4576056ab0b req-5de49fdf-ca04-4d0b-8953-d0df12313b1e service nova] Creating event network-vif-plugged:bf021cb5-24d6-405a-94a5-01c51e16436f for instance e79e4c5e-a1c6-4f80-9a63-d340231e3359 on hv-cinder-78447 Dec 14 13:00:23.167525 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: INFO nova.api.openstack.requestlog [req-34a4b10a-15be-43a3-9750-a4576056ab0b req-5de49fdf-ca04-4d0b-8953-d0df12313b1e service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039336 Dec 14 13:00:23.169006 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: [pid: 116064|app: 0|req: 200/423] 10.222.0.49 () {64 vars in 1317 bytes} [Tue Dec 14 13:00:23 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 14 13:00:23.484715 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.api.openstack.wsgi [None req-53516840-2c61-4689-8fbb-80af01f6cc78 tempest-AttachVolumeNegativeTest-1000400951 tempest-AttachVolumeNegativeTest-1000400951-project] Calling method '>' {{(pid=116063) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 13:00:23.485357 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.compute.api [None req-53516840-2c61-4689-8fbb-80af01f6cc78 tempest-AttachVolumeNegativeTest-1000400951 tempest-AttachVolumeNegativeTest-1000400951-project] [instance: e79e4c5e-a1c6-4f80-9a63-d340231e3359] Fetching instance by UUID {{(pid=116063) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 13:00:23.490455 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.api.openstack.wsgi [None req-1f8f02b1-550b-4b18-8347-0dc1b6b073c8 tempest-ServerRescueNegativeTestJSON-1573931620 tempest-ServerRescueNegativeTestJSON-1573931620-project] Calling method '>' {{(pid=116064) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 13:00:23.491258 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.compute.api [None req-1f8f02b1-550b-4b18-8347-0dc1b6b073c8 tempest-ServerRescueNegativeTestJSON-1573931620 tempest-ServerRescueNegativeTestJSON-1573931620-project] [instance: eb6e04a4-8901-47df-9b51-7c1664bd3f6c] Fetching instance by UUID {{(pid=116064) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 13:00:23.491983 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-53516840-2c61-4689-8fbb-80af01f6cc78 tempest-AttachVolumeNegativeTest-1000400951 tempest-AttachVolumeNegativeTest-1000400951-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 13:00:23.492478 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-53516840-2c61-4689-8fbb-80af01f6cc78 tempest-AttachVolumeNegativeTest-1000400951 tempest-AttachVolumeNegativeTest-1000400951-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 13:00:23.495524 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-53516840-2c61-4689-8fbb-80af01f6cc78 tempest-AttachVolumeNegativeTest-1000400951 tempest-AttachVolumeNegativeTest-1000400951-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 13:00:23.496017 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-53516840-2c61-4689-8fbb-80af01f6cc78 tempest-AttachVolumeNegativeTest-1000400951 tempest-AttachVolumeNegativeTest-1000400951-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 13:00:23.497969 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-1f8f02b1-550b-4b18-8347-0dc1b6b073c8 tempest-ServerRescueNegativeTestJSON-1573931620 tempest-ServerRescueNegativeTestJSON-1573931620-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 13:00:23.498403 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-1f8f02b1-550b-4b18-8347-0dc1b6b073c8 tempest-ServerRescueNegativeTestJSON-1573931620 tempest-ServerRescueNegativeTestJSON-1573931620-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 13:00:23.499451 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-1f8f02b1-550b-4b18-8347-0dc1b6b073c8 tempest-ServerRescueNegativeTestJSON-1573931620 tempest-ServerRescueNegativeTestJSON-1573931620-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 13:00:23.500113 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-1f8f02b1-550b-4b18-8347-0dc1b6b073c8 tempest-ServerRescueNegativeTestJSON-1573931620 tempest-ServerRescueNegativeTestJSON-1573931620-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 13:00:23.752216 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.policy [None req-53516840-2c61-4689-8fbb-80af01f6cc78 tempest-AttachVolumeNegativeTest-1000400951 tempest-AttachVolumeNegativeTest-1000400951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57d0ec01f0784c8ea87d339980bed3cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad27b8951cae4eeeafa257f45217653a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116063) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 13:00:23.757599 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.policy [None req-1f8f02b1-550b-4b18-8347-0dc1b6b073c8 tempest-ServerRescueNegativeTestJSON-1573931620 tempest-ServerRescueNegativeTestJSON-1573931620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '731cbbfe17214ded8ac66299d66dfc45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '010919ea84eb4eb8b936c63153600eba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116064) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 13:00:23.760592 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: INFO nova.api.openstack.requestlog [None req-53516840-2c61-4689-8fbb-80af01f6cc78 tempest-AttachVolumeNegativeTest-1000400951 tempest-AttachVolumeNegativeTest-1000400951-project] 10.222.0.49 "GET /compute/v2.1/servers/e79e4c5e-a1c6-4f80-9a63-d340231e3359" status: 200 len: 1318 microversion: 2.1 time: 0.279457 Dec 14 13:00:23.761547 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: [pid: 116063|app: 0|req: 224/424] 10.222.0.49 () {58 vars in 1235 bytes} [Tue Dec 14 13:00:23 2021] GET /compute/v2.1/servers/e79e4c5e-a1c6-4f80-9a63-d340231e3359 => generated 1318 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 14 13:00:23.766704 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: INFO nova.api.openstack.requestlog [None req-1f8f02b1-550b-4b18-8347-0dc1b6b073c8 tempest-ServerRescueNegativeTestJSON-1573931620 tempest-ServerRescueNegativeTestJSON-1573931620-project] 10.222.0.49 "GET /compute/v2.1/servers/eb6e04a4-8901-47df-9b51-7c1664bd3f6c" status: 200 len: 1523 microversion: 2.1 time: 0.280571 Dec 14 13:00:23.770880 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: [pid: 116064|app: 0|req: 201/425] 10.222.0.49 () {58 vars in 1235 bytes} [Tue Dec 14 13:00:23 2021] GET /compute/v2.1/servers/eb6e04a4-8901-47df-9b51-7c1664bd3f6c => generated 1523 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 14 13:00:23.934832 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.api.openstack.wsgi [None req-a7cde332-7f45-4f13-ba68-099300ffdaaf tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] Calling method '>' {{(pid=116063) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 13:00:23.935592 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.compute.api [None req-a7cde332-7f45-4f13-ba68-099300ffdaaf tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] [instance: c8de7730-62f2-4a77-b1e9-cf6a74fa366d] Fetching instance by UUID {{(pid=116063) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 13:00:23.942739 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-a7cde332-7f45-4f13-ba68-099300ffdaaf tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 13:00:23.943305 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-a7cde332-7f45-4f13-ba68-099300ffdaaf tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 13:00:23.944265 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-a7cde332-7f45-4f13-ba68-099300ffdaaf tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 13:00:23.944805 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-a7cde332-7f45-4f13-ba68-099300ffdaaf tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 13:00:24.097851 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.policy [None req-a7cde332-7f45-4f13-ba68-099300ffdaaf tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79d74a2ea1e541d28d085c15cec34032', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68a8770b8dbe489a8119016fbee64eb5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116063) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 13:00:24.117115 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.policy [None req-a7cde332-7f45-4f13-ba68-099300ffdaaf tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '79d74a2ea1e541d28d085c15cec34032', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68a8770b8dbe489a8119016fbee64eb5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116063) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 13:00:24.117115 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.policy [None req-a7cde332-7f45-4f13-ba68-099300ffdaaf tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '79d74a2ea1e541d28d085c15cec34032', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68a8770b8dbe489a8119016fbee64eb5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116063) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 13:00:24.117115 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: INFO nova.api.openstack.requestlog [None req-a7cde332-7f45-4f13-ba68-099300ffdaaf tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] 10.222.0.49 "GET /compute/v2.1/servers/c8de7730-62f2-4a77-b1e9-cf6a74fa366d" status: 200 len: 1724 microversion: 2.20 time: 0.186729 Dec 14 13:00:24.117607 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: [pid: 116063|app: 0|req: 225/426] 10.222.0.49 () {60 vars in 1276 bytes} [Tue Dec 14 13:00:23 2021] GET /compute/v2.1/servers/c8de7730-62f2-4a77-b1e9-cf6a74fa366d => generated 1724 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 14 13:00:24.777405 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.api.openstack.wsgi [None req-1ed10b9b-29cd-4d5b-a721-679d79d1cc2c tempest-AttachVolumeNegativeTest-1000400951 tempest-AttachVolumeNegativeTest-1000400951-project] Calling method '>' {{(pid=116064) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 13:00:24.778014 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.compute.api [None req-1ed10b9b-29cd-4d5b-a721-679d79d1cc2c tempest-AttachVolumeNegativeTest-1000400951 tempest-AttachVolumeNegativeTest-1000400951-project] [instance: e79e4c5e-a1c6-4f80-9a63-d340231e3359] Fetching instance by UUID {{(pid=116064) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 13:00:24.784828 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-1ed10b9b-29cd-4d5b-a721-679d79d1cc2c tempest-AttachVolumeNegativeTest-1000400951 tempest-AttachVolumeNegativeTest-1000400951-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 13:00:24.785325 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-1ed10b9b-29cd-4d5b-a721-679d79d1cc2c tempest-AttachVolumeNegativeTest-1000400951 tempest-AttachVolumeNegativeTest-1000400951-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 13:00:24.786110 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-1ed10b9b-29cd-4d5b-a721-679d79d1cc2c tempest-AttachVolumeNegativeTest-1000400951 tempest-AttachVolumeNegativeTest-1000400951-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 13:00:24.786542 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-1ed10b9b-29cd-4d5b-a721-679d79d1cc2c tempest-AttachVolumeNegativeTest-1000400951 tempest-AttachVolumeNegativeTest-1000400951-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 13:00:24.787881 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.api.openstack.wsgi [None req-6c536f89-db19-4700-93f7-9a4258854208 tempest-ServerRescueNegativeTestJSON-1573931620 tempest-ServerRescueNegativeTestJSON-1573931620-project] Calling method '>' {{(pid=116063) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 13:00:24.788547 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.compute.api [None req-6c536f89-db19-4700-93f7-9a4258854208 tempest-ServerRescueNegativeTestJSON-1573931620 tempest-ServerRescueNegativeTestJSON-1573931620-project] [instance: eb6e04a4-8901-47df-9b51-7c1664bd3f6c] Fetching instance by UUID {{(pid=116063) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 13:00:24.795095 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-6c536f89-db19-4700-93f7-9a4258854208 tempest-ServerRescueNegativeTestJSON-1573931620 tempest-ServerRescueNegativeTestJSON-1573931620-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 13:00:24.795844 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-6c536f89-db19-4700-93f7-9a4258854208 tempest-ServerRescueNegativeTestJSON-1573931620 tempest-ServerRescueNegativeTestJSON-1573931620-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 13:00:24.797101 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-6c536f89-db19-4700-93f7-9a4258854208 tempest-ServerRescueNegativeTestJSON-1573931620 tempest-ServerRescueNegativeTestJSON-1573931620-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 13:00:24.797512 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-6c536f89-db19-4700-93f7-9a4258854208 tempest-ServerRescueNegativeTestJSON-1573931620 tempest-ServerRescueNegativeTestJSON-1573931620-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 13:00:24.980188 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.policy [None req-1ed10b9b-29cd-4d5b-a721-679d79d1cc2c tempest-AttachVolumeNegativeTest-1000400951 tempest-AttachVolumeNegativeTest-1000400951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57d0ec01f0784c8ea87d339980bed3cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad27b8951cae4eeeafa257f45217653a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116064) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 13:00:24.991887 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: INFO nova.api.openstack.requestlog [None req-1ed10b9b-29cd-4d5b-a721-679d79d1cc2c tempest-AttachVolumeNegativeTest-1000400951 tempest-AttachVolumeNegativeTest-1000400951-project] 10.222.0.49 "GET /compute/v2.1/servers/e79e4c5e-a1c6-4f80-9a63-d340231e3359" status: 200 len: 1318 microversion: 2.1 time: 0.217491 Dec 14 13:00:24.993124 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: [pid: 116064|app: 0|req: 202/427] 10.222.0.49 () {58 vars in 1235 bytes} [Tue Dec 14 13:00:24 2021] GET /compute/v2.1/servers/e79e4c5e-a1c6-4f80-9a63-d340231e3359 => generated 1318 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 14 13:00:25.009030 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.policy [None req-6c536f89-db19-4700-93f7-9a4258854208 tempest-ServerRescueNegativeTestJSON-1573931620 tempest-ServerRescueNegativeTestJSON-1573931620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '731cbbfe17214ded8ac66299d66dfc45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '010919ea84eb4eb8b936c63153600eba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116063) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 13:00:25.019844 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: INFO nova.api.openstack.requestlog [None req-6c536f89-db19-4700-93f7-9a4258854208 tempest-ServerRescueNegativeTestJSON-1573931620 tempest-ServerRescueNegativeTestJSON-1573931620-project] 10.222.0.49 "GET /compute/v2.1/servers/eb6e04a4-8901-47df-9b51-7c1664bd3f6c" status: 200 len: 1523 microversion: 2.1 time: 0.236257 Dec 14 13:00:25.020685 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: [pid: 116063|app: 0|req: 226/428] 10.222.0.49 () {58 vars in 1235 bytes} [Tue Dec 14 13:00:24 2021] GET /compute/v2.1/servers/eb6e04a4-8901-47df-9b51-7c1664bd3f6c => generated 1523 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 14 13:00:25.136460 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.api.openstack.wsgi [None req-33195983-98f1-44fb-a007-9d2e85fd16cb tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] Calling method '>' {{(pid=116064) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 13:00:25.137458 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.compute.api [None req-33195983-98f1-44fb-a007-9d2e85fd16cb tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] [instance: c8de7730-62f2-4a77-b1e9-cf6a74fa366d] Fetching instance by UUID {{(pid=116064) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 13:00:25.144558 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-33195983-98f1-44fb-a007-9d2e85fd16cb tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 13:00:25.145129 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-33195983-98f1-44fb-a007-9d2e85fd16cb tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 13:00:25.146006 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-33195983-98f1-44fb-a007-9d2e85fd16cb tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 13:00:25.146524 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-33195983-98f1-44fb-a007-9d2e85fd16cb tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 13:00:25.302901 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.policy [None req-33195983-98f1-44fb-a007-9d2e85fd16cb tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79d74a2ea1e541d28d085c15cec34032', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68a8770b8dbe489a8119016fbee64eb5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116064) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 13:00:25.311396 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.policy [None req-33195983-98f1-44fb-a007-9d2e85fd16cb tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '79d74a2ea1e541d28d085c15cec34032', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68a8770b8dbe489a8119016fbee64eb5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116064) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 13:00:25.312942 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.policy [None req-33195983-98f1-44fb-a007-9d2e85fd16cb tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '79d74a2ea1e541d28d085c15cec34032', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68a8770b8dbe489a8119016fbee64eb5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116064) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 13:00:25.314101 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: INFO nova.api.openstack.requestlog [None req-33195983-98f1-44fb-a007-9d2e85fd16cb tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] 10.222.0.49 "GET /compute/v2.1/servers/c8de7730-62f2-4a77-b1e9-cf6a74fa366d" status: 200 len: 1724 microversion: 2.20 time: 0.181520 Dec 14 13:00:25.314870 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: [pid: 116064|app: 0|req: 203/429] 10.222.0.49 () {60 vars in 1276 bytes} [Tue Dec 14 13:00:25 2021] GET /compute/v2.1/servers/c8de7730-62f2-4a77-b1e9-cf6a74fa366d => generated 1724 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 14 13:00:26.012162 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.api.openstack.wsgi [None req-ccac18ad-90b8-44fe-9fc1-5c922c6c1a6e tempest-AttachVolumeNegativeTest-1000400951 tempest-AttachVolumeNegativeTest-1000400951-project] Calling method '>' {{(pid=116063) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 13:00:26.013145 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.compute.api [None req-ccac18ad-90b8-44fe-9fc1-5c922c6c1a6e tempest-AttachVolumeNegativeTest-1000400951 tempest-AttachVolumeNegativeTest-1000400951-project] [instance: e79e4c5e-a1c6-4f80-9a63-d340231e3359] Fetching instance by UUID {{(pid=116063) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 13:00:26.022968 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-ccac18ad-90b8-44fe-9fc1-5c922c6c1a6e tempest-AttachVolumeNegativeTest-1000400951 tempest-AttachVolumeNegativeTest-1000400951-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 13:00:26.023667 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-ccac18ad-90b8-44fe-9fc1-5c922c6c1a6e tempest-AttachVolumeNegativeTest-1000400951 tempest-AttachVolumeNegativeTest-1000400951-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 13:00:26.024910 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-ccac18ad-90b8-44fe-9fc1-5c922c6c1a6e tempest-AttachVolumeNegativeTest-1000400951 tempest-AttachVolumeNegativeTest-1000400951-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 13:00:26.025584 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-ccac18ad-90b8-44fe-9fc1-5c922c6c1a6e tempest-AttachVolumeNegativeTest-1000400951 tempest-AttachVolumeNegativeTest-1000400951-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 13:00:26.038631 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.api.openstack.wsgi [None req-3cd38316-62f2-45de-a35d-5dda37b74645 tempest-ServerRescueNegativeTestJSON-1573931620 tempest-ServerRescueNegativeTestJSON-1573931620-project] Calling method '>' {{(pid=116064) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 13:00:26.039217 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.compute.api [None req-3cd38316-62f2-45de-a35d-5dda37b74645 tempest-ServerRescueNegativeTestJSON-1573931620 tempest-ServerRescueNegativeTestJSON-1573931620-project] [instance: eb6e04a4-8901-47df-9b51-7c1664bd3f6c] Fetching instance by UUID {{(pid=116064) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 13:00:26.045893 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-3cd38316-62f2-45de-a35d-5dda37b74645 tempest-ServerRescueNegativeTestJSON-1573931620 tempest-ServerRescueNegativeTestJSON-1573931620-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 13:00:26.046906 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-3cd38316-62f2-45de-a35d-5dda37b74645 tempest-ServerRescueNegativeTestJSON-1573931620 tempest-ServerRescueNegativeTestJSON-1573931620-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 13:00:26.047750 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-3cd38316-62f2-45de-a35d-5dda37b74645 tempest-ServerRescueNegativeTestJSON-1573931620 tempest-ServerRescueNegativeTestJSON-1573931620-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 13:00:26.048178 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-3cd38316-62f2-45de-a35d-5dda37b74645 tempest-ServerRescueNegativeTestJSON-1573931620 tempest-ServerRescueNegativeTestJSON-1573931620-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 13:00:26.228995 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.policy [None req-ccac18ad-90b8-44fe-9fc1-5c922c6c1a6e tempest-AttachVolumeNegativeTest-1000400951 tempest-AttachVolumeNegativeTest-1000400951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57d0ec01f0784c8ea87d339980bed3cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad27b8951cae4eeeafa257f45217653a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116063) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 13:00:26.235761 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.policy [None req-3cd38316-62f2-45de-a35d-5dda37b74645 tempest-ServerRescueNegativeTestJSON-1573931620 tempest-ServerRescueNegativeTestJSON-1573931620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '731cbbfe17214ded8ac66299d66dfc45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '010919ea84eb4eb8b936c63153600eba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116064) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 13:00:26.236490 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: INFO nova.api.openstack.requestlog [None req-ccac18ad-90b8-44fe-9fc1-5c922c6c1a6e tempest-AttachVolumeNegativeTest-1000400951 tempest-AttachVolumeNegativeTest-1000400951-project] 10.222.0.49 "GET /compute/v2.1/servers/e79e4c5e-a1c6-4f80-9a63-d340231e3359" status: 200 len: 1507 microversion: 2.1 time: 0.230059 Dec 14 13:00:26.237096 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: [pid: 116063|app: 0|req: 227/430] 10.222.0.49 () {58 vars in 1235 bytes} [Tue Dec 14 13:00:26 2021] GET /compute/v2.1/servers/e79e4c5e-a1c6-4f80-9a63-d340231e3359 => generated 1507 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 14 13:00:26.243510 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: INFO nova.api.openstack.requestlog [None req-3cd38316-62f2-45de-a35d-5dda37b74645 tempest-ServerRescueNegativeTestJSON-1573931620 tempest-ServerRescueNegativeTestJSON-1573931620-project] 10.222.0.49 "GET /compute/v2.1/servers/eb6e04a4-8901-47df-9b51-7c1664bd3f6c" status: 200 len: 1523 microversion: 2.1 time: 0.208788 Dec 14 13:00:26.244072 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: [pid: 116064|app: 0|req: 204/431] 10.222.0.49 () {58 vars in 1235 bytes} [Tue Dec 14 13:00:26 2021] GET /compute/v2.1/servers/eb6e04a4-8901-47df-9b51-7c1664bd3f6c => generated 1523 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 14 13:00:26.332689 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.api.openstack.wsgi [None req-b99fedba-2516-4599-92c7-5758dcf6492b tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] Calling method '>' {{(pid=116063) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 13:00:26.333306 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.compute.api [None req-b99fedba-2516-4599-92c7-5758dcf6492b tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] [instance: c8de7730-62f2-4a77-b1e9-cf6a74fa366d] Fetching instance by UUID {{(pid=116063) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 13:00:26.340526 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-b99fedba-2516-4599-92c7-5758dcf6492b tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 13:00:26.341005 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-b99fedba-2516-4599-92c7-5758dcf6492b tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 13:00:26.341789 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-b99fedba-2516-4599-92c7-5758dcf6492b tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 13:00:26.342218 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-b99fedba-2516-4599-92c7-5758dcf6492b tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 13:00:26.501498 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.policy [None req-b99fedba-2516-4599-92c7-5758dcf6492b tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79d74a2ea1e541d28d085c15cec34032', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68a8770b8dbe489a8119016fbee64eb5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116063) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 13:00:26.510173 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.policy [None req-b99fedba-2516-4599-92c7-5758dcf6492b tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '79d74a2ea1e541d28d085c15cec34032', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68a8770b8dbe489a8119016fbee64eb5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116063) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 13:00:26.511928 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.policy [None req-b99fedba-2516-4599-92c7-5758dcf6492b tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '79d74a2ea1e541d28d085c15cec34032', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68a8770b8dbe489a8119016fbee64eb5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116063) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 13:00:26.513206 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: INFO nova.api.openstack.requestlog [None req-b99fedba-2516-4599-92c7-5758dcf6492b tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] 10.222.0.49 "GET /compute/v2.1/servers/c8de7730-62f2-4a77-b1e9-cf6a74fa366d" status: 200 len: 1724 microversion: 2.20 time: 0.184129 Dec 14 13:00:26.518216 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: [pid: 116063|app: 0|req: 228/432] 10.222.0.49 () {60 vars in 1276 bytes} [Tue Dec 14 13:00:26 2021] GET /compute/v2.1/servers/c8de7730-62f2-4a77-b1e9-cf6a74fa366d => generated 1724 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Dec 14 13:00:27.260524 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.api.openstack.wsgi [None req-3feeac7c-bdfa-4415-8aa0-61746991b3c0 tempest-ServerRescueNegativeTestJSON-1573931620 tempest-ServerRescueNegativeTestJSON-1573931620-project] Calling method '>' {{(pid=116064) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 13:00:27.261525 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.compute.api [None req-3feeac7c-bdfa-4415-8aa0-61746991b3c0 tempest-ServerRescueNegativeTestJSON-1573931620 tempest-ServerRescueNegativeTestJSON-1573931620-project] [instance: eb6e04a4-8901-47df-9b51-7c1664bd3f6c] Fetching instance by UUID {{(pid=116064) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 13:00:27.268334 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-3feeac7c-bdfa-4415-8aa0-61746991b3c0 tempest-ServerRescueNegativeTestJSON-1573931620 tempest-ServerRescueNegativeTestJSON-1573931620-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 13:00:27.268919 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-3feeac7c-bdfa-4415-8aa0-61746991b3c0 tempest-ServerRescueNegativeTestJSON-1573931620 tempest-ServerRescueNegativeTestJSON-1573931620-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 13:00:27.269894 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-3feeac7c-bdfa-4415-8aa0-61746991b3c0 tempest-ServerRescueNegativeTestJSON-1573931620 tempest-ServerRescueNegativeTestJSON-1573931620-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 13:00:27.270400 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-3feeac7c-bdfa-4415-8aa0-61746991b3c0 tempest-ServerRescueNegativeTestJSON-1573931620 tempest-ServerRescueNegativeTestJSON-1573931620-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 13:00:27.406586 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.policy [None req-3feeac7c-bdfa-4415-8aa0-61746991b3c0 tempest-ServerRescueNegativeTestJSON-1573931620 tempest-ServerRescueNegativeTestJSON-1573931620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '731cbbfe17214ded8ac66299d66dfc45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '010919ea84eb4eb8b936c63153600eba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116064) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 13:00:27.414224 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: INFO nova.api.openstack.requestlog [None req-3feeac7c-bdfa-4415-8aa0-61746991b3c0 tempest-ServerRescueNegativeTestJSON-1573931620 tempest-ServerRescueNegativeTestJSON-1573931620-project] 10.222.0.49 "GET /compute/v2.1/servers/eb6e04a4-8901-47df-9b51-7c1664bd3f6c" status: 200 len: 1523 microversion: 2.1 time: 0.157485 Dec 14 13:00:27.414797 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: [pid: 116064|app: 0|req: 205/433] 10.222.0.49 () {58 vars in 1235 bytes} [Tue Dec 14 13:00:27 2021] GET /compute/v2.1/servers/eb6e04a4-8901-47df-9b51-7c1664bd3f6c => generated 1523 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 14 13:00:27.532037 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.api.openstack.wsgi [None req-191d04ec-0e34-4b74-a98b-180e0d6d07cb tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] Calling method '>' {{(pid=116063) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 13:00:27.532653 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.compute.api [None req-191d04ec-0e34-4b74-a98b-180e0d6d07cb tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] [instance: c8de7730-62f2-4a77-b1e9-cf6a74fa366d] Fetching instance by UUID {{(pid=116063) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 13:00:27.539385 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-191d04ec-0e34-4b74-a98b-180e0d6d07cb tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 13:00:27.539817 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-191d04ec-0e34-4b74-a98b-180e0d6d07cb tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 13:00:27.540588 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-191d04ec-0e34-4b74-a98b-180e0d6d07cb tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 13:00:27.541047 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-191d04ec-0e34-4b74-a98b-180e0d6d07cb tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 13:00:27.587628 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.api.openstack.wsgi [None req-44cf4bf9-412c-4a9a-9aac-3421206ec5d0 tempest-AttachVolumeNegativeTest-1000400951 tempest-AttachVolumeNegativeTest-1000400951-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "95aec328-e5cf-45a4-9abc-8a95b574a60e"}} {{(pid=116064) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 14 13:00:27.588993 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.compute.api [None req-44cf4bf9-412c-4a9a-9aac-3421206ec5d0 tempest-AttachVolumeNegativeTest-1000400951 tempest-AttachVolumeNegativeTest-1000400951-project] [instance: e79e4c5e-a1c6-4f80-9a63-d340231e3359] Fetching instance by UUID {{(pid=116064) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 13:00:27.595180 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-44cf4bf9-412c-4a9a-9aac-3421206ec5d0 tempest-AttachVolumeNegativeTest-1000400951 tempest-AttachVolumeNegativeTest-1000400951-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 13:00:27.595746 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-44cf4bf9-412c-4a9a-9aac-3421206ec5d0 tempest-AttachVolumeNegativeTest-1000400951 tempest-AttachVolumeNegativeTest-1000400951-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 13:00:27.596712 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-44cf4bf9-412c-4a9a-9aac-3421206ec5d0 tempest-AttachVolumeNegativeTest-1000400951 tempest-AttachVolumeNegativeTest-1000400951-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 13:00:27.597317 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-44cf4bf9-412c-4a9a-9aac-3421206ec5d0 tempest-AttachVolumeNegativeTest-1000400951 tempest-AttachVolumeNegativeTest-1000400951-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 13:00:27.686172 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.policy [None req-191d04ec-0e34-4b74-a98b-180e0d6d07cb tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79d74a2ea1e541d28d085c15cec34032', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68a8770b8dbe489a8119016fbee64eb5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116063) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 13:00:27.696194 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.policy [None req-191d04ec-0e34-4b74-a98b-180e0d6d07cb tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '79d74a2ea1e541d28d085c15cec34032', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68a8770b8dbe489a8119016fbee64eb5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116063) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 13:00:27.698566 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.policy [None req-191d04ec-0e34-4b74-a98b-180e0d6d07cb tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '79d74a2ea1e541d28d085c15cec34032', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68a8770b8dbe489a8119016fbee64eb5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116063) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 13:00:27.700487 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: INFO nova.api.openstack.requestlog [None req-191d04ec-0e34-4b74-a98b-180e0d6d07cb tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] 10.222.0.49 "GET /compute/v2.1/servers/c8de7730-62f2-4a77-b1e9-cf6a74fa366d" status: 200 len: 1724 microversion: 2.20 time: 0.172346 Dec 14 13:00:27.713331 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: [pid: 116063|app: 0|req: 229/434] 10.222.0.49 () {60 vars in 1276 bytes} [Tue Dec 14 13:00:27 2021] GET /compute/v2.1/servers/c8de7730-62f2-4a77-b1e9-cf6a74fa366d => generated 1724 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 14 13:00:27.923356 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: INFO nova.api.openstack.requestlog [None req-44cf4bf9-412c-4a9a-9aac-3421206ec5d0 tempest-AttachVolumeNegativeTest-1000400951 tempest-AttachVolumeNegativeTest-1000400951-project] 10.222.0.49 "POST /compute/v2.1/servers/e79e4c5e-a1c6-4f80-9a63-d340231e3359/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.339317 Dec 14 13:00:27.923920 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: [pid: 116064|app: 0|req: 206/435] 10.222.0.49 () {60 vars in 1322 bytes} [Tue Dec 14 13:00:27 2021] POST /compute/v2.1/servers/e79e4c5e-a1c6-4f80-9a63-d340231e3359/os-volume_attachments => generated 194 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 14 13:00:28.436047 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.api.openstack.wsgi [None req-46b183e0-b3bc-4282-8897-eb95c5dfeeaa tempest-ServerRescueNegativeTestJSON-1573931620 tempest-ServerRescueNegativeTestJSON-1573931620-project] Calling method '>' {{(pid=116063) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 13:00:28.436682 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.compute.api [None req-46b183e0-b3bc-4282-8897-eb95c5dfeeaa tempest-ServerRescueNegativeTestJSON-1573931620 tempest-ServerRescueNegativeTestJSON-1573931620-project] [instance: eb6e04a4-8901-47df-9b51-7c1664bd3f6c] Fetching instance by UUID {{(pid=116063) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 13:00:28.442532 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-46b183e0-b3bc-4282-8897-eb95c5dfeeaa tempest-ServerRescueNegativeTestJSON-1573931620 tempest-ServerRescueNegativeTestJSON-1573931620-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 13:00:28.442970 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-46b183e0-b3bc-4282-8897-eb95c5dfeeaa tempest-ServerRescueNegativeTestJSON-1573931620 tempest-ServerRescueNegativeTestJSON-1573931620-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 13:00:28.443736 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-46b183e0-b3bc-4282-8897-eb95c5dfeeaa tempest-ServerRescueNegativeTestJSON-1573931620 tempest-ServerRescueNegativeTestJSON-1573931620-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 13:00:28.444130 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-46b183e0-b3bc-4282-8897-eb95c5dfeeaa tempest-ServerRescueNegativeTestJSON-1573931620 tempest-ServerRescueNegativeTestJSON-1573931620-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 13:00:28.595982 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.policy [None req-46b183e0-b3bc-4282-8897-eb95c5dfeeaa tempest-ServerRescueNegativeTestJSON-1573931620 tempest-ServerRescueNegativeTestJSON-1573931620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '731cbbfe17214ded8ac66299d66dfc45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '010919ea84eb4eb8b936c63153600eba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116063) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 13:00:28.603797 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: INFO nova.api.openstack.requestlog [None req-46b183e0-b3bc-4282-8897-eb95c5dfeeaa tempest-ServerRescueNegativeTestJSON-1573931620 tempest-ServerRescueNegativeTestJSON-1573931620-project] 10.222.0.49 "GET /compute/v2.1/servers/eb6e04a4-8901-47df-9b51-7c1664bd3f6c" status: 200 len: 1523 microversion: 2.1 time: 0.171407 Dec 14 13:00:28.604369 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: [pid: 116063|app: 0|req: 230/436] 10.222.0.49 () {58 vars in 1235 bytes} [Tue Dec 14 13:00:28 2021] GET /compute/v2.1/servers/eb6e04a4-8901-47df-9b51-7c1664bd3f6c => generated 1523 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 14 13:00:28.723070 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.api.openstack.wsgi [None req-799819d1-c036-4174-8553-a5b14b0b336f tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] Calling method '>' {{(pid=116064) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 13:00:28.723750 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.compute.api [None req-799819d1-c036-4174-8553-a5b14b0b336f tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] [instance: c8de7730-62f2-4a77-b1e9-cf6a74fa366d] Fetching instance by UUID {{(pid=116064) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 13:00:28.730343 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-799819d1-c036-4174-8553-a5b14b0b336f tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 13:00:28.730790 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-799819d1-c036-4174-8553-a5b14b0b336f tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 13:00:28.731567 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-799819d1-c036-4174-8553-a5b14b0b336f tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 13:00:28.732007 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-799819d1-c036-4174-8553-a5b14b0b336f tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 13:00:28.871603 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.policy [None req-799819d1-c036-4174-8553-a5b14b0b336f tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79d74a2ea1e541d28d085c15cec34032', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68a8770b8dbe489a8119016fbee64eb5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116064) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 13:00:28.879981 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.policy [None req-799819d1-c036-4174-8553-a5b14b0b336f tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '79d74a2ea1e541d28d085c15cec34032', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68a8770b8dbe489a8119016fbee64eb5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116064) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 13:00:28.881562 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.policy [None req-799819d1-c036-4174-8553-a5b14b0b336f tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '79d74a2ea1e541d28d085c15cec34032', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68a8770b8dbe489a8119016fbee64eb5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116064) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 13:00:28.883581 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: INFO nova.api.openstack.requestlog [None req-799819d1-c036-4174-8553-a5b14b0b336f tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] 10.222.0.49 "GET /compute/v2.1/servers/c8de7730-62f2-4a77-b1e9-cf6a74fa366d" status: 200 len: 1724 microversion: 2.20 time: 0.164341 Dec 14 13:00:28.884481 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: [pid: 116064|app: 0|req: 207/437] 10.222.0.49 () {60 vars in 1276 bytes} [Tue Dec 14 13:00:28 2021] GET /compute/v2.1/servers/c8de7730-62f2-4a77-b1e9-cf6a74fa366d => generated 1724 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 14 13:00:29.620340 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.api.openstack.wsgi [None req-eb3e8011-0999-41ed-9431-f0446e425a07 tempest-ServerRescueNegativeTestJSON-1573931620 tempest-ServerRescueNegativeTestJSON-1573931620-project] Calling method '>' {{(pid=116063) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 13:00:29.621000 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.compute.api [None req-eb3e8011-0999-41ed-9431-f0446e425a07 tempest-ServerRescueNegativeTestJSON-1573931620 tempest-ServerRescueNegativeTestJSON-1573931620-project] [instance: eb6e04a4-8901-47df-9b51-7c1664bd3f6c] Fetching instance by UUID {{(pid=116063) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 13:00:29.627620 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-eb3e8011-0999-41ed-9431-f0446e425a07 tempest-ServerRescueNegativeTestJSON-1573931620 tempest-ServerRescueNegativeTestJSON-1573931620-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 13:00:29.628064 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-eb3e8011-0999-41ed-9431-f0446e425a07 tempest-ServerRescueNegativeTestJSON-1573931620 tempest-ServerRescueNegativeTestJSON-1573931620-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 13:00:29.628837 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-eb3e8011-0999-41ed-9431-f0446e425a07 tempest-ServerRescueNegativeTestJSON-1573931620 tempest-ServerRescueNegativeTestJSON-1573931620-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 13:00:29.629297 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-eb3e8011-0999-41ed-9431-f0446e425a07 tempest-ServerRescueNegativeTestJSON-1573931620 tempest-ServerRescueNegativeTestJSON-1573931620-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 13:00:29.782637 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.policy [None req-eb3e8011-0999-41ed-9431-f0446e425a07 tempest-ServerRescueNegativeTestJSON-1573931620 tempest-ServerRescueNegativeTestJSON-1573931620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '731cbbfe17214ded8ac66299d66dfc45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '010919ea84eb4eb8b936c63153600eba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116063) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 13:00:29.790833 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: INFO nova.api.openstack.requestlog [None req-eb3e8011-0999-41ed-9431-f0446e425a07 tempest-ServerRescueNegativeTestJSON-1573931620 tempest-ServerRescueNegativeTestJSON-1573931620-project] 10.222.0.49 "GET /compute/v2.1/servers/eb6e04a4-8901-47df-9b51-7c1664bd3f6c" status: 200 len: 1523 microversion: 2.1 time: 0.174276 Dec 14 13:00:29.791377 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: [pid: 116063|app: 0|req: 231/438] 10.222.0.49 () {58 vars in 1235 bytes} [Tue Dec 14 13:00:29 2021] GET /compute/v2.1/servers/eb6e04a4-8901-47df-9b51-7c1664bd3f6c => generated 1523 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 14 13:00:29.902060 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.api.openstack.wsgi [None req-1e83cee6-f899-4a6f-88fa-ca735d6a4930 tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] Calling method '>' {{(pid=116064) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 13:00:29.902667 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.compute.api [None req-1e83cee6-f899-4a6f-88fa-ca735d6a4930 tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] [instance: c8de7730-62f2-4a77-b1e9-cf6a74fa366d] Fetching instance by UUID {{(pid=116064) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 13:00:29.909387 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-1e83cee6-f899-4a6f-88fa-ca735d6a4930 tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 13:00:29.909825 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-1e83cee6-f899-4a6f-88fa-ca735d6a4930 tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 13:00:29.910659 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-1e83cee6-f899-4a6f-88fa-ca735d6a4930 tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 13:00:29.911144 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-1e83cee6-f899-4a6f-88fa-ca735d6a4930 tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 13:00:30.053566 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.policy [None req-1e83cee6-f899-4a6f-88fa-ca735d6a4930 tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79d74a2ea1e541d28d085c15cec34032', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68a8770b8dbe489a8119016fbee64eb5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116064) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 13:00:30.061354 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.policy [None req-1e83cee6-f899-4a6f-88fa-ca735d6a4930 tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '79d74a2ea1e541d28d085c15cec34032', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68a8770b8dbe489a8119016fbee64eb5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116064) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 13:00:30.062914 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.policy [None req-1e83cee6-f899-4a6f-88fa-ca735d6a4930 tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '79d74a2ea1e541d28d085c15cec34032', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68a8770b8dbe489a8119016fbee64eb5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116064) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 13:00:30.064026 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: INFO nova.api.openstack.requestlog [None req-1e83cee6-f899-4a6f-88fa-ca735d6a4930 tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] 10.222.0.49 "GET /compute/v2.1/servers/c8de7730-62f2-4a77-b1e9-cf6a74fa366d" status: 200 len: 1724 microversion: 2.20 time: 0.165784 Dec 14 13:00:30.064622 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: [pid: 116064|app: 0|req: 208/439] 10.222.0.49 () {60 vars in 1276 bytes} [Tue Dec 14 13:00:29 2021] GET /compute/v2.1/servers/c8de7730-62f2-4a77-b1e9-cf6a74fa366d => generated 1724 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 14 13:00:30.812178 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.api.openstack.wsgi [None req-49dc05c7-cc37-4cce-a522-c6405748f900 tempest-ServerRescueNegativeTestJSON-1573931620 tempest-ServerRescueNegativeTestJSON-1573931620-project] Calling method '>' {{(pid=116063) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 13:00:30.813360 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.compute.api [None req-49dc05c7-cc37-4cce-a522-c6405748f900 tempest-ServerRescueNegativeTestJSON-1573931620 tempest-ServerRescueNegativeTestJSON-1573931620-project] [instance: eb6e04a4-8901-47df-9b51-7c1664bd3f6c] Fetching instance by UUID {{(pid=116063) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 13:00:30.823842 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-49dc05c7-cc37-4cce-a522-c6405748f900 tempest-ServerRescueNegativeTestJSON-1573931620 tempest-ServerRescueNegativeTestJSON-1573931620-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 13:00:30.824580 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-49dc05c7-cc37-4cce-a522-c6405748f900 tempest-ServerRescueNegativeTestJSON-1573931620 tempest-ServerRescueNegativeTestJSON-1573931620-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 13:00:30.825902 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-49dc05c7-cc37-4cce-a522-c6405748f900 tempest-ServerRescueNegativeTestJSON-1573931620 tempest-ServerRescueNegativeTestJSON-1573931620-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 13:00:30.826611 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-49dc05c7-cc37-4cce-a522-c6405748f900 tempest-ServerRescueNegativeTestJSON-1573931620 tempest-ServerRescueNegativeTestJSON-1573931620-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 13:00:30.992237 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.policy [None req-49dc05c7-cc37-4cce-a522-c6405748f900 tempest-ServerRescueNegativeTestJSON-1573931620 tempest-ServerRescueNegativeTestJSON-1573931620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '731cbbfe17214ded8ac66299d66dfc45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '010919ea84eb4eb8b936c63153600eba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116063) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 13:00:31.000156 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: INFO nova.api.openstack.requestlog [None req-49dc05c7-cc37-4cce-a522-c6405748f900 tempest-ServerRescueNegativeTestJSON-1573931620 tempest-ServerRescueNegativeTestJSON-1573931620-project] 10.222.0.49 "GET /compute/v2.1/servers/eb6e04a4-8901-47df-9b51-7c1664bd3f6c" status: 200 len: 1523 microversion: 2.1 time: 0.193996 Dec 14 13:00:31.000739 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: [pid: 116063|app: 0|req: 232/440] 10.222.0.49 () {58 vars in 1235 bytes} [Tue Dec 14 13:00:30 2021] GET /compute/v2.1/servers/eb6e04a4-8901-47df-9b51-7c1664bd3f6c => generated 1523 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 14 13:00:31.086572 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.api.openstack.wsgi [None req-13473c47-4148-4ab7-9baa-4425c0523e97 tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] Calling method '>' {{(pid=116064) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 13:00:31.087644 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.compute.api [None req-13473c47-4148-4ab7-9baa-4425c0523e97 tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] [instance: c8de7730-62f2-4a77-b1e9-cf6a74fa366d] Fetching instance by UUID {{(pid=116064) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 13:00:31.097907 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-13473c47-4148-4ab7-9baa-4425c0523e97 tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 13:00:31.098604 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-13473c47-4148-4ab7-9baa-4425c0523e97 tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 13:00:31.099383 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-13473c47-4148-4ab7-9baa-4425c0523e97 tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 13:00:31.099807 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-13473c47-4148-4ab7-9baa-4425c0523e97 tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 13:00:31.229099 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.policy [None req-13473c47-4148-4ab7-9baa-4425c0523e97 tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79d74a2ea1e541d28d085c15cec34032', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68a8770b8dbe489a8119016fbee64eb5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116064) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 13:00:31.237582 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.policy [None req-13473c47-4148-4ab7-9baa-4425c0523e97 tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '79d74a2ea1e541d28d085c15cec34032', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68a8770b8dbe489a8119016fbee64eb5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116064) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 13:00:31.239091 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.policy [None req-13473c47-4148-4ab7-9baa-4425c0523e97 tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '79d74a2ea1e541d28d085c15cec34032', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68a8770b8dbe489a8119016fbee64eb5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116064) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 13:00:31.240251 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: INFO nova.api.openstack.requestlog [None req-13473c47-4148-4ab7-9baa-4425c0523e97 tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] 10.222.0.49 "GET /compute/v2.1/servers/c8de7730-62f2-4a77-b1e9-cf6a74fa366d" status: 200 len: 1724 microversion: 2.20 time: 0.160106 Dec 14 13:00:31.240871 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: [pid: 116064|app: 0|req: 209/441] 10.222.0.49 () {60 vars in 1276 bytes} [Tue Dec 14 13:00:31 2021] GET /compute/v2.1/servers/c8de7730-62f2-4a77-b1e9-cf6a74fa366d => generated 1724 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 14 13:00:32.021481 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.api.openstack.wsgi [None req-beaecd0c-02da-4c23-850c-273f6f39de7d tempest-ServerRescueNegativeTestJSON-1573931620 tempest-ServerRescueNegativeTestJSON-1573931620-project] Calling method '>' {{(pid=116063) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 13:00:32.022319 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.compute.api [None req-beaecd0c-02da-4c23-850c-273f6f39de7d tempest-ServerRescueNegativeTestJSON-1573931620 tempest-ServerRescueNegativeTestJSON-1573931620-project] [instance: eb6e04a4-8901-47df-9b51-7c1664bd3f6c] Fetching instance by UUID {{(pid=116063) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 13:00:32.033470 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-beaecd0c-02da-4c23-850c-273f6f39de7d tempest-ServerRescueNegativeTestJSON-1573931620 tempest-ServerRescueNegativeTestJSON-1573931620-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 13:00:32.034210 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-beaecd0c-02da-4c23-850c-273f6f39de7d tempest-ServerRescueNegativeTestJSON-1573931620 tempest-ServerRescueNegativeTestJSON-1573931620-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 13:00:32.035583 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-beaecd0c-02da-4c23-850c-273f6f39de7d tempest-ServerRescueNegativeTestJSON-1573931620 tempest-ServerRescueNegativeTestJSON-1573931620-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 13:00:32.036484 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-beaecd0c-02da-4c23-850c-273f6f39de7d tempest-ServerRescueNegativeTestJSON-1573931620 tempest-ServerRescueNegativeTestJSON-1573931620-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 13:00:32.182908 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.policy [None req-beaecd0c-02da-4c23-850c-273f6f39de7d tempest-ServerRescueNegativeTestJSON-1573931620 tempest-ServerRescueNegativeTestJSON-1573931620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '731cbbfe17214ded8ac66299d66dfc45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '010919ea84eb4eb8b936c63153600eba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116063) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 13:00:32.190775 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: INFO nova.api.openstack.requestlog [None req-beaecd0c-02da-4c23-850c-273f6f39de7d tempest-ServerRescueNegativeTestJSON-1573931620 tempest-ServerRescueNegativeTestJSON-1573931620-project] 10.222.0.49 "GET /compute/v2.1/servers/eb6e04a4-8901-47df-9b51-7c1664bd3f6c" status: 200 len: 1523 microversion: 2.1 time: 0.175825 Dec 14 13:00:32.191335 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: [pid: 116063|app: 0|req: 233/442] 10.222.0.49 () {58 vars in 1235 bytes} [Tue Dec 14 13:00:32 2021] GET /compute/v2.1/servers/eb6e04a4-8901-47df-9b51-7c1664bd3f6c => generated 1523 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 14 13:00:32.262783 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.api.openstack.wsgi [None req-e868b2e0-a39f-413c-bbb3-a102275b9587 tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] Calling method '>' {{(pid=116064) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 13:00:32.263941 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.compute.api [None req-e868b2e0-a39f-413c-bbb3-a102275b9587 tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] [instance: c8de7730-62f2-4a77-b1e9-cf6a74fa366d] Fetching instance by UUID {{(pid=116064) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 13:00:32.273503 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-e868b2e0-a39f-413c-bbb3-a102275b9587 tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 13:00:32.273900 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-e868b2e0-a39f-413c-bbb3-a102275b9587 tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 13:00:32.274693 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-e868b2e0-a39f-413c-bbb3-a102275b9587 tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 13:00:32.275129 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-e868b2e0-a39f-413c-bbb3-a102275b9587 tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 13:00:32.412342 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.policy [None req-e868b2e0-a39f-413c-bbb3-a102275b9587 tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79d74a2ea1e541d28d085c15cec34032', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68a8770b8dbe489a8119016fbee64eb5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116064) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 13:00:32.421078 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.policy [None req-e868b2e0-a39f-413c-bbb3-a102275b9587 tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '79d74a2ea1e541d28d085c15cec34032', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68a8770b8dbe489a8119016fbee64eb5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116064) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 13:00:32.423146 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.policy [None req-e868b2e0-a39f-413c-bbb3-a102275b9587 tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '79d74a2ea1e541d28d085c15cec34032', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68a8770b8dbe489a8119016fbee64eb5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116064) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 13:00:32.424463 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: INFO nova.api.openstack.requestlog [None req-e868b2e0-a39f-413c-bbb3-a102275b9587 tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] 10.222.0.49 "GET /compute/v2.1/servers/c8de7730-62f2-4a77-b1e9-cf6a74fa366d" status: 200 len: 1724 microversion: 2.20 time: 0.167969 Dec 14 13:00:32.425377 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: [pid: 116064|app: 0|req: 210/443] 10.222.0.49 () {60 vars in 1276 bytes} [Tue Dec 14 13:00:32 2021] GET /compute/v2.1/servers/c8de7730-62f2-4a77-b1e9-cf6a74fa366d => generated 1724 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 14 13:00:33.210171 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.api.openstack.wsgi [None req-b14fff47-6272-4f1a-822f-c39cf7e6114a tempest-ServerRescueNegativeTestJSON-1573931620 tempest-ServerRescueNegativeTestJSON-1573931620-project] Calling method '>' {{(pid=116063) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 13:00:33.210802 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.compute.api [None req-b14fff47-6272-4f1a-822f-c39cf7e6114a tempest-ServerRescueNegativeTestJSON-1573931620 tempest-ServerRescueNegativeTestJSON-1573931620-project] [instance: eb6e04a4-8901-47df-9b51-7c1664bd3f6c] Fetching instance by UUID {{(pid=116063) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 13:00:33.217348 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-b14fff47-6272-4f1a-822f-c39cf7e6114a tempest-ServerRescueNegativeTestJSON-1573931620 tempest-ServerRescueNegativeTestJSON-1573931620-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 13:00:33.217799 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-b14fff47-6272-4f1a-822f-c39cf7e6114a tempest-ServerRescueNegativeTestJSON-1573931620 tempest-ServerRescueNegativeTestJSON-1573931620-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 13:00:33.218570 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-b14fff47-6272-4f1a-822f-c39cf7e6114a tempest-ServerRescueNegativeTestJSON-1573931620 tempest-ServerRescueNegativeTestJSON-1573931620-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 13:00:33.218994 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-b14fff47-6272-4f1a-822f-c39cf7e6114a tempest-ServerRescueNegativeTestJSON-1573931620 tempest-ServerRescueNegativeTestJSON-1573931620-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 13:00:33.353862 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.policy [None req-b14fff47-6272-4f1a-822f-c39cf7e6114a tempest-ServerRescueNegativeTestJSON-1573931620 tempest-ServerRescueNegativeTestJSON-1573931620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '731cbbfe17214ded8ac66299d66dfc45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '010919ea84eb4eb8b936c63153600eba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116063) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 13:00:33.361704 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: INFO nova.api.openstack.requestlog [None req-b14fff47-6272-4f1a-822f-c39cf7e6114a tempest-ServerRescueNegativeTestJSON-1573931620 tempest-ServerRescueNegativeTestJSON-1573931620-project] 10.222.0.49 "GET /compute/v2.1/servers/eb6e04a4-8901-47df-9b51-7c1664bd3f6c" status: 200 len: 1523 microversion: 2.1 time: 0.156622 Dec 14 13:00:33.362283 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: [pid: 116063|app: 0|req: 234/444] 10.222.0.49 () {58 vars in 1235 bytes} [Tue Dec 14 13:00:33 2021] GET /compute/v2.1/servers/eb6e04a4-8901-47df-9b51-7c1664bd3f6c => generated 1523 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 14 13:00:33.446014 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.api.openstack.wsgi [None req-63d408fc-8a7a-4019-aac0-69bb15a13b46 tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] Calling method '>' {{(pid=116064) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 13:00:33.446857 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.compute.api [None req-63d408fc-8a7a-4019-aac0-69bb15a13b46 tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] [instance: c8de7730-62f2-4a77-b1e9-cf6a74fa366d] Fetching instance by UUID {{(pid=116064) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 13:00:33.453480 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-63d408fc-8a7a-4019-aac0-69bb15a13b46 tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 13:00:33.453848 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-63d408fc-8a7a-4019-aac0-69bb15a13b46 tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 13:00:33.454663 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-63d408fc-8a7a-4019-aac0-69bb15a13b46 tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 13:00:33.455099 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-63d408fc-8a7a-4019-aac0-69bb15a13b46 tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 13:00:33.589613 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.policy [None req-63d408fc-8a7a-4019-aac0-69bb15a13b46 tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79d74a2ea1e541d28d085c15cec34032', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68a8770b8dbe489a8119016fbee64eb5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116064) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 13:00:33.597933 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.policy [None req-63d408fc-8a7a-4019-aac0-69bb15a13b46 tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '79d74a2ea1e541d28d085c15cec34032', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68a8770b8dbe489a8119016fbee64eb5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116064) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 13:00:33.599487 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.policy [None req-63d408fc-8a7a-4019-aac0-69bb15a13b46 tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '79d74a2ea1e541d28d085c15cec34032', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68a8770b8dbe489a8119016fbee64eb5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116064) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 13:00:33.600674 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: INFO nova.api.openstack.requestlog [None req-63d408fc-8a7a-4019-aac0-69bb15a13b46 tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] 10.222.0.49 "GET /compute/v2.1/servers/c8de7730-62f2-4a77-b1e9-cf6a74fa366d" status: 200 len: 1724 microversion: 2.20 time: 0.159283 Dec 14 13:00:33.601279 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: [pid: 116064|app: 0|req: 211/445] 10.222.0.49 () {60 vars in 1276 bytes} [Tue Dec 14 13:00:33 2021] GET /compute/v2.1/servers/c8de7730-62f2-4a77-b1e9-cf6a74fa366d => generated 1724 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 14 13:00:34.381596 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.api.openstack.wsgi [None req-de0f77f6-00b0-43a5-a568-71576da81bde tempest-ServerRescueNegativeTestJSON-1573931620 tempest-ServerRescueNegativeTestJSON-1573931620-project] Calling method '>' {{(pid=116063) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 13:00:34.382185 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.compute.api [None req-de0f77f6-00b0-43a5-a568-71576da81bde tempest-ServerRescueNegativeTestJSON-1573931620 tempest-ServerRescueNegativeTestJSON-1573931620-project] [instance: eb6e04a4-8901-47df-9b51-7c1664bd3f6c] Fetching instance by UUID {{(pid=116063) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 13:00:34.389231 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-de0f77f6-00b0-43a5-a568-71576da81bde tempest-ServerRescueNegativeTestJSON-1573931620 tempest-ServerRescueNegativeTestJSON-1573931620-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 13:00:34.389727 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-de0f77f6-00b0-43a5-a568-71576da81bde tempest-ServerRescueNegativeTestJSON-1573931620 tempest-ServerRescueNegativeTestJSON-1573931620-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 13:00:34.390559 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-de0f77f6-00b0-43a5-a568-71576da81bde tempest-ServerRescueNegativeTestJSON-1573931620 tempest-ServerRescueNegativeTestJSON-1573931620-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 13:00:34.390990 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-de0f77f6-00b0-43a5-a568-71576da81bde tempest-ServerRescueNegativeTestJSON-1573931620 tempest-ServerRescueNegativeTestJSON-1573931620-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 13:00:34.525747 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.policy [None req-de0f77f6-00b0-43a5-a568-71576da81bde tempest-ServerRescueNegativeTestJSON-1573931620 tempest-ServerRescueNegativeTestJSON-1573931620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '731cbbfe17214ded8ac66299d66dfc45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '010919ea84eb4eb8b936c63153600eba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116063) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 13:00:34.533868 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: INFO nova.api.openstack.requestlog [None req-de0f77f6-00b0-43a5-a568-71576da81bde tempest-ServerRescueNegativeTestJSON-1573931620 tempest-ServerRescueNegativeTestJSON-1573931620-project] 10.222.0.49 "GET /compute/v2.1/servers/eb6e04a4-8901-47df-9b51-7c1664bd3f6c" status: 200 len: 1523 microversion: 2.1 time: 0.157703 Dec 14 13:00:34.534527 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: [pid: 116063|app: 0|req: 235/446] 10.222.0.49 () {58 vars in 1235 bytes} [Tue Dec 14 13:00:34 2021] GET /compute/v2.1/servers/eb6e04a4-8901-47df-9b51-7c1664bd3f6c => generated 1523 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 14 13:00:34.619609 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.api.openstack.wsgi [None req-9277d00f-f538-4cb8-8c3e-675432f5b3a7 tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] Calling method '>' {{(pid=116064) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 13:00:34.620178 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.compute.api [None req-9277d00f-f538-4cb8-8c3e-675432f5b3a7 tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] [instance: c8de7730-62f2-4a77-b1e9-cf6a74fa366d] Fetching instance by UUID {{(pid=116064) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 13:00:34.626903 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-9277d00f-f538-4cb8-8c3e-675432f5b3a7 tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 13:00:34.627345 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-9277d00f-f538-4cb8-8c3e-675432f5b3a7 tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 13:00:34.628112 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-9277d00f-f538-4cb8-8c3e-675432f5b3a7 tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 13:00:34.628539 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-9277d00f-f538-4cb8-8c3e-675432f5b3a7 tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 13:00:34.767777 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.policy [None req-9277d00f-f538-4cb8-8c3e-675432f5b3a7 tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79d74a2ea1e541d28d085c15cec34032', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68a8770b8dbe489a8119016fbee64eb5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116064) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 13:00:34.777231 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.policy [None req-9277d00f-f538-4cb8-8c3e-675432f5b3a7 tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '79d74a2ea1e541d28d085c15cec34032', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68a8770b8dbe489a8119016fbee64eb5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116064) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 13:00:34.778672 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.policy [None req-9277d00f-f538-4cb8-8c3e-675432f5b3a7 tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '79d74a2ea1e541d28d085c15cec34032', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68a8770b8dbe489a8119016fbee64eb5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116064) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 13:00:34.779888 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: INFO nova.api.openstack.requestlog [None req-9277d00f-f538-4cb8-8c3e-675432f5b3a7 tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] 10.222.0.49 "GET /compute/v2.1/servers/c8de7730-62f2-4a77-b1e9-cf6a74fa366d" status: 200 len: 1724 microversion: 2.20 time: 0.164034 Dec 14 13:00:34.780450 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: [pid: 116064|app: 0|req: 212/447] 10.222.0.49 () {60 vars in 1276 bytes} [Tue Dec 14 13:00:34 2021] GET /compute/v2.1/servers/c8de7730-62f2-4a77-b1e9-cf6a74fa366d => generated 1724 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 14 13:00:35.556107 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.api.openstack.wsgi [None req-d2436abe-7e70-4010-a027-57cd3f95ad5f tempest-ServerRescueNegativeTestJSON-1573931620 tempest-ServerRescueNegativeTestJSON-1573931620-project] Calling method '>' {{(pid=116063) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 13:00:35.557244 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.compute.api [None req-d2436abe-7e70-4010-a027-57cd3f95ad5f tempest-ServerRescueNegativeTestJSON-1573931620 tempest-ServerRescueNegativeTestJSON-1573931620-project] [instance: eb6e04a4-8901-47df-9b51-7c1664bd3f6c] Fetching instance by UUID {{(pid=116063) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 13:00:35.568694 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-d2436abe-7e70-4010-a027-57cd3f95ad5f tempest-ServerRescueNegativeTestJSON-1573931620 tempest-ServerRescueNegativeTestJSON-1573931620-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 13:00:35.569012 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-d2436abe-7e70-4010-a027-57cd3f95ad5f tempest-ServerRescueNegativeTestJSON-1573931620 tempest-ServerRescueNegativeTestJSON-1573931620-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 13:00:35.569866 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-d2436abe-7e70-4010-a027-57cd3f95ad5f tempest-ServerRescueNegativeTestJSON-1573931620 tempest-ServerRescueNegativeTestJSON-1573931620-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 13:00:35.570300 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-d2436abe-7e70-4010-a027-57cd3f95ad5f tempest-ServerRescueNegativeTestJSON-1573931620 tempest-ServerRescueNegativeTestJSON-1573931620-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 13:00:35.718341 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.policy [None req-d2436abe-7e70-4010-a027-57cd3f95ad5f tempest-ServerRescueNegativeTestJSON-1573931620 tempest-ServerRescueNegativeTestJSON-1573931620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '731cbbfe17214ded8ac66299d66dfc45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '010919ea84eb4eb8b936c63153600eba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116063) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 13:00:35.727351 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: INFO nova.api.openstack.requestlog [None req-d2436abe-7e70-4010-a027-57cd3f95ad5f tempest-ServerRescueNegativeTestJSON-1573931620 tempest-ServerRescueNegativeTestJSON-1573931620-project] 10.222.0.49 "GET /compute/v2.1/servers/eb6e04a4-8901-47df-9b51-7c1664bd3f6c" status: 200 len: 1523 microversion: 2.1 time: 0.178316 Dec 14 13:00:35.727933 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: [pid: 116063|app: 0|req: 236/448] 10.222.0.49 () {58 vars in 1235 bytes} [Tue Dec 14 13:00:35 2021] GET /compute/v2.1/servers/eb6e04a4-8901-47df-9b51-7c1664bd3f6c => generated 1523 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 14 13:00:35.799972 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.api.openstack.wsgi [None req-b4aee314-1557-45dd-82a2-2bf87533198c tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] Calling method '>' {{(pid=116064) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 13:00:35.800552 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.compute.api [None req-b4aee314-1557-45dd-82a2-2bf87533198c tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] [instance: c8de7730-62f2-4a77-b1e9-cf6a74fa366d] Fetching instance by UUID {{(pid=116064) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 13:00:35.807369 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-b4aee314-1557-45dd-82a2-2bf87533198c tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 13:00:35.807819 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-b4aee314-1557-45dd-82a2-2bf87533198c tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 13:00:35.808596 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-b4aee314-1557-45dd-82a2-2bf87533198c tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 13:00:35.809069 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-b4aee314-1557-45dd-82a2-2bf87533198c tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 13:00:35.943588 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.policy [None req-b4aee314-1557-45dd-82a2-2bf87533198c tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79d74a2ea1e541d28d085c15cec34032', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68a8770b8dbe489a8119016fbee64eb5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116064) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 13:00:35.951470 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.policy [None req-b4aee314-1557-45dd-82a2-2bf87533198c tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '79d74a2ea1e541d28d085c15cec34032', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68a8770b8dbe489a8119016fbee64eb5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116064) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 13:00:35.953112 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.policy [None req-b4aee314-1557-45dd-82a2-2bf87533198c tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '79d74a2ea1e541d28d085c15cec34032', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68a8770b8dbe489a8119016fbee64eb5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116064) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 13:00:35.954256 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: INFO nova.api.openstack.requestlog [None req-b4aee314-1557-45dd-82a2-2bf87533198c tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] 10.222.0.49 "GET /compute/v2.1/servers/c8de7730-62f2-4a77-b1e9-cf6a74fa366d" status: 200 len: 1724 microversion: 2.20 time: 0.158460 Dec 14 13:00:35.954806 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: [pid: 116064|app: 0|req: 213/449] 10.222.0.49 () {60 vars in 1276 bytes} [Tue Dec 14 13:00:35 2021] GET /compute/v2.1/servers/c8de7730-62f2-4a77-b1e9-cf6a74fa366d => generated 1724 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 14 13:00:36.744653 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.api.openstack.wsgi [None req-3b8346aa-4763-4f21-89b9-af3ac736f371 tempest-ServerRescueNegativeTestJSON-1573931620 tempest-ServerRescueNegativeTestJSON-1573931620-project] Calling method '>' {{(pid=116063) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 13:00:36.745251 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.compute.api [None req-3b8346aa-4763-4f21-89b9-af3ac736f371 tempest-ServerRescueNegativeTestJSON-1573931620 tempest-ServerRescueNegativeTestJSON-1573931620-project] [instance: eb6e04a4-8901-47df-9b51-7c1664bd3f6c] Fetching instance by UUID {{(pid=116063) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 13:00:36.752061 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-3b8346aa-4763-4f21-89b9-af3ac736f371 tempest-ServerRescueNegativeTestJSON-1573931620 tempest-ServerRescueNegativeTestJSON-1573931620-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 13:00:36.752543 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-3b8346aa-4763-4f21-89b9-af3ac736f371 tempest-ServerRescueNegativeTestJSON-1573931620 tempest-ServerRescueNegativeTestJSON-1573931620-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 13:00:36.753532 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-3b8346aa-4763-4f21-89b9-af3ac736f371 tempest-ServerRescueNegativeTestJSON-1573931620 tempest-ServerRescueNegativeTestJSON-1573931620-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 13:00:36.753972 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-3b8346aa-4763-4f21-89b9-af3ac736f371 tempest-ServerRescueNegativeTestJSON-1573931620 tempest-ServerRescueNegativeTestJSON-1573931620-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 13:00:36.912014 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.policy [None req-3b8346aa-4763-4f21-89b9-af3ac736f371 tempest-ServerRescueNegativeTestJSON-1573931620 tempest-ServerRescueNegativeTestJSON-1573931620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '731cbbfe17214ded8ac66299d66dfc45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '010919ea84eb4eb8b936c63153600eba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116063) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 13:00:36.919689 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: INFO nova.api.openstack.requestlog [None req-3b8346aa-4763-4f21-89b9-af3ac736f371 tempest-ServerRescueNegativeTestJSON-1573931620 tempest-ServerRescueNegativeTestJSON-1573931620-project] 10.222.0.49 "GET /compute/v2.1/servers/eb6e04a4-8901-47df-9b51-7c1664bd3f6c" status: 200 len: 1503 microversion: 2.1 time: 0.178844 Dec 14 13:00:36.920265 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: [pid: 116063|app: 0|req: 237/450] 10.222.0.49 () {58 vars in 1235 bytes} [Tue Dec 14 13:00:36 2021] GET /compute/v2.1/servers/eb6e04a4-8901-47df-9b51-7c1664bd3f6c => generated 1503 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 14 13:00:36.936975 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.api.openstack.wsgi [None req-10c8ad11-6677-47a3-b2d3-5fb3851cd224 tempest-ServerRescueNegativeTestJSON-1573931620 tempest-ServerRescueNegativeTestJSON-1573931620-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "f5219b71-61ba-4945-ac1f-fb474bbc6fdb"}} {{(pid=116064) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 14 13:00:36.938090 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.compute.api [None req-10c8ad11-6677-47a3-b2d3-5fb3851cd224 tempest-ServerRescueNegativeTestJSON-1573931620 tempest-ServerRescueNegativeTestJSON-1573931620-project] [instance: eb6e04a4-8901-47df-9b51-7c1664bd3f6c] Fetching instance by UUID {{(pid=116064) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 13:00:36.944464 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-10c8ad11-6677-47a3-b2d3-5fb3851cd224 tempest-ServerRescueNegativeTestJSON-1573931620 tempest-ServerRescueNegativeTestJSON-1573931620-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 13:00:36.946541 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-10c8ad11-6677-47a3-b2d3-5fb3851cd224 tempest-ServerRescueNegativeTestJSON-1573931620 tempest-ServerRescueNegativeTestJSON-1573931620-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 13:00:36.946541 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-10c8ad11-6677-47a3-b2d3-5fb3851cd224 tempest-ServerRescueNegativeTestJSON-1573931620 tempest-ServerRescueNegativeTestJSON-1573931620-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 13:00:36.946541 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-10c8ad11-6677-47a3-b2d3-5fb3851cd224 tempest-ServerRescueNegativeTestJSON-1573931620 tempest-ServerRescueNegativeTestJSON-1573931620-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 13:00:36.970458 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: INFO nova.api.openstack.wsgi [None req-10c8ad11-6677-47a3-b2d3-5fb3851cd224 tempest-ServerRescueNegativeTestJSON-1573931620 tempest-ServerRescueNegativeTestJSON-1573931620-project] HTTP exception thrown: Cannot 'attach_volume' instance eb6e04a4-8901-47df-9b51-7c1664bd3f6c while it is in vm_state rescued Dec 14 13:00:36.971050 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.api.openstack.wsgi [None req-10c8ad11-6677-47a3-b2d3-5fb3851cd224 tempest-ServerRescueNegativeTestJSON-1573931620 tempest-ServerRescueNegativeTestJSON-1573931620-project] Returning 409 to user: Cannot 'attach_volume' instance eb6e04a4-8901-47df-9b51-7c1664bd3f6c while it is in vm_state rescued {{(pid=116064) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 14 13:00:36.971765 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.api.openstack.wsgi [None req-09c916b7-104b-45ee-869d-86bd5c38b4c7 tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] Calling method '>' {{(pid=116063) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 13:00:36.972058 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: INFO nova.api.openstack.requestlog [None req-10c8ad11-6677-47a3-b2d3-5fb3851cd224 tempest-ServerRescueNegativeTestJSON-1573931620 tempest-ServerRescueNegativeTestJSON-1573931620-project] 10.222.0.49 "POST /compute/v2.1/servers/eb6e04a4-8901-47df-9b51-7c1664bd3f6c/os-volume_attachments" status: 409 len: 152 microversion: 2.1 time: 0.038915 Dec 14 13:00:36.972375 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.compute.api [None req-09c916b7-104b-45ee-869d-86bd5c38b4c7 tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] [instance: c8de7730-62f2-4a77-b1e9-cf6a74fa366d] Fetching instance by UUID {{(pid=116063) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 13:00:36.972595 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: [pid: 116064|app: 0|req: 214/451] 10.222.0.49 () {60 vars in 1322 bytes} [Tue Dec 14 13:00:36 2021] POST /compute/v2.1/servers/eb6e04a4-8901-47df-9b51-7c1664bd3f6c/os-volume_attachments => generated 152 bytes in 40 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Dec 14 13:00:36.978881 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-09c916b7-104b-45ee-869d-86bd5c38b4c7 tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 13:00:36.979352 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-09c916b7-104b-45ee-869d-86bd5c38b4c7 tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 13:00:36.980117 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-09c916b7-104b-45ee-869d-86bd5c38b4c7 tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 13:00:36.980558 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-09c916b7-104b-45ee-869d-86bd5c38b4c7 tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 13:00:36.980874 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.api.openstack.wsgi [None req-967b527e-234c-4a48-a52b-3072b9692e7b tempest-ServerRescueNegativeTestJSON-1573931620 tempest-ServerRescueNegativeTestJSON-1573931620-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=116064) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 14 13:00:36.981395 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.compute.api [None req-967b527e-234c-4a48-a52b-3072b9692e7b tempest-ServerRescueNegativeTestJSON-1573931620 tempest-ServerRescueNegativeTestJSON-1573931620-project] [instance: eb6e04a4-8901-47df-9b51-7c1664bd3f6c] Fetching instance by UUID {{(pid=116064) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 13:00:36.987362 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-967b527e-234c-4a48-a52b-3072b9692e7b tempest-ServerRescueNegativeTestJSON-1573931620 tempest-ServerRescueNegativeTestJSON-1573931620-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 13:00:36.987819 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-967b527e-234c-4a48-a52b-3072b9692e7b tempest-ServerRescueNegativeTestJSON-1573931620 tempest-ServerRescueNegativeTestJSON-1573931620-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 13:00:36.988634 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-967b527e-234c-4a48-a52b-3072b9692e7b tempest-ServerRescueNegativeTestJSON-1573931620 tempest-ServerRescueNegativeTestJSON-1573931620-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 13:00:36.989098 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-967b527e-234c-4a48-a52b-3072b9692e7b tempest-ServerRescueNegativeTestJSON-1573931620 tempest-ServerRescueNegativeTestJSON-1573931620-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 13:00:37.057398 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: INFO nova.api.openstack.requestlog [None req-967b527e-234c-4a48-a52b-3072b9692e7b tempest-ServerRescueNegativeTestJSON-1573931620 tempest-ServerRescueNegativeTestJSON-1573931620-project] 10.222.0.49 "POST /compute/v2.1/servers/eb6e04a4-8901-47df-9b51-7c1664bd3f6c/action" status: 202 len: 0 microversion: 2.1 time: 0.079147 Dec 14 13:00:37.058201 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: [pid: 116064|app: 0|req: 215/452] 10.222.0.49 () {60 vars in 1277 bytes} [Tue Dec 14 13:00:36 2021] POST /compute/v2.1/servers/eb6e04a4-8901-47df-9b51-7c1664bd3f6c/action => generated 0 bytes in 81 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Dec 14 13:00:37.066892 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.api.openstack.wsgi [None req-9d72c5ca-def0-449a-ba4a-d512d4b4bf80 tempest-ServerRescueNegativeTestJSON-1573931620 tempest-ServerRescueNegativeTestJSON-1573931620-project] Calling method '>' {{(pid=116064) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 13:00:37.067614 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.compute.api [None req-9d72c5ca-def0-449a-ba4a-d512d4b4bf80 tempest-ServerRescueNegativeTestJSON-1573931620 tempest-ServerRescueNegativeTestJSON-1573931620-project] [instance: eb6e04a4-8901-47df-9b51-7c1664bd3f6c] Fetching instance by UUID {{(pid=116064) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 13:00:37.076798 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-9d72c5ca-def0-449a-ba4a-d512d4b4bf80 tempest-ServerRescueNegativeTestJSON-1573931620 tempest-ServerRescueNegativeTestJSON-1573931620-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 13:00:37.077605 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-9d72c5ca-def0-449a-ba4a-d512d4b4bf80 tempest-ServerRescueNegativeTestJSON-1573931620 tempest-ServerRescueNegativeTestJSON-1573931620-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 13:00:37.078389 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-9d72c5ca-def0-449a-ba4a-d512d4b4bf80 tempest-ServerRescueNegativeTestJSON-1573931620 tempest-ServerRescueNegativeTestJSON-1573931620-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 13:00:37.078822 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-9d72c5ca-def0-449a-ba4a-d512d4b4bf80 tempest-ServerRescueNegativeTestJSON-1573931620 tempest-ServerRescueNegativeTestJSON-1573931620-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 13:00:37.114516 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.policy [None req-09c916b7-104b-45ee-869d-86bd5c38b4c7 tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79d74a2ea1e541d28d085c15cec34032', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68a8770b8dbe489a8119016fbee64eb5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116063) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 13:00:37.122523 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.policy [None req-09c916b7-104b-45ee-869d-86bd5c38b4c7 tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '79d74a2ea1e541d28d085c15cec34032', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68a8770b8dbe489a8119016fbee64eb5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116063) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 13:00:37.124026 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.policy [None req-09c916b7-104b-45ee-869d-86bd5c38b4c7 tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '79d74a2ea1e541d28d085c15cec34032', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68a8770b8dbe489a8119016fbee64eb5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116063) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 13:00:37.125207 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: INFO nova.api.openstack.requestlog [None req-09c916b7-104b-45ee-869d-86bd5c38b4c7 tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] 10.222.0.49 "GET /compute/v2.1/servers/c8de7730-62f2-4a77-b1e9-cf6a74fa366d" status: 200 len: 1724 microversion: 2.20 time: 0.157176 Dec 14 13:00:37.125801 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: [pid: 116063|app: 0|req: 238/453] 10.222.0.49 () {60 vars in 1276 bytes} [Tue Dec 14 13:00:36 2021] GET /compute/v2.1/servers/c8de7730-62f2-4a77-b1e9-cf6a74fa366d => generated 1724 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Dec 14 13:00:37.215006 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.policy [None req-9d72c5ca-def0-449a-ba4a-d512d4b4bf80 tempest-ServerRescueNegativeTestJSON-1573931620 tempest-ServerRescueNegativeTestJSON-1573931620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '731cbbfe17214ded8ac66299d66dfc45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '010919ea84eb4eb8b936c63153600eba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116064) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 13:00:37.224240 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: INFO nova.api.openstack.requestlog [None req-9d72c5ca-def0-449a-ba4a-d512d4b4bf80 tempest-ServerRescueNegativeTestJSON-1573931620 tempest-ServerRescueNegativeTestJSON-1573931620-project] 10.222.0.49 "GET /compute/v2.1/servers/eb6e04a4-8901-47df-9b51-7c1664bd3f6c" status: 200 len: 1511 microversion: 2.1 time: 0.161456 Dec 14 13:00:37.224886 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: [pid: 116064|app: 0|req: 216/454] 10.222.0.49 () {58 vars in 1235 bytes} [Tue Dec 14 13:00:37 2021] GET /compute/v2.1/servers/eb6e04a4-8901-47df-9b51-7c1664bd3f6c => generated 1511 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 14 13:00:38.147252 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.api.openstack.wsgi [None req-76702759-d826-4451-972b-1d5f701cfa41 tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] Calling method '>' {{(pid=116063) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 13:00:38.148250 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.compute.api [None req-76702759-d826-4451-972b-1d5f701cfa41 tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] [instance: c8de7730-62f2-4a77-b1e9-cf6a74fa366d] Fetching instance by UUID {{(pid=116063) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 13:00:38.158757 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-76702759-d826-4451-972b-1d5f701cfa41 tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 13:00:38.159506 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-76702759-d826-4451-972b-1d5f701cfa41 tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 13:00:38.160729 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-76702759-d826-4451-972b-1d5f701cfa41 tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 13:00:38.161551 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-76702759-d826-4451-972b-1d5f701cfa41 tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 13:00:38.242027 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.api.openstack.wsgi [None req-185e16a5-88b0-432d-a9ff-aaf1b2d45989 tempest-ServerRescueNegativeTestJSON-1573931620 tempest-ServerRescueNegativeTestJSON-1573931620-project] Calling method '>' {{(pid=116064) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 13:00:38.242590 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.compute.api [None req-185e16a5-88b0-432d-a9ff-aaf1b2d45989 tempest-ServerRescueNegativeTestJSON-1573931620 tempest-ServerRescueNegativeTestJSON-1573931620-project] [instance: eb6e04a4-8901-47df-9b51-7c1664bd3f6c] Fetching instance by UUID {{(pid=116064) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 13:00:38.249792 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-185e16a5-88b0-432d-a9ff-aaf1b2d45989 tempest-ServerRescueNegativeTestJSON-1573931620 tempest-ServerRescueNegativeTestJSON-1573931620-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 13:00:38.250346 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-185e16a5-88b0-432d-a9ff-aaf1b2d45989 tempest-ServerRescueNegativeTestJSON-1573931620 tempest-ServerRescueNegativeTestJSON-1573931620-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 13:00:38.251151 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-185e16a5-88b0-432d-a9ff-aaf1b2d45989 tempest-ServerRescueNegativeTestJSON-1573931620 tempest-ServerRescueNegativeTestJSON-1573931620-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 13:00:38.251588 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-185e16a5-88b0-432d-a9ff-aaf1b2d45989 tempest-ServerRescueNegativeTestJSON-1573931620 tempest-ServerRescueNegativeTestJSON-1573931620-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 13:00:38.305180 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.policy [None req-76702759-d826-4451-972b-1d5f701cfa41 tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79d74a2ea1e541d28d085c15cec34032', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68a8770b8dbe489a8119016fbee64eb5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116063) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 13:00:38.313403 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.policy [None req-76702759-d826-4451-972b-1d5f701cfa41 tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '79d74a2ea1e541d28d085c15cec34032', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68a8770b8dbe489a8119016fbee64eb5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116063) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 13:00:38.314899 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.policy [None req-76702759-d826-4451-972b-1d5f701cfa41 tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '79d74a2ea1e541d28d085c15cec34032', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68a8770b8dbe489a8119016fbee64eb5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116063) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 13:00:38.316055 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: INFO nova.api.openstack.requestlog [None req-76702759-d826-4451-972b-1d5f701cfa41 tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] 10.222.0.49 "GET /compute/v2.1/servers/c8de7730-62f2-4a77-b1e9-cf6a74fa366d" status: 200 len: 1724 microversion: 2.20 time: 0.174991 Dec 14 13:00:38.316614 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: [pid: 116063|app: 0|req: 239/455] 10.222.0.49 () {60 vars in 1276 bytes} [Tue Dec 14 13:00:38 2021] GET /compute/v2.1/servers/c8de7730-62f2-4a77-b1e9-cf6a74fa366d => generated 1724 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 14 13:00:38.393873 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.policy [None req-185e16a5-88b0-432d-a9ff-aaf1b2d45989 tempest-ServerRescueNegativeTestJSON-1573931620 tempest-ServerRescueNegativeTestJSON-1573931620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '731cbbfe17214ded8ac66299d66dfc45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '010919ea84eb4eb8b936c63153600eba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116064) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 13:00:38.401501 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: INFO nova.api.openstack.requestlog [None req-185e16a5-88b0-432d-a9ff-aaf1b2d45989 tempest-ServerRescueNegativeTestJSON-1573931620 tempest-ServerRescueNegativeTestJSON-1573931620-project] 10.222.0.49 "GET /compute/v2.1/servers/eb6e04a4-8901-47df-9b51-7c1664bd3f6c" status: 200 len: 1511 microversion: 2.1 time: 0.163308 Dec 14 13:00:38.402071 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: [pid: 116064|app: 0|req: 217/456] 10.222.0.49 () {58 vars in 1235 bytes} [Tue Dec 14 13:00:38 2021] GET /compute/v2.1/servers/eb6e04a4-8901-47df-9b51-7c1664bd3f6c => generated 1511 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 14 13:00:39.334436 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.api.openstack.wsgi [None req-e280b70d-5eed-4ed4-b375-025b30679ecf tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] Calling method '>' {{(pid=116063) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 13:00:39.335173 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.compute.api [None req-e280b70d-5eed-4ed4-b375-025b30679ecf tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] [instance: c8de7730-62f2-4a77-b1e9-cf6a74fa366d] Fetching instance by UUID {{(pid=116063) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 13:00:39.341852 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-e280b70d-5eed-4ed4-b375-025b30679ecf tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 13:00:39.342370 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-e280b70d-5eed-4ed4-b375-025b30679ecf tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 13:00:39.343087 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-e280b70d-5eed-4ed4-b375-025b30679ecf tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 13:00:39.343524 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-e280b70d-5eed-4ed4-b375-025b30679ecf tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 13:00:39.419168 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.api.openstack.wsgi [None req-0482b1dc-7145-4a44-afd9-4cea841ff7fe tempest-ServerRescueNegativeTestJSON-1573931620 tempest-ServerRescueNegativeTestJSON-1573931620-project] Calling method '>' {{(pid=116064) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 13:00:39.419807 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.compute.api [None req-0482b1dc-7145-4a44-afd9-4cea841ff7fe tempest-ServerRescueNegativeTestJSON-1573931620 tempest-ServerRescueNegativeTestJSON-1573931620-project] [instance: eb6e04a4-8901-47df-9b51-7c1664bd3f6c] Fetching instance by UUID {{(pid=116064) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 13:00:39.426835 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-0482b1dc-7145-4a44-afd9-4cea841ff7fe tempest-ServerRescueNegativeTestJSON-1573931620 tempest-ServerRescueNegativeTestJSON-1573931620-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 13:00:39.427188 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-0482b1dc-7145-4a44-afd9-4cea841ff7fe tempest-ServerRescueNegativeTestJSON-1573931620 tempest-ServerRescueNegativeTestJSON-1573931620-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 13:00:39.433930 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-0482b1dc-7145-4a44-afd9-4cea841ff7fe tempest-ServerRescueNegativeTestJSON-1573931620 tempest-ServerRescueNegativeTestJSON-1573931620-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 13:00:39.434393 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-0482b1dc-7145-4a44-afd9-4cea841ff7fe tempest-ServerRescueNegativeTestJSON-1573931620 tempest-ServerRescueNegativeTestJSON-1573931620-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 13:00:39.519802 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.policy [None req-e280b70d-5eed-4ed4-b375-025b30679ecf tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79d74a2ea1e541d28d085c15cec34032', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68a8770b8dbe489a8119016fbee64eb5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116063) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 13:00:39.528587 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.policy [None req-e280b70d-5eed-4ed4-b375-025b30679ecf tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '79d74a2ea1e541d28d085c15cec34032', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68a8770b8dbe489a8119016fbee64eb5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116063) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 13:00:39.530109 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.policy [None req-e280b70d-5eed-4ed4-b375-025b30679ecf tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '79d74a2ea1e541d28d085c15cec34032', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68a8770b8dbe489a8119016fbee64eb5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116063) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 13:00:39.531320 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: INFO nova.api.openstack.requestlog [None req-e280b70d-5eed-4ed4-b375-025b30679ecf tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] 10.222.0.49 "GET /compute/v2.1/servers/c8de7730-62f2-4a77-b1e9-cf6a74fa366d" status: 200 len: 1724 microversion: 2.20 time: 0.200687 Dec 14 13:00:39.531897 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: [pid: 116063|app: 0|req: 240/457] 10.222.0.49 () {60 vars in 1276 bytes} [Tue Dec 14 13:00:39 2021] GET /compute/v2.1/servers/c8de7730-62f2-4a77-b1e9-cf6a74fa366d => generated 1724 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 14 13:00:39.600108 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.policy [None req-0482b1dc-7145-4a44-afd9-4cea841ff7fe tempest-ServerRescueNegativeTestJSON-1573931620 tempest-ServerRescueNegativeTestJSON-1573931620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '731cbbfe17214ded8ac66299d66dfc45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '010919ea84eb4eb8b936c63153600eba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116064) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 13:00:39.608382 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: INFO nova.api.openstack.requestlog [None req-0482b1dc-7145-4a44-afd9-4cea841ff7fe tempest-ServerRescueNegativeTestJSON-1573931620 tempest-ServerRescueNegativeTestJSON-1573931620-project] 10.222.0.49 "GET /compute/v2.1/servers/eb6e04a4-8901-47df-9b51-7c1664bd3f6c" status: 200 len: 1511 microversion: 2.1 time: 0.193145 Dec 14 13:00:39.608976 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: [pid: 116064|app: 0|req: 218/458] 10.222.0.49 () {58 vars in 1235 bytes} [Tue Dec 14 13:00:39 2021] GET /compute/v2.1/servers/eb6e04a4-8901-47df-9b51-7c1664bd3f6c => generated 1511 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 14 13:00:40.550731 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.api.openstack.wsgi [None req-3b6062d6-061c-4387-9a95-7eab88533ee9 tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] Calling method '>' {{(pid=116063) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 13:00:40.551375 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.compute.api [None req-3b6062d6-061c-4387-9a95-7eab88533ee9 tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] [instance: c8de7730-62f2-4a77-b1e9-cf6a74fa366d] Fetching instance by UUID {{(pid=116063) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 13:00:40.558060 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-3b6062d6-061c-4387-9a95-7eab88533ee9 tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 13:00:40.558494 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-3b6062d6-061c-4387-9a95-7eab88533ee9 tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 13:00:40.559257 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-3b6062d6-061c-4387-9a95-7eab88533ee9 tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 13:00:40.559679 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-3b6062d6-061c-4387-9a95-7eab88533ee9 tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 13:00:40.625316 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.api.openstack.wsgi [None req-d297a5a1-4a3f-426f-a57f-76d9def99aba tempest-ServerRescueNegativeTestJSON-1573931620 tempest-ServerRescueNegativeTestJSON-1573931620-project] Calling method '>' {{(pid=116064) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 13:00:40.625912 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.compute.api [None req-d297a5a1-4a3f-426f-a57f-76d9def99aba tempest-ServerRescueNegativeTestJSON-1573931620 tempest-ServerRescueNegativeTestJSON-1573931620-project] [instance: eb6e04a4-8901-47df-9b51-7c1664bd3f6c] Fetching instance by UUID {{(pid=116064) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 13:00:40.633040 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-d297a5a1-4a3f-426f-a57f-76d9def99aba tempest-ServerRescueNegativeTestJSON-1573931620 tempest-ServerRescueNegativeTestJSON-1573931620-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 13:00:40.633509 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-d297a5a1-4a3f-426f-a57f-76d9def99aba tempest-ServerRescueNegativeTestJSON-1573931620 tempest-ServerRescueNegativeTestJSON-1573931620-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 13:00:40.634477 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-d297a5a1-4a3f-426f-a57f-76d9def99aba tempest-ServerRescueNegativeTestJSON-1573931620 tempest-ServerRescueNegativeTestJSON-1573931620-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 13:00:40.634715 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-d297a5a1-4a3f-426f-a57f-76d9def99aba tempest-ServerRescueNegativeTestJSON-1573931620 tempest-ServerRescueNegativeTestJSON-1573931620-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 13:00:40.735181 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.policy [None req-3b6062d6-061c-4387-9a95-7eab88533ee9 tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79d74a2ea1e541d28d085c15cec34032', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68a8770b8dbe489a8119016fbee64eb5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116063) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 13:00:40.744922 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.policy [None req-3b6062d6-061c-4387-9a95-7eab88533ee9 tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '79d74a2ea1e541d28d085c15cec34032', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68a8770b8dbe489a8119016fbee64eb5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116063) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 13:00:40.746474 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.policy [None req-3b6062d6-061c-4387-9a95-7eab88533ee9 tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '79d74a2ea1e541d28d085c15cec34032', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68a8770b8dbe489a8119016fbee64eb5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116063) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 13:00:40.747628 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: INFO nova.api.openstack.requestlog [None req-3b6062d6-061c-4387-9a95-7eab88533ee9 tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] 10.222.0.49 "GET /compute/v2.1/servers/c8de7730-62f2-4a77-b1e9-cf6a74fa366d" status: 200 len: 1745 microversion: 2.20 time: 0.201385 Dec 14 13:00:40.748540 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: [pid: 116063|app: 0|req: 241/459] 10.222.0.49 () {60 vars in 1276 bytes} [Tue Dec 14 13:00:40 2021] GET /compute/v2.1/servers/c8de7730-62f2-4a77-b1e9-cf6a74fa366d => generated 1745 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 14 13:00:40.798531 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.policy [None req-d297a5a1-4a3f-426f-a57f-76d9def99aba tempest-ServerRescueNegativeTestJSON-1573931620 tempest-ServerRescueNegativeTestJSON-1573931620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '731cbbfe17214ded8ac66299d66dfc45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '010919ea84eb4eb8b936c63153600eba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116064) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 13:00:40.806145 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: INFO nova.api.openstack.requestlog [None req-d297a5a1-4a3f-426f-a57f-76d9def99aba tempest-ServerRescueNegativeTestJSON-1573931620 tempest-ServerRescueNegativeTestJSON-1573931620-project] 10.222.0.49 "GET /compute/v2.1/servers/eb6e04a4-8901-47df-9b51-7c1664bd3f6c" status: 200 len: 1511 microversion: 2.1 time: 0.184506 Dec 14 13:00:40.806716 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: [pid: 116064|app: 0|req: 219/460] 10.222.0.49 () {58 vars in 1235 bytes} [Tue Dec 14 13:00:40 2021] GET /compute/v2.1/servers/eb6e04a4-8901-47df-9b51-7c1664bd3f6c => generated 1511 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 14 13:00:40.831024 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.api.openstack.wsgi [None req-24072ce4-fdc7-400a-ae1b-300015626ab8 tempest-AttachVolumeNegativeTest-1000400951 tempest-AttachVolumeNegativeTest-1000400951-project] Calling method '>' {{(pid=116063) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 13:00:40.833108 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.compute.api [None req-24072ce4-fdc7-400a-ae1b-300015626ab8 tempest-AttachVolumeNegativeTest-1000400951 tempest-AttachVolumeNegativeTest-1000400951-project] [instance: e79e4c5e-a1c6-4f80-9a63-d340231e3359] Fetching instance by UUID {{(pid=116063) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 13:00:40.839345 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-24072ce4-fdc7-400a-ae1b-300015626ab8 tempest-AttachVolumeNegativeTest-1000400951 tempest-AttachVolumeNegativeTest-1000400951-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 13:00:40.839799 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-24072ce4-fdc7-400a-ae1b-300015626ab8 tempest-AttachVolumeNegativeTest-1000400951 tempest-AttachVolumeNegativeTest-1000400951-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 13:00:40.840588 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-24072ce4-fdc7-400a-ae1b-300015626ab8 tempest-AttachVolumeNegativeTest-1000400951 tempest-AttachVolumeNegativeTest-1000400951-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 13:00:40.841047 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-24072ce4-fdc7-400a-ae1b-300015626ab8 tempest-AttachVolumeNegativeTest-1000400951 tempest-AttachVolumeNegativeTest-1000400951-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 13:00:40.924187 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.objects.instance [None req-24072ce4-fdc7-400a-ae1b-300015626ab8 tempest-AttachVolumeNegativeTest-1000400951 tempest-AttachVolumeNegativeTest-1000400951-project] Lazy-loading 'services' on Instance uuid e79e4c5e-a1c6-4f80-9a63-d340231e3359 {{(pid=116063) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Dec 14 13:00:40.997643 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: INFO nova.api.openstack.requestlog [None req-24072ce4-fdc7-400a-ae1b-300015626ab8 tempest-AttachVolumeNegativeTest-1000400951 tempest-AttachVolumeNegativeTest-1000400951-project] 10.222.0.49 "DELETE /compute/v2.1/servers/e79e4c5e-a1c6-4f80-9a63-d340231e3359/os-volume_attachments/95aec328-e5cf-45a4-9abc-8a95b574a60e" status: 202 len: 0 microversion: 2.1 time: 0.170363 Dec 14 13:00:40.998461 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: [pid: 116063|app: 0|req: 242/461] 10.222.0.49 () {58 vars in 1415 bytes} [Tue Dec 14 13:00:40 2021] DELETE /compute/v2.1/servers/e79e4c5e-a1c6-4f80-9a63-d340231e3359/os-volume_attachments/95aec328-e5cf-45a4-9abc-8a95b574a60e => generated 0 bytes in 172 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Dec 14 13:00:41.006936 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.api.openstack.wsgi [None req-5176b435-596f-46fc-8997-a794df77353e tempest-AttachVolumeNegativeTest-1000400951 tempest-AttachVolumeNegativeTest-1000400951-project] Calling method '>' {{(pid=116064) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 13:00:41.008481 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.compute.api [None req-5176b435-596f-46fc-8997-a794df77353e tempest-AttachVolumeNegativeTest-1000400951 tempest-AttachVolumeNegativeTest-1000400951-project] [instance: e79e4c5e-a1c6-4f80-9a63-d340231e3359] Fetching instance by UUID {{(pid=116064) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 13:00:41.014997 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-5176b435-596f-46fc-8997-a794df77353e tempest-AttachVolumeNegativeTest-1000400951 tempest-AttachVolumeNegativeTest-1000400951-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 13:00:41.015536 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-5176b435-596f-46fc-8997-a794df77353e tempest-AttachVolumeNegativeTest-1000400951 tempest-AttachVolumeNegativeTest-1000400951-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 13:00:41.016472 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-5176b435-596f-46fc-8997-a794df77353e tempest-AttachVolumeNegativeTest-1000400951 tempest-AttachVolumeNegativeTest-1000400951-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 13:00:41.017069 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-5176b435-596f-46fc-8997-a794df77353e tempest-AttachVolumeNegativeTest-1000400951 tempest-AttachVolumeNegativeTest-1000400951-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 13:00:41.047695 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: INFO nova.api.openstack.requestlog [None req-5176b435-596f-46fc-8997-a794df77353e tempest-AttachVolumeNegativeTest-1000400951 tempest-AttachVolumeNegativeTest-1000400951-project] 10.222.0.49 "GET /compute/v2.1/servers/e79e4c5e-a1c6-4f80-9a63-d340231e3359/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044806 Dec 14 13:00:41.048631 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: [pid: 116064|app: 0|req: 220/462] 10.222.0.49 () {58 vars in 1301 bytes} [Tue Dec 14 13:00:41 2021] GET /compute/v2.1/servers/e79e4c5e-a1c6-4f80-9a63-d340231e3359/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 14 13:00:41.771869 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.api.openstack.wsgi [None req-d2a6c1a9-0025-4d56-a74e-c2a54a0d3261 tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] Calling method '>' {{(pid=116063) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 13:00:41.773074 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.compute.api [None req-d2a6c1a9-0025-4d56-a74e-c2a54a0d3261 tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] [instance: c8de7730-62f2-4a77-b1e9-cf6a74fa366d] Fetching instance by UUID {{(pid=116063) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 13:00:41.780486 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-d2a6c1a9-0025-4d56-a74e-c2a54a0d3261 tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 13:00:41.781021 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-d2a6c1a9-0025-4d56-a74e-c2a54a0d3261 tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 13:00:41.781884 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-d2a6c1a9-0025-4d56-a74e-c2a54a0d3261 tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 13:00:41.782361 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-d2a6c1a9-0025-4d56-a74e-c2a54a0d3261 tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 13:00:41.822580 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.api.openstack.wsgi [None req-bd88b728-7db9-40d6-9378-fe5b70a1a407 tempest-ServerRescueNegativeTestJSON-1573931620 tempest-ServerRescueNegativeTestJSON-1573931620-project] Calling method '>' {{(pid=116064) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 13:00:41.823233 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.compute.api [None req-bd88b728-7db9-40d6-9378-fe5b70a1a407 tempest-ServerRescueNegativeTestJSON-1573931620 tempest-ServerRescueNegativeTestJSON-1573931620-project] [instance: eb6e04a4-8901-47df-9b51-7c1664bd3f6c] Fetching instance by UUID {{(pid=116064) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 13:00:41.831342 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-bd88b728-7db9-40d6-9378-fe5b70a1a407 tempest-ServerRescueNegativeTestJSON-1573931620 tempest-ServerRescueNegativeTestJSON-1573931620-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 13:00:41.831797 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-bd88b728-7db9-40d6-9378-fe5b70a1a407 tempest-ServerRescueNegativeTestJSON-1573931620 tempest-ServerRescueNegativeTestJSON-1573931620-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 13:00:41.832607 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-bd88b728-7db9-40d6-9378-fe5b70a1a407 tempest-ServerRescueNegativeTestJSON-1573931620 tempest-ServerRescueNegativeTestJSON-1573931620-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 13:00:41.833052 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-bd88b728-7db9-40d6-9378-fe5b70a1a407 tempest-ServerRescueNegativeTestJSON-1573931620 tempest-ServerRescueNegativeTestJSON-1573931620-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 13:00:41.958653 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.policy [None req-d2a6c1a9-0025-4d56-a74e-c2a54a0d3261 tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79d74a2ea1e541d28d085c15cec34032', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68a8770b8dbe489a8119016fbee64eb5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116063) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 13:00:41.966517 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.policy [None req-d2a6c1a9-0025-4d56-a74e-c2a54a0d3261 tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '79d74a2ea1e541d28d085c15cec34032', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68a8770b8dbe489a8119016fbee64eb5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116063) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 13:00:41.968026 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.policy [None req-d2a6c1a9-0025-4d56-a74e-c2a54a0d3261 tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '79d74a2ea1e541d28d085c15cec34032', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68a8770b8dbe489a8119016fbee64eb5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116063) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 13:00:41.969237 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: INFO nova.api.openstack.requestlog [None req-d2a6c1a9-0025-4d56-a74e-c2a54a0d3261 tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] 10.222.0.49 "GET /compute/v2.1/servers/c8de7730-62f2-4a77-b1e9-cf6a74fa366d" status: 200 len: 1745 microversion: 2.20 time: 0.205007 Dec 14 13:00:41.969993 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: [pid: 116063|app: 0|req: 243/463] 10.222.0.49 () {60 vars in 1276 bytes} [Tue Dec 14 13:00:41 2021] GET /compute/v2.1/servers/c8de7730-62f2-4a77-b1e9-cf6a74fa366d => generated 1745 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 14 13:00:41.994274 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.policy [None req-bd88b728-7db9-40d6-9378-fe5b70a1a407 tempest-ServerRescueNegativeTestJSON-1573931620 tempest-ServerRescueNegativeTestJSON-1573931620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '731cbbfe17214ded8ac66299d66dfc45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '010919ea84eb4eb8b936c63153600eba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116064) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 13:00:42.002295 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: INFO nova.api.openstack.requestlog [None req-bd88b728-7db9-40d6-9378-fe5b70a1a407 tempest-ServerRescueNegativeTestJSON-1573931620 tempest-ServerRescueNegativeTestJSON-1573931620-project] 10.222.0.49 "GET /compute/v2.1/servers/eb6e04a4-8901-47df-9b51-7c1664bd3f6c" status: 200 len: 1511 microversion: 2.1 time: 0.183371 Dec 14 13:00:42.002835 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: [pid: 116064|app: 0|req: 221/464] 10.222.0.49 () {58 vars in 1235 bytes} [Tue Dec 14 13:00:41 2021] GET /compute/v2.1/servers/eb6e04a4-8901-47df-9b51-7c1664bd3f6c => generated 1511 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 14 13:00:42.063512 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.api.openstack.wsgi [None req-90292a8d-5b25-4004-8f58-3c5c8b5071f0 tempest-AttachVolumeNegativeTest-1000400951 tempest-AttachVolumeNegativeTest-1000400951-project] Calling method '>' {{(pid=116063) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 13:00:42.065360 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.compute.api [None req-90292a8d-5b25-4004-8f58-3c5c8b5071f0 tempest-AttachVolumeNegativeTest-1000400951 tempest-AttachVolumeNegativeTest-1000400951-project] [instance: e79e4c5e-a1c6-4f80-9a63-d340231e3359] Fetching instance by UUID {{(pid=116063) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 13:00:42.074625 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-90292a8d-5b25-4004-8f58-3c5c8b5071f0 tempest-AttachVolumeNegativeTest-1000400951 tempest-AttachVolumeNegativeTest-1000400951-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 13:00:42.075074 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-90292a8d-5b25-4004-8f58-3c5c8b5071f0 tempest-AttachVolumeNegativeTest-1000400951 tempest-AttachVolumeNegativeTest-1000400951-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 13:00:42.075852 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-90292a8d-5b25-4004-8f58-3c5c8b5071f0 tempest-AttachVolumeNegativeTest-1000400951 tempest-AttachVolumeNegativeTest-1000400951-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 13:00:42.076283 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-90292a8d-5b25-4004-8f58-3c5c8b5071f0 tempest-AttachVolumeNegativeTest-1000400951 tempest-AttachVolumeNegativeTest-1000400951-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 13:00:42.105357 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: INFO nova.api.openstack.requestlog [None req-90292a8d-5b25-4004-8f58-3c5c8b5071f0 tempest-AttachVolumeNegativeTest-1000400951 tempest-AttachVolumeNegativeTest-1000400951-project] 10.222.0.49 "GET /compute/v2.1/servers/e79e4c5e-a1c6-4f80-9a63-d340231e3359/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048166 Dec 14 13:00:42.105894 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: [pid: 116063|app: 0|req: 244/465] 10.222.0.49 () {58 vars in 1301 bytes} [Tue Dec 14 13:00:42 2021] GET /compute/v2.1/servers/e79e4c5e-a1c6-4f80-9a63-d340231e3359/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 14 13:00:42.987481 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.api.openstack.wsgi [None req-1ac77ec5-1a6a-40f7-afab-3c29fcbfeb81 tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] Calling method '>' {{(pid=116064) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 13:00:42.988087 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.compute.api [None req-1ac77ec5-1a6a-40f7-afab-3c29fcbfeb81 tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] [instance: c8de7730-62f2-4a77-b1e9-cf6a74fa366d] Fetching instance by UUID {{(pid=116064) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 13:00:42.994796 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-1ac77ec5-1a6a-40f7-afab-3c29fcbfeb81 tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 13:00:42.995238 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-1ac77ec5-1a6a-40f7-afab-3c29fcbfeb81 tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 13:00:42.996004 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-1ac77ec5-1a6a-40f7-afab-3c29fcbfeb81 tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 13:00:42.996427 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-1ac77ec5-1a6a-40f7-afab-3c29fcbfeb81 tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 13:00:43.019364 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.api.openstack.wsgi [None req-66150349-600f-43ba-9673-8b5887ed5d6f tempest-ServerRescueNegativeTestJSON-1573931620 tempest-ServerRescueNegativeTestJSON-1573931620-project] Calling method '>' {{(pid=116063) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 13:00:43.019959 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.compute.api [None req-66150349-600f-43ba-9673-8b5887ed5d6f tempest-ServerRescueNegativeTestJSON-1573931620 tempest-ServerRescueNegativeTestJSON-1573931620-project] [instance: eb6e04a4-8901-47df-9b51-7c1664bd3f6c] Fetching instance by UUID {{(pid=116063) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 13:00:43.026652 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-66150349-600f-43ba-9673-8b5887ed5d6f tempest-ServerRescueNegativeTestJSON-1573931620 tempest-ServerRescueNegativeTestJSON-1573931620-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 13:00:43.027109 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-66150349-600f-43ba-9673-8b5887ed5d6f tempest-ServerRescueNegativeTestJSON-1573931620 tempest-ServerRescueNegativeTestJSON-1573931620-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 13:00:43.027894 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-66150349-600f-43ba-9673-8b5887ed5d6f tempest-ServerRescueNegativeTestJSON-1573931620 tempest-ServerRescueNegativeTestJSON-1573931620-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 13:00:43.028332 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-66150349-600f-43ba-9673-8b5887ed5d6f tempest-ServerRescueNegativeTestJSON-1573931620 tempest-ServerRescueNegativeTestJSON-1573931620-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 13:00:43.175712 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.policy [None req-1ac77ec5-1a6a-40f7-afab-3c29fcbfeb81 tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79d74a2ea1e541d28d085c15cec34032', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68a8770b8dbe489a8119016fbee64eb5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116064) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 13:00:43.184596 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.policy [None req-1ac77ec5-1a6a-40f7-afab-3c29fcbfeb81 tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '79d74a2ea1e541d28d085c15cec34032', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68a8770b8dbe489a8119016fbee64eb5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116064) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 13:00:43.186126 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.policy [None req-1ac77ec5-1a6a-40f7-afab-3c29fcbfeb81 tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '79d74a2ea1e541d28d085c15cec34032', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68a8770b8dbe489a8119016fbee64eb5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116064) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 13:00:43.187308 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: INFO nova.api.openstack.requestlog [None req-1ac77ec5-1a6a-40f7-afab-3c29fcbfeb81 tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] 10.222.0.49 "GET /compute/v2.1/servers/c8de7730-62f2-4a77-b1e9-cf6a74fa366d" status: 200 len: 1745 microversion: 2.20 time: 0.203553 Dec 14 13:00:43.187869 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: [pid: 116064|app: 0|req: 222/466] 10.222.0.49 () {60 vars in 1276 bytes} [Tue Dec 14 13:00:42 2021] GET /compute/v2.1/servers/c8de7730-62f2-4a77-b1e9-cf6a74fa366d => generated 1745 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 14 13:00:43.198340 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.api.openstack.wsgi [None req-de3483d6-352e-4e71-a23e-b0f24395ccfd tempest-AttachVolumeNegativeTest-1000400951 tempest-AttachVolumeNegativeTest-1000400951-project] Calling method '>' {{(pid=116064) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 13:00:43.198340 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.compute.api [None req-de3483d6-352e-4e71-a23e-b0f24395ccfd tempest-AttachVolumeNegativeTest-1000400951 tempest-AttachVolumeNegativeTest-1000400951-project] [instance: e79e4c5e-a1c6-4f80-9a63-d340231e3359] Fetching instance by UUID {{(pid=116064) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 13:00:43.198746 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-de3483d6-352e-4e71-a23e-b0f24395ccfd tempest-AttachVolumeNegativeTest-1000400951 tempest-AttachVolumeNegativeTest-1000400951-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 13:00:43.199192 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-de3483d6-352e-4e71-a23e-b0f24395ccfd tempest-AttachVolumeNegativeTest-1000400951 tempest-AttachVolumeNegativeTest-1000400951-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 13:00:43.199962 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-de3483d6-352e-4e71-a23e-b0f24395ccfd tempest-AttachVolumeNegativeTest-1000400951 tempest-AttachVolumeNegativeTest-1000400951-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 13:00:43.200388 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-de3483d6-352e-4e71-a23e-b0f24395ccfd tempest-AttachVolumeNegativeTest-1000400951 tempest-AttachVolumeNegativeTest-1000400951-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 13:00:43.202971 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.policy [None req-66150349-600f-43ba-9673-8b5887ed5d6f tempest-ServerRescueNegativeTestJSON-1573931620 tempest-ServerRescueNegativeTestJSON-1573931620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '731cbbfe17214ded8ac66299d66dfc45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '010919ea84eb4eb8b936c63153600eba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116063) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 13:00:43.210793 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: INFO nova.api.openstack.requestlog [None req-66150349-600f-43ba-9673-8b5887ed5d6f tempest-ServerRescueNegativeTestJSON-1573931620 tempest-ServerRescueNegativeTestJSON-1573931620-project] 10.222.0.49 "GET /compute/v2.1/servers/eb6e04a4-8901-47df-9b51-7c1664bd3f6c" status: 200 len: 1511 microversion: 2.1 time: 0.195137 Dec 14 13:00:43.211564 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: [pid: 116063|app: 0|req: 245/467] 10.222.0.49 () {58 vars in 1235 bytes} [Tue Dec 14 13:00:43 2021] GET /compute/v2.1/servers/eb6e04a4-8901-47df-9b51-7c1664bd3f6c => generated 1511 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 14 13:00:43.229923 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: INFO nova.api.openstack.requestlog [None req-de3483d6-352e-4e71-a23e-b0f24395ccfd tempest-AttachVolumeNegativeTest-1000400951 tempest-AttachVolumeNegativeTest-1000400951-project] 10.222.0.49 "GET /compute/v2.1/servers/e79e4c5e-a1c6-4f80-9a63-d340231e3359/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041051 Dec 14 13:00:43.230467 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: [pid: 116064|app: 0|req: 223/468] 10.222.0.49 () {58 vars in 1301 bytes} [Tue Dec 14 13:00:43 2021] GET /compute/v2.1/servers/e79e4c5e-a1c6-4f80-9a63-d340231e3359/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 14 13:00:44.209947 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.api.openstack.wsgi [None req-c4a3bcd7-ba44-4bf2-a6ae-b3537cbe3097 tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] Calling method '>' {{(pid=116063) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 13:00:44.210904 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.compute.api [None req-c4a3bcd7-ba44-4bf2-a6ae-b3537cbe3097 tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] [instance: c8de7730-62f2-4a77-b1e9-cf6a74fa366d] Fetching instance by UUID {{(pid=116063) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 13:00:44.221713 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-c4a3bcd7-ba44-4bf2-a6ae-b3537cbe3097 tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 13:00:44.222454 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-c4a3bcd7-ba44-4bf2-a6ae-b3537cbe3097 tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 13:00:44.223737 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-c4a3bcd7-ba44-4bf2-a6ae-b3537cbe3097 tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 13:00:44.224453 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-c4a3bcd7-ba44-4bf2-a6ae-b3537cbe3097 tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 13:00:44.229896 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.api.openstack.wsgi [None req-0bb2407b-4f8b-4427-81f9-44ba76ecc23e tempest-ServerRescueNegativeTestJSON-1573931620 tempest-ServerRescueNegativeTestJSON-1573931620-project] Calling method '>' {{(pid=116064) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 13:00:44.230598 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.compute.api [None req-0bb2407b-4f8b-4427-81f9-44ba76ecc23e tempest-ServerRescueNegativeTestJSON-1573931620 tempest-ServerRescueNegativeTestJSON-1573931620-project] [instance: eb6e04a4-8901-47df-9b51-7c1664bd3f6c] Fetching instance by UUID {{(pid=116064) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 13:00:44.237153 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-0bb2407b-4f8b-4427-81f9-44ba76ecc23e tempest-ServerRescueNegativeTestJSON-1573931620 tempest-ServerRescueNegativeTestJSON-1573931620-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 13:00:44.237598 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-0bb2407b-4f8b-4427-81f9-44ba76ecc23e tempest-ServerRescueNegativeTestJSON-1573931620 tempest-ServerRescueNegativeTestJSON-1573931620-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 13:00:44.238373 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-0bb2407b-4f8b-4427-81f9-44ba76ecc23e tempest-ServerRescueNegativeTestJSON-1573931620 tempest-ServerRescueNegativeTestJSON-1573931620-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 13:00:44.238847 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-0bb2407b-4f8b-4427-81f9-44ba76ecc23e tempest-ServerRescueNegativeTestJSON-1573931620 tempest-ServerRescueNegativeTestJSON-1573931620-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 13:00:44.428129 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.policy [None req-c4a3bcd7-ba44-4bf2-a6ae-b3537cbe3097 tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79d74a2ea1e541d28d085c15cec34032', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68a8770b8dbe489a8119016fbee64eb5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116063) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 13:00:44.432711 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.policy [None req-0bb2407b-4f8b-4427-81f9-44ba76ecc23e tempest-ServerRescueNegativeTestJSON-1573931620 tempest-ServerRescueNegativeTestJSON-1573931620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '731cbbfe17214ded8ac66299d66dfc45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '010919ea84eb4eb8b936c63153600eba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116064) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 13:00:44.436951 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.policy [None req-c4a3bcd7-ba44-4bf2-a6ae-b3537cbe3097 tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '79d74a2ea1e541d28d085c15cec34032', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68a8770b8dbe489a8119016fbee64eb5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116063) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 13:00:44.438577 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.policy [None req-c4a3bcd7-ba44-4bf2-a6ae-b3537cbe3097 tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '79d74a2ea1e541d28d085c15cec34032', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68a8770b8dbe489a8119016fbee64eb5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116063) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 13:00:44.439847 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: INFO nova.api.openstack.requestlog [None req-c4a3bcd7-ba44-4bf2-a6ae-b3537cbe3097 tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] 10.222.0.49 "GET /compute/v2.1/servers/c8de7730-62f2-4a77-b1e9-cf6a74fa366d" status: 200 len: 1745 microversion: 2.20 time: 0.236333 Dec 14 13:00:44.440009 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: INFO nova.api.openstack.requestlog [None req-0bb2407b-4f8b-4427-81f9-44ba76ecc23e tempest-ServerRescueNegativeTestJSON-1573931620 tempest-ServerRescueNegativeTestJSON-1573931620-project] 10.222.0.49 "GET /compute/v2.1/servers/eb6e04a4-8901-47df-9b51-7c1664bd3f6c" status: 200 len: 1511 microversion: 2.1 time: 0.214945 Dec 14 13:00:44.440514 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: [pid: 116063|app: 0|req: 246/469] 10.222.0.49 () {60 vars in 1276 bytes} [Tue Dec 14 13:00:44 2021] GET /compute/v2.1/servers/c8de7730-62f2-4a77-b1e9-cf6a74fa366d => generated 1745 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 14 13:00:44.440650 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: [pid: 116064|app: 0|req: 224/470] 10.222.0.49 () {58 vars in 1235 bytes} [Tue Dec 14 13:00:44 2021] GET /compute/v2.1/servers/eb6e04a4-8901-47df-9b51-7c1664bd3f6c => generated 1511 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 14 13:00:44.445173 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.api.openstack.wsgi [None req-56910732-3772-4e21-a3bf-ae19d6cc8bfc tempest-AttachVolumeNegativeTest-1000400951 tempest-AttachVolumeNegativeTest-1000400951-project] Calling method '>' {{(pid=116064) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 13:00:44.446242 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.compute.api [None req-56910732-3772-4e21-a3bf-ae19d6cc8bfc tempest-AttachVolumeNegativeTest-1000400951 tempest-AttachVolumeNegativeTest-1000400951-project] [instance: e79e4c5e-a1c6-4f80-9a63-d340231e3359] Fetching instance by UUID {{(pid=116064) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 13:00:44.452140 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-56910732-3772-4e21-a3bf-ae19d6cc8bfc tempest-AttachVolumeNegativeTest-1000400951 tempest-AttachVolumeNegativeTest-1000400951-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 13:00:44.452595 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-56910732-3772-4e21-a3bf-ae19d6cc8bfc tempest-AttachVolumeNegativeTest-1000400951 tempest-AttachVolumeNegativeTest-1000400951-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 13:00:44.453422 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-56910732-3772-4e21-a3bf-ae19d6cc8bfc tempest-AttachVolumeNegativeTest-1000400951 tempest-AttachVolumeNegativeTest-1000400951-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 13:00:44.453857 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-56910732-3772-4e21-a3bf-ae19d6cc8bfc tempest-AttachVolumeNegativeTest-1000400951 tempest-AttachVolumeNegativeTest-1000400951-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 13:00:44.482020 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: INFO nova.api.openstack.requestlog [None req-56910732-3772-4e21-a3bf-ae19d6cc8bfc tempest-AttachVolumeNegativeTest-1000400951 tempest-AttachVolumeNegativeTest-1000400951-project] 10.222.0.49 "GET /compute/v2.1/servers/e79e4c5e-a1c6-4f80-9a63-d340231e3359/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040423 Dec 14 13:00:44.482572 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: [pid: 116064|app: 0|req: 225/471] 10.222.0.49 () {58 vars in 1301 bytes} [Tue Dec 14 13:00:44 2021] GET /compute/v2.1/servers/e79e4c5e-a1c6-4f80-9a63-d340231e3359/os-volume_attachments => generated 197 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 14 13:00:45.458251 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.api.openstack.wsgi [None req-ce874a21-5682-4e7e-b5dd-247c59cfc6c4 tempest-ServerRescueNegativeTestJSON-1573931620 tempest-ServerRescueNegativeTestJSON-1573931620-project] Calling method '>' {{(pid=116063) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 13:00:45.458727 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.api.openstack.wsgi [None req-426d5417-d7f8-48c7-a2db-02022927393d tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] Calling method '>' {{(pid=116064) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 13:00:45.459250 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.compute.api [None req-426d5417-d7f8-48c7-a2db-02022927393d tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] [instance: c8de7730-62f2-4a77-b1e9-cf6a74fa366d] Fetching instance by UUID {{(pid=116064) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 13:00:45.460286 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.compute.api [None req-ce874a21-5682-4e7e-b5dd-247c59cfc6c4 tempest-ServerRescueNegativeTestJSON-1573931620 tempest-ServerRescueNegativeTestJSON-1573931620-project] [instance: eb6e04a4-8901-47df-9b51-7c1664bd3f6c] Fetching instance by UUID {{(pid=116063) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 13:00:45.466057 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-426d5417-d7f8-48c7-a2db-02022927393d tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 13:00:45.466481 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-ce874a21-5682-4e7e-b5dd-247c59cfc6c4 tempest-ServerRescueNegativeTestJSON-1573931620 tempest-ServerRescueNegativeTestJSON-1573931620-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 13:00:45.466599 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-426d5417-d7f8-48c7-a2db-02022927393d tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 13:00:45.466931 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-ce874a21-5682-4e7e-b5dd-247c59cfc6c4 tempest-ServerRescueNegativeTestJSON-1573931620 tempest-ServerRescueNegativeTestJSON-1573931620-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 13:00:45.467371 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-426d5417-d7f8-48c7-a2db-02022927393d tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 13:00:45.467786 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-ce874a21-5682-4e7e-b5dd-247c59cfc6c4 tempest-ServerRescueNegativeTestJSON-1573931620 tempest-ServerRescueNegativeTestJSON-1573931620-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 13:00:45.467972 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-426d5417-d7f8-48c7-a2db-02022927393d tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 13:00:45.468375 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-ce874a21-5682-4e7e-b5dd-247c59cfc6c4 tempest-ServerRescueNegativeTestJSON-1573931620 tempest-ServerRescueNegativeTestJSON-1573931620-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 13:00:45.672389 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.policy [None req-ce874a21-5682-4e7e-b5dd-247c59cfc6c4 tempest-ServerRescueNegativeTestJSON-1573931620 tempest-ServerRescueNegativeTestJSON-1573931620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '731cbbfe17214ded8ac66299d66dfc45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '010919ea84eb4eb8b936c63153600eba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116063) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 13:00:45.678248 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.policy [None req-426d5417-d7f8-48c7-a2db-02022927393d tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79d74a2ea1e541d28d085c15cec34032', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68a8770b8dbe489a8119016fbee64eb5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116064) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 13:00:45.680116 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: INFO nova.api.openstack.requestlog [None req-ce874a21-5682-4e7e-b5dd-247c59cfc6c4 tempest-ServerRescueNegativeTestJSON-1573931620 tempest-ServerRescueNegativeTestJSON-1573931620-project] 10.222.0.49 "GET /compute/v2.1/servers/eb6e04a4-8901-47df-9b51-7c1664bd3f6c" status: 200 len: 1511 microversion: 2.1 time: 0.226422 Dec 14 13:00:45.680718 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: [pid: 116063|app: 0|req: 247/472] 10.222.0.49 () {58 vars in 1235 bytes} [Tue Dec 14 13:00:45 2021] GET /compute/v2.1/servers/eb6e04a4-8901-47df-9b51-7c1664bd3f6c => generated 1511 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 14 13:00:45.685514 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.api.openstack.wsgi [None req-ad8d2bc4-e9cd-4196-a1f1-d4cb9dd77f00 tempest-AttachVolumeNegativeTest-1000400951 tempest-AttachVolumeNegativeTest-1000400951-project] Calling method '>' {{(pid=116063) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 13:00:45.686492 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.compute.api [None req-ad8d2bc4-e9cd-4196-a1f1-d4cb9dd77f00 tempest-AttachVolumeNegativeTest-1000400951 tempest-AttachVolumeNegativeTest-1000400951-project] [instance: e79e4c5e-a1c6-4f80-9a63-d340231e3359] Fetching instance by UUID {{(pid=116063) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 13:00:45.692642 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-ad8d2bc4-e9cd-4196-a1f1-d4cb9dd77f00 tempest-AttachVolumeNegativeTest-1000400951 tempest-AttachVolumeNegativeTest-1000400951-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 13:00:45.693122 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-ad8d2bc4-e9cd-4196-a1f1-d4cb9dd77f00 tempest-AttachVolumeNegativeTest-1000400951 tempest-AttachVolumeNegativeTest-1000400951-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 13:00:45.693967 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-ad8d2bc4-e9cd-4196-a1f1-d4cb9dd77f00 tempest-AttachVolumeNegativeTest-1000400951 tempest-AttachVolumeNegativeTest-1000400951-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 13:00:45.694565 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-ad8d2bc4-e9cd-4196-a1f1-d4cb9dd77f00 tempest-AttachVolumeNegativeTest-1000400951 tempest-AttachVolumeNegativeTest-1000400951-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 13:00:45.699579 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.policy [None req-426d5417-d7f8-48c7-a2db-02022927393d tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '79d74a2ea1e541d28d085c15cec34032', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68a8770b8dbe489a8119016fbee64eb5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116064) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 13:00:45.701272 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.policy [None req-426d5417-d7f8-48c7-a2db-02022927393d tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '79d74a2ea1e541d28d085c15cec34032', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68a8770b8dbe489a8119016fbee64eb5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116064) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 13:00:45.703106 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: INFO nova.api.openstack.requestlog [None req-426d5417-d7f8-48c7-a2db-02022927393d tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] 10.222.0.49 "GET /compute/v2.1/servers/c8de7730-62f2-4a77-b1e9-cf6a74fa366d" status: 200 len: 1740 microversion: 2.20 time: 0.248584 Dec 14 13:00:45.703777 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: [pid: 116064|app: 0|req: 226/473] 10.222.0.49 () {60 vars in 1276 bytes} [Tue Dec 14 13:00:45 2021] GET /compute/v2.1/servers/c8de7730-62f2-4a77-b1e9-cf6a74fa366d => generated 1740 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Dec 14 13:00:45.730267 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: INFO nova.api.openstack.requestlog [None req-ad8d2bc4-e9cd-4196-a1f1-d4cb9dd77f00 tempest-AttachVolumeNegativeTest-1000400951 tempest-AttachVolumeNegativeTest-1000400951-project] 10.222.0.49 "GET /compute/v2.1/servers/e79e4c5e-a1c6-4f80-9a63-d340231e3359/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048288 Dec 14 13:00:45.730851 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: [pid: 116063|app: 0|req: 248/474] 10.222.0.49 () {58 vars in 1301 bytes} [Tue Dec 14 13:00:45 2021] GET /compute/v2.1/servers/e79e4c5e-a1c6-4f80-9a63-d340231e3359/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 14 13:00:46.560113 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.api.openstack.wsgi [req-6e25672b-5735-43b6-acbf-56ca12b9c9d4 req-2926c95b-efa9-4c20-ac4c-83c6c49fe66e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c8de7730-62f2-4a77-b1e9-cf6a74fa366d", "name": "network-vif-plugged", "status": "completed", "tag": "45d34d58-1ff8-4ce3-a024-e2acb9451196"}]} {{(pid=116064) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 14 13:00:46.562112 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 14 13:00:46.562112 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: warnings.warn(msg) Dec 14 13:00:46.572428 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [req-6e25672b-5735-43b6-acbf-56ca12b9c9d4 req-2926c95b-efa9-4c20-ac4c-83c6c49fe66e service nova] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 13:00:46.572428 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [req-6e25672b-5735-43b6-acbf-56ca12b9c9d4 req-2926c95b-efa9-4c20-ac4c-83c6c49fe66e service nova] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 13:00:46.583231 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: INFO nova.api.openstack.compute.server_external_events [req-6e25672b-5735-43b6-acbf-56ca12b9c9d4 req-2926c95b-efa9-4c20-ac4c-83c6c49fe66e service nova] Creating event network-vif-plugged:45d34d58-1ff8-4ce3-a024-e2acb9451196 for instance c8de7730-62f2-4a77-b1e9-cf6a74fa366d on hv-cinder-78447 Dec 14 13:00:46.588689 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: INFO nova.api.openstack.requestlog [req-6e25672b-5735-43b6-acbf-56ca12b9c9d4 req-2926c95b-efa9-4c20-ac4c-83c6c49fe66e service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032747 Dec 14 13:00:46.589806 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: [pid: 116064|app: 0|req: 227/475] 10.222.0.49 () {64 vars in 1317 bytes} [Tue Dec 14 13:00:46 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 14 13:00:46.696652 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.api.openstack.wsgi [None req-cf1b8a69-88aa-4a4b-9785-9b6c1eb07710 tempest-ServerRescueNegativeTestJSON-1573931620 tempest-ServerRescueNegativeTestJSON-1573931620-project] Calling method '>' {{(pid=116063) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 13:00:46.698043 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.compute.api [None req-cf1b8a69-88aa-4a4b-9785-9b6c1eb07710 tempest-ServerRescueNegativeTestJSON-1573931620 tempest-ServerRescueNegativeTestJSON-1573931620-project] [instance: eb6e04a4-8901-47df-9b51-7c1664bd3f6c] Fetching instance by UUID {{(pid=116063) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 13:00:46.706502 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-cf1b8a69-88aa-4a4b-9785-9b6c1eb07710 tempest-ServerRescueNegativeTestJSON-1573931620 tempest-ServerRescueNegativeTestJSON-1573931620-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 13:00:46.707773 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-cf1b8a69-88aa-4a4b-9785-9b6c1eb07710 tempest-ServerRescueNegativeTestJSON-1573931620 tempest-ServerRescueNegativeTestJSON-1573931620-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 13:00:46.708913 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-cf1b8a69-88aa-4a4b-9785-9b6c1eb07710 tempest-ServerRescueNegativeTestJSON-1573931620 tempest-ServerRescueNegativeTestJSON-1573931620-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 13:00:46.709806 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-cf1b8a69-88aa-4a4b-9785-9b6c1eb07710 tempest-ServerRescueNegativeTestJSON-1573931620 tempest-ServerRescueNegativeTestJSON-1573931620-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 13:00:46.724502 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.api.openstack.wsgi [None req-9717f386-a842-41ee-bc93-0f4c4bec6a5e tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] Calling method '>' {{(pid=116064) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 13:00:46.725838 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.compute.api [None req-9717f386-a842-41ee-bc93-0f4c4bec6a5e tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] [instance: c8de7730-62f2-4a77-b1e9-cf6a74fa366d] Fetching instance by UUID {{(pid=116064) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 13:00:46.739847 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-9717f386-a842-41ee-bc93-0f4c4bec6a5e tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 13:00:46.740586 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-9717f386-a842-41ee-bc93-0f4c4bec6a5e tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 13:00:46.741605 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-9717f386-a842-41ee-bc93-0f4c4bec6a5e tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 13:00:46.742242 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-9717f386-a842-41ee-bc93-0f4c4bec6a5e tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 13:00:46.963382 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.policy [None req-cf1b8a69-88aa-4a4b-9785-9b6c1eb07710 tempest-ServerRescueNegativeTestJSON-1573931620 tempest-ServerRescueNegativeTestJSON-1573931620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '731cbbfe17214ded8ac66299d66dfc45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '010919ea84eb4eb8b936c63153600eba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116063) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 13:00:46.977720 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.policy [None req-9717f386-a842-41ee-bc93-0f4c4bec6a5e tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79d74a2ea1e541d28d085c15cec34032', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68a8770b8dbe489a8119016fbee64eb5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116064) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 13:00:46.978434 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: INFO nova.api.openstack.requestlog [None req-cf1b8a69-88aa-4a4b-9785-9b6c1eb07710 tempest-ServerRescueNegativeTestJSON-1573931620 tempest-ServerRescueNegativeTestJSON-1573931620-project] 10.222.0.49 "GET /compute/v2.1/servers/eb6e04a4-8901-47df-9b51-7c1664bd3f6c" status: 200 len: 1517 microversion: 2.1 time: 0.283965 Dec 14 13:00:46.980521 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: [pid: 116063|app: 0|req: 249/476] 10.222.0.49 () {58 vars in 1235 bytes} [Tue Dec 14 13:00:46 2021] GET /compute/v2.1/servers/eb6e04a4-8901-47df-9b51-7c1664bd3f6c => generated 1517 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 14 13:00:46.990014 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.api.openstack.wsgi [None req-bb2166bb-2680-4e0f-9d69-1708a8bcb2d4 tempest-AttachVolumeNegativeTest-1000400951 tempest-AttachVolumeNegativeTest-1000400951-project] Calling method '>' {{(pid=116063) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 13:00:46.991498 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.compute.api [None req-bb2166bb-2680-4e0f-9d69-1708a8bcb2d4 tempest-AttachVolumeNegativeTest-1000400951 tempest-AttachVolumeNegativeTest-1000400951-project] [instance: e79e4c5e-a1c6-4f80-9a63-d340231e3359] Fetching instance by UUID {{(pid=116063) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 13:00:47.007106 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.policy [None req-9717f386-a842-41ee-bc93-0f4c4bec6a5e tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '79d74a2ea1e541d28d085c15cec34032', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68a8770b8dbe489a8119016fbee64eb5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116064) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 13:00:47.009676 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.policy [None req-9717f386-a842-41ee-bc93-0f4c4bec6a5e tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '79d74a2ea1e541d28d085c15cec34032', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68a8770b8dbe489a8119016fbee64eb5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116064) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 13:00:47.012052 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: INFO nova.api.openstack.requestlog [None req-9717f386-a842-41ee-bc93-0f4c4bec6a5e tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] 10.222.0.49 "GET /compute/v2.1/servers/c8de7730-62f2-4a77-b1e9-cf6a74fa366d" status: 200 len: 1740 microversion: 2.20 time: 0.291940 Dec 14 13:00:47.023079 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-bb2166bb-2680-4e0f-9d69-1708a8bcb2d4 tempest-AttachVolumeNegativeTest-1000400951 tempest-AttachVolumeNegativeTest-1000400951-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 13:00:47.023079 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-bb2166bb-2680-4e0f-9d69-1708a8bcb2d4 tempest-AttachVolumeNegativeTest-1000400951 tempest-AttachVolumeNegativeTest-1000400951-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 13:00:47.023079 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-bb2166bb-2680-4e0f-9d69-1708a8bcb2d4 tempest-AttachVolumeNegativeTest-1000400951 tempest-AttachVolumeNegativeTest-1000400951-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 13:00:47.023079 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-bb2166bb-2680-4e0f-9d69-1708a8bcb2d4 tempest-AttachVolumeNegativeTest-1000400951 tempest-AttachVolumeNegativeTest-1000400951-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 13:00:47.023923 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: [pid: 116064|app: 0|req: 228/477] 10.222.0.49 () {60 vars in 1276 bytes} [Tue Dec 14 13:00:46 2021] GET /compute/v2.1/servers/c8de7730-62f2-4a77-b1e9-cf6a74fa366d => generated 1740 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 14 13:00:47.056917 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: INFO nova.api.openstack.requestlog [None req-bb2166bb-2680-4e0f-9d69-1708a8bcb2d4 tempest-AttachVolumeNegativeTest-1000400951 tempest-AttachVolumeNegativeTest-1000400951-project] 10.222.0.49 "GET /compute/v2.1/servers/e79e4c5e-a1c6-4f80-9a63-d340231e3359/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.074997 Dec 14 13:00:47.063121 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: [pid: 116063|app: 0|req: 250/478] 10.222.0.49 () {58 vars in 1301 bytes} [Tue Dec 14 13:00:46 2021] GET /compute/v2.1/servers/e79e4c5e-a1c6-4f80-9a63-d340231e3359/os-volume_attachments => generated 25 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Dec 14 13:00:48.030829 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.api.openstack.wsgi [None req-f58bddd5-c9b8-49b5-8f5b-79baba0db52d tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] Calling method '>' {{(pid=116064) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 13:00:48.031538 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.compute.api [None req-f58bddd5-c9b8-49b5-8f5b-79baba0db52d tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] [instance: c8de7730-62f2-4a77-b1e9-cf6a74fa366d] Fetching instance by UUID {{(pid=116064) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 13:00:48.037878 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-f58bddd5-c9b8-49b5-8f5b-79baba0db52d tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 13:00:48.038620 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-f58bddd5-c9b8-49b5-8f5b-79baba0db52d tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 13:00:48.039936 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-f58bddd5-c9b8-49b5-8f5b-79baba0db52d tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 13:00:48.040466 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-f58bddd5-c9b8-49b5-8f5b-79baba0db52d tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 13:00:48.221339 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.policy [None req-f58bddd5-c9b8-49b5-8f5b-79baba0db52d tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79d74a2ea1e541d28d085c15cec34032', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68a8770b8dbe489a8119016fbee64eb5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116064) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 13:00:48.232694 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.policy [None req-f58bddd5-c9b8-49b5-8f5b-79baba0db52d tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '79d74a2ea1e541d28d085c15cec34032', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68a8770b8dbe489a8119016fbee64eb5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116064) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 13:00:48.234332 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.policy [None req-f58bddd5-c9b8-49b5-8f5b-79baba0db52d tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '79d74a2ea1e541d28d085c15cec34032', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68a8770b8dbe489a8119016fbee64eb5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116064) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 13:00:48.235629 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: INFO nova.api.openstack.requestlog [None req-f58bddd5-c9b8-49b5-8f5b-79baba0db52d tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] 10.222.0.49 "GET /compute/v2.1/servers/c8de7730-62f2-4a77-b1e9-cf6a74fa366d" status: 200 len: 1740 microversion: 2.20 time: 0.208581 Dec 14 13:00:48.236611 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: [pid: 116064|app: 0|req: 229/479] 10.222.0.49 () {60 vars in 1276 bytes} [Tue Dec 14 13:00:48 2021] GET /compute/v2.1/servers/c8de7730-62f2-4a77-b1e9-cf6a74fa366d => generated 1740 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Dec 14 13:00:48.325898 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.api.openstack.wsgi [None req-a35ef0a0-25d4-4051-8d66-c673bfc7daf2 tempest-AttachVolumeNegativeTest-1000400951 tempest-AttachVolumeNegativeTest-1000400951-project] Calling method '>' {{(pid=116063) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 13:00:48.326477 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.compute.api [None req-a35ef0a0-25d4-4051-8d66-c673bfc7daf2 tempest-AttachVolumeNegativeTest-1000400951 tempest-AttachVolumeNegativeTest-1000400951-project] [instance: e79e4c5e-a1c6-4f80-9a63-d340231e3359] Fetching instance by UUID {{(pid=116063) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 13:00:48.333572 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-a35ef0a0-25d4-4051-8d66-c673bfc7daf2 tempest-AttachVolumeNegativeTest-1000400951 tempest-AttachVolumeNegativeTest-1000400951-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 13:00:48.334293 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-a35ef0a0-25d4-4051-8d66-c673bfc7daf2 tempest-AttachVolumeNegativeTest-1000400951 tempest-AttachVolumeNegativeTest-1000400951-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 13:00:48.335141 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-a35ef0a0-25d4-4051-8d66-c673bfc7daf2 tempest-AttachVolumeNegativeTest-1000400951 tempest-AttachVolumeNegativeTest-1000400951-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 13:00:48.335712 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-a35ef0a0-25d4-4051-8d66-c673bfc7daf2 tempest-AttachVolumeNegativeTest-1000400951 tempest-AttachVolumeNegativeTest-1000400951-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 13:00:48.395662 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.compute.api [None req-a35ef0a0-25d4-4051-8d66-c673bfc7daf2 tempest-AttachVolumeNegativeTest-1000400951 tempest-AttachVolumeNegativeTest-1000400951-project] [instance: e79e4c5e-a1c6-4f80-9a63-d340231e3359] Going to try to terminate instance {{(pid=116063) delete /opt/stack/nova/nova/compute/api.py:2614}} Dec 14 13:00:48.437040 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.api.openstack.wsgi [None req-c23c30fd-f9ab-4536-8246-3a4bb0523fbd tempest-ServerRescueNegativeTestJSON-1573931620 tempest-ServerRescueNegativeTestJSON-1573931620-project] Calling method '>' {{(pid=116064) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 13:00:48.437653 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.compute.api [None req-c23c30fd-f9ab-4536-8246-3a4bb0523fbd tempest-ServerRescueNegativeTestJSON-1573931620 tempest-ServerRescueNegativeTestJSON-1573931620-project] [instance: eb6e04a4-8901-47df-9b51-7c1664bd3f6c] Fetching instance by UUID {{(pid=116064) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 13:00:48.445306 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-c23c30fd-f9ab-4536-8246-3a4bb0523fbd tempest-ServerRescueNegativeTestJSON-1573931620 tempest-ServerRescueNegativeTestJSON-1573931620-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 13:00:48.445977 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-c23c30fd-f9ab-4536-8246-3a4bb0523fbd tempest-ServerRescueNegativeTestJSON-1573931620 tempest-ServerRescueNegativeTestJSON-1573931620-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 13:00:48.446797 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-c23c30fd-f9ab-4536-8246-3a4bb0523fbd tempest-ServerRescueNegativeTestJSON-1573931620 tempest-ServerRescueNegativeTestJSON-1573931620-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 13:00:48.447233 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-c23c30fd-f9ab-4536-8246-3a4bb0523fbd tempest-ServerRescueNegativeTestJSON-1573931620 tempest-ServerRescueNegativeTestJSON-1573931620-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 13:00:48.540889 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: INFO nova.api.openstack.requestlog [None req-a35ef0a0-25d4-4051-8d66-c673bfc7daf2 tempest-AttachVolumeNegativeTest-1000400951 tempest-AttachVolumeNegativeTest-1000400951-project] 10.222.0.49 "DELETE /compute/v2.1/servers/e79e4c5e-a1c6-4f80-9a63-d340231e3359" status: 204 len: 0 microversion: 2.1 time: 0.216703 Dec 14 13:00:48.543617 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: [pid: 116063|app: 0|req: 251/480] 10.222.0.49 () {58 vars in 1238 bytes} [Tue Dec 14 13:00:48 2021] DELETE /compute/v2.1/servers/e79e4c5e-a1c6-4f80-9a63-d340231e3359 => generated 0 bytes in 224 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Dec 14 13:00:48.556225 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.api.openstack.wsgi [None req-f90aeeac-c509-49bd-8f4b-b5f6a62865d8 tempest-AttachVolumeNegativeTest-1000400951 tempest-AttachVolumeNegativeTest-1000400951-project] Calling method '>' {{(pid=116063) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 13:00:48.557646 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.compute.api [None req-f90aeeac-c509-49bd-8f4b-b5f6a62865d8 tempest-AttachVolumeNegativeTest-1000400951 tempest-AttachVolumeNegativeTest-1000400951-project] [instance: e79e4c5e-a1c6-4f80-9a63-d340231e3359] Fetching instance by UUID {{(pid=116063) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 13:00:48.568227 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-f90aeeac-c509-49bd-8f4b-b5f6a62865d8 tempest-AttachVolumeNegativeTest-1000400951 tempest-AttachVolumeNegativeTest-1000400951-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 13:00:48.572816 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-f90aeeac-c509-49bd-8f4b-b5f6a62865d8 tempest-AttachVolumeNegativeTest-1000400951 tempest-AttachVolumeNegativeTest-1000400951-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 13:00:48.573688 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-f90aeeac-c509-49bd-8f4b-b5f6a62865d8 tempest-AttachVolumeNegativeTest-1000400951 tempest-AttachVolumeNegativeTest-1000400951-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 13:00:48.574128 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-f90aeeac-c509-49bd-8f4b-b5f6a62865d8 tempest-AttachVolumeNegativeTest-1000400951 tempest-AttachVolumeNegativeTest-1000400951-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 13:00:48.637134 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.policy [None req-c23c30fd-f9ab-4536-8246-3a4bb0523fbd tempest-ServerRescueNegativeTestJSON-1573931620 tempest-ServerRescueNegativeTestJSON-1573931620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '731cbbfe17214ded8ac66299d66dfc45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '010919ea84eb4eb8b936c63153600eba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116064) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 13:00:48.645616 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: INFO nova.api.openstack.requestlog [None req-c23c30fd-f9ab-4536-8246-3a4bb0523fbd tempest-ServerRescueNegativeTestJSON-1573931620 tempest-ServerRescueNegativeTestJSON-1573931620-project] 10.222.0.49 "GET /compute/v2.1/servers/eb6e04a4-8901-47df-9b51-7c1664bd3f6c" status: 200 len: 1517 microversion: 2.1 time: 0.212422 Dec 14 13:00:48.651936 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: [pid: 116064|app: 0|req: 230/481] 10.222.0.49 () {58 vars in 1235 bytes} [Tue Dec 14 13:00:48 2021] GET /compute/v2.1/servers/eb6e04a4-8901-47df-9b51-7c1664bd3f6c => generated 1517 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 14 13:00:48.668493 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.api.openstack.wsgi [None req-bc6e20b5-8326-4d99-b998-640685c05f6e tempest-ServerRescueNegativeTestJSON-1573931620 tempest-ServerRescueNegativeTestJSON-1573931620-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "114b9795-4e4c-4e93-a120-0d2eafeb4b02"}} {{(pid=116064) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 14 13:00:48.669879 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.compute.api [None req-bc6e20b5-8326-4d99-b998-640685c05f6e tempest-ServerRescueNegativeTestJSON-1573931620 tempest-ServerRescueNegativeTestJSON-1573931620-project] [instance: eb6e04a4-8901-47df-9b51-7c1664bd3f6c] Fetching instance by UUID {{(pid=116064) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 13:00:48.676891 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-bc6e20b5-8326-4d99-b998-640685c05f6e tempest-ServerRescueNegativeTestJSON-1573931620 tempest-ServerRescueNegativeTestJSON-1573931620-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 13:00:48.677604 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-bc6e20b5-8326-4d99-b998-640685c05f6e tempest-ServerRescueNegativeTestJSON-1573931620 tempest-ServerRescueNegativeTestJSON-1573931620-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 13:00:48.678546 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-bc6e20b5-8326-4d99-b998-640685c05f6e tempest-ServerRescueNegativeTestJSON-1573931620 tempest-ServerRescueNegativeTestJSON-1573931620-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 13:00:48.679301 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-bc6e20b5-8326-4d99-b998-640685c05f6e tempest-ServerRescueNegativeTestJSON-1573931620 tempest-ServerRescueNegativeTestJSON-1573931620-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 13:00:48.774896 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.policy [None req-f90aeeac-c509-49bd-8f4b-b5f6a62865d8 tempest-AttachVolumeNegativeTest-1000400951 tempest-AttachVolumeNegativeTest-1000400951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57d0ec01f0784c8ea87d339980bed3cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad27b8951cae4eeeafa257f45217653a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116063) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 13:00:48.785059 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: INFO nova.api.openstack.requestlog [None req-f90aeeac-c509-49bd-8f4b-b5f6a62865d8 tempest-AttachVolumeNegativeTest-1000400951 tempest-AttachVolumeNegativeTest-1000400951-project] 10.222.0.49 "GET /compute/v2.1/servers/e79e4c5e-a1c6-4f80-9a63-d340231e3359" status: 200 len: 1513 microversion: 2.1 time: 0.235828 Dec 14 13:00:48.786262 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: [pid: 116063|app: 0|req: 252/482] 10.222.0.49 () {58 vars in 1235 bytes} [Tue Dec 14 13:00:48 2021] GET /compute/v2.1/servers/e79e4c5e-a1c6-4f80-9a63-d340231e3359 => generated 1513 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 14 13:00:48.807211 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.api.openstack.wsgi [None req-343bff41-5526-4524-956f-c91ed2e28e9a tempest-VolumesSnapshotTestJSON-1649574085 tempest-VolumesSnapshotTestJSON-1649574085-project] Calling method '>' {{(pid=116063) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 13:00:48.807699 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.compute.api [None req-343bff41-5526-4524-956f-c91ed2e28e9a tempest-VolumesSnapshotTestJSON-1649574085 tempest-VolumesSnapshotTestJSON-1649574085-project] [instance: c48d3c23-3b4b-4220-8ead-d04a670ec64f] Fetching instance by UUID {{(pid=116063) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 13:00:48.817827 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-343bff41-5526-4524-956f-c91ed2e28e9a tempest-VolumesSnapshotTestJSON-1649574085 tempest-VolumesSnapshotTestJSON-1649574085-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 13:00:48.819040 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-343bff41-5526-4524-956f-c91ed2e28e9a tempest-VolumesSnapshotTestJSON-1649574085 tempest-VolumesSnapshotTestJSON-1649574085-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 13:00:48.819900 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-343bff41-5526-4524-956f-c91ed2e28e9a tempest-VolumesSnapshotTestJSON-1649574085 tempest-VolumesSnapshotTestJSON-1649574085-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 13:00:48.820345 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-343bff41-5526-4524-956f-c91ed2e28e9a tempest-VolumesSnapshotTestJSON-1649574085 tempest-VolumesSnapshotTestJSON-1649574085-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 13:00:48.921948 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.objects.instance [None req-343bff41-5526-4524-956f-c91ed2e28e9a tempest-VolumesSnapshotTestJSON-1649574085 tempest-VolumesSnapshotTestJSON-1649574085-project] Lazy-loading 'services' on Instance uuid c48d3c23-3b4b-4220-8ead-d04a670ec64f {{(pid=116063) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Dec 14 13:00:49.012685 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: INFO nova.api.openstack.requestlog [None req-343bff41-5526-4524-956f-c91ed2e28e9a tempest-VolumesSnapshotTestJSON-1649574085 tempest-VolumesSnapshotTestJSON-1649574085-project] 10.222.0.49 "DELETE /compute/v2.1/servers/c48d3c23-3b4b-4220-8ead-d04a670ec64f/os-volume_attachments/47100da6-3e7d-4101-88b1-56d05d9a7dd3" status: 202 len: 0 microversion: 2.1 time: 0.210097 Dec 14 13:00:49.013644 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: [pid: 116063|app: 0|req: 253/483] 10.222.0.49 () {58 vars in 1415 bytes} [Tue Dec 14 13:00:48 2021] DELETE /compute/v2.1/servers/c48d3c23-3b4b-4220-8ead-d04a670ec64f/os-volume_attachments/47100da6-3e7d-4101-88b1-56d05d9a7dd3 => generated 0 bytes in 212 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Dec 14 13:00:49.091804 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: INFO nova.api.openstack.requestlog [None req-bc6e20b5-8326-4d99-b998-640685c05f6e tempest-ServerRescueNegativeTestJSON-1573931620 tempest-ServerRescueNegativeTestJSON-1573931620-project] 10.222.0.49 "POST /compute/v2.1/servers/eb6e04a4-8901-47df-9b51-7c1664bd3f6c/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.427101 Dec 14 13:00:49.096898 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: [pid: 116064|app: 0|req: 231/484] 10.222.0.49 () {60 vars in 1322 bytes} [Tue Dec 14 13:00:48 2021] POST /compute/v2.1/servers/eb6e04a4-8901-47df-9b51-7c1664bd3f6c/os-volume_attachments => generated 194 bytes in 429 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 14 13:00:49.255472 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.api.openstack.wsgi [None req-088630de-d68d-4314-8d56-56f5c77f8a59 tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] Calling method '>' {{(pid=116063) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 13:00:49.256874 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.compute.api [None req-088630de-d68d-4314-8d56-56f5c77f8a59 tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] [instance: c8de7730-62f2-4a77-b1e9-cf6a74fa366d] Fetching instance by UUID {{(pid=116063) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 13:00:49.264128 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-088630de-d68d-4314-8d56-56f5c77f8a59 tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 13:00:49.264591 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-088630de-d68d-4314-8d56-56f5c77f8a59 tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 13:00:49.265425 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-088630de-d68d-4314-8d56-56f5c77f8a59 tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 13:00:49.266219 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-088630de-d68d-4314-8d56-56f5c77f8a59 tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 13:00:49.460800 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.policy [None req-088630de-d68d-4314-8d56-56f5c77f8a59 tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79d74a2ea1e541d28d085c15cec34032', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68a8770b8dbe489a8119016fbee64eb5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116063) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 13:00:49.469876 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.policy [None req-088630de-d68d-4314-8d56-56f5c77f8a59 tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '79d74a2ea1e541d28d085c15cec34032', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68a8770b8dbe489a8119016fbee64eb5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116063) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 13:00:49.471988 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.policy [None req-088630de-d68d-4314-8d56-56f5c77f8a59 tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '79d74a2ea1e541d28d085c15cec34032', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68a8770b8dbe489a8119016fbee64eb5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116063) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 13:00:49.473606 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: INFO nova.api.openstack.requestlog [None req-088630de-d68d-4314-8d56-56f5c77f8a59 tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] 10.222.0.49 "GET /compute/v2.1/servers/c8de7730-62f2-4a77-b1e9-cf6a74fa366d" status: 200 len: 1740 microversion: 2.20 time: 0.222341 Dec 14 13:00:49.484914 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: [pid: 116063|app: 0|req: 254/485] 10.222.0.49 () {60 vars in 1276 bytes} [Tue Dec 14 13:00:49 2021] GET /compute/v2.1/servers/c8de7730-62f2-4a77-b1e9-cf6a74fa366d => generated 1740 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 14 13:00:49.804230 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.api.openstack.wsgi [None req-2a7e0730-2773-44e0-ac87-7ebf6b56e66e tempest-AttachVolumeNegativeTest-1000400951 tempest-AttachVolumeNegativeTest-1000400951-project] Calling method '>' {{(pid=116064) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 13:00:49.804918 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.compute.api [None req-2a7e0730-2773-44e0-ac87-7ebf6b56e66e tempest-AttachVolumeNegativeTest-1000400951 tempest-AttachVolumeNegativeTest-1000400951-project] [instance: e79e4c5e-a1c6-4f80-9a63-d340231e3359] Fetching instance by UUID {{(pid=116064) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 13:00:49.813977 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-2a7e0730-2773-44e0-ac87-7ebf6b56e66e tempest-AttachVolumeNegativeTest-1000400951 tempest-AttachVolumeNegativeTest-1000400951-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 13:00:49.814459 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-2a7e0730-2773-44e0-ac87-7ebf6b56e66e tempest-AttachVolumeNegativeTest-1000400951 tempest-AttachVolumeNegativeTest-1000400951-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 13:00:49.815312 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-2a7e0730-2773-44e0-ac87-7ebf6b56e66e tempest-AttachVolumeNegativeTest-1000400951 tempest-AttachVolumeNegativeTest-1000400951-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 13:00:49.815738 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-2a7e0730-2773-44e0-ac87-7ebf6b56e66e tempest-AttachVolumeNegativeTest-1000400951 tempest-AttachVolumeNegativeTest-1000400951-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 13:00:49.984805 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.policy [None req-2a7e0730-2773-44e0-ac87-7ebf6b56e66e tempest-AttachVolumeNegativeTest-1000400951 tempest-AttachVolumeNegativeTest-1000400951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57d0ec01f0784c8ea87d339980bed3cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad27b8951cae4eeeafa257f45217653a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116064) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 13:00:49.992966 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: INFO nova.api.openstack.requestlog [None req-2a7e0730-2773-44e0-ac87-7ebf6b56e66e tempest-AttachVolumeNegativeTest-1000400951 tempest-AttachVolumeNegativeTest-1000400951-project] 10.222.0.49 "GET /compute/v2.1/servers/e79e4c5e-a1c6-4f80-9a63-d340231e3359" status: 200 len: 1513 microversion: 2.1 time: 0.193127 Dec 14 13:00:49.994101 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: [pid: 116064|app: 0|req: 232/486] 10.222.0.49 () {58 vars in 1235 bytes} [Tue Dec 14 13:00:49 2021] GET /compute/v2.1/servers/e79e4c5e-a1c6-4f80-9a63-d340231e3359 => generated 1513 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 14 13:00:50.502821 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.api.openstack.wsgi [None req-b7039e49-55a6-49fa-9307-d10b86a05890 tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] Calling method '>' {{(pid=116063) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 13:00:50.504090 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.compute.api [None req-b7039e49-55a6-49fa-9307-d10b86a05890 tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] [instance: c8de7730-62f2-4a77-b1e9-cf6a74fa366d] Fetching instance by UUID {{(pid=116063) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 13:00:50.513849 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-b7039e49-55a6-49fa-9307-d10b86a05890 tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 13:00:50.514580 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-b7039e49-55a6-49fa-9307-d10b86a05890 tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 13:00:50.515527 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-b7039e49-55a6-49fa-9307-d10b86a05890 tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 13:00:50.516160 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-b7039e49-55a6-49fa-9307-d10b86a05890 tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 13:00:50.679738 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.policy [None req-b7039e49-55a6-49fa-9307-d10b86a05890 tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79d74a2ea1e541d28d085c15cec34032', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68a8770b8dbe489a8119016fbee64eb5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116063) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 13:00:50.691758 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.policy [None req-b7039e49-55a6-49fa-9307-d10b86a05890 tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '79d74a2ea1e541d28d085c15cec34032', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68a8770b8dbe489a8119016fbee64eb5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116063) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 13:00:50.693635 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.policy [None req-b7039e49-55a6-49fa-9307-d10b86a05890 tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '79d74a2ea1e541d28d085c15cec34032', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68a8770b8dbe489a8119016fbee64eb5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116063) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 13:00:50.695091 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: INFO nova.api.openstack.requestlog [None req-b7039e49-55a6-49fa-9307-d10b86a05890 tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] 10.222.0.49 "GET /compute/v2.1/servers/c8de7730-62f2-4a77-b1e9-cf6a74fa366d" status: 200 len: 1740 microversion: 2.20 time: 0.199363 Dec 14 13:00:50.707212 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: [pid: 116063|app: 0|req: 255/487] 10.222.0.49 () {60 vars in 1276 bytes} [Tue Dec 14 13:00:50 2021] GET /compute/v2.1/servers/c8de7730-62f2-4a77-b1e9-cf6a74fa366d => generated 1740 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 14 13:00:51.012137 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.api.openstack.wsgi [None req-109b325c-329b-4c38-a1dd-bb55c5fa3e50 tempest-AttachVolumeNegativeTest-1000400951 tempest-AttachVolumeNegativeTest-1000400951-project] Calling method '>' {{(pid=116064) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 13:00:51.013688 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.compute.api [None req-109b325c-329b-4c38-a1dd-bb55c5fa3e50 tempest-AttachVolumeNegativeTest-1000400951 tempest-AttachVolumeNegativeTest-1000400951-project] [instance: e79e4c5e-a1c6-4f80-9a63-d340231e3359] Fetching instance by UUID {{(pid=116064) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 13:00:51.021082 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-109b325c-329b-4c38-a1dd-bb55c5fa3e50 tempest-AttachVolumeNegativeTest-1000400951 tempest-AttachVolumeNegativeTest-1000400951-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 13:00:51.021601 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-109b325c-329b-4c38-a1dd-bb55c5fa3e50 tempest-AttachVolumeNegativeTest-1000400951 tempest-AttachVolumeNegativeTest-1000400951-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 13:00:51.022389 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-109b325c-329b-4c38-a1dd-bb55c5fa3e50 tempest-AttachVolumeNegativeTest-1000400951 tempest-AttachVolumeNegativeTest-1000400951-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 13:00:51.022817 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-109b325c-329b-4c38-a1dd-bb55c5fa3e50 tempest-AttachVolumeNegativeTest-1000400951 tempest-AttachVolumeNegativeTest-1000400951-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 13:00:51.163437 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.policy [None req-109b325c-329b-4c38-a1dd-bb55c5fa3e50 tempest-AttachVolumeNegativeTest-1000400951 tempest-AttachVolumeNegativeTest-1000400951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57d0ec01f0784c8ea87d339980bed3cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad27b8951cae4eeeafa257f45217653a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116064) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 13:00:51.210045 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: INFO nova.api.openstack.requestlog [None req-109b325c-329b-4c38-a1dd-bb55c5fa3e50 tempest-AttachVolumeNegativeTest-1000400951 tempest-AttachVolumeNegativeTest-1000400951-project] 10.222.0.49 "GET /compute/v2.1/servers/e79e4c5e-a1c6-4f80-9a63-d340231e3359" status: 200 len: 1513 microversion: 2.1 time: 0.203489 Dec 14 13:00:51.210793 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: [pid: 116064|app: 0|req: 233/488] 10.222.0.49 () {58 vars in 1235 bytes} [Tue Dec 14 13:00:51 2021] GET /compute/v2.1/servers/e79e4c5e-a1c6-4f80-9a63-d340231e3359 => generated 1513 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 14 13:00:51.219469 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.api.openstack.wsgi [None req-d6dc6bc3-9298-4bdb-9c4d-36b0348adcab tempest-VolumesSnapshotTestJSON-1649574085 tempest-VolumesSnapshotTestJSON-1649574085-project] Calling method '>' {{(pid=116063) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 13:00:51.220186 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.compute.api [None req-d6dc6bc3-9298-4bdb-9c4d-36b0348adcab tempest-VolumesSnapshotTestJSON-1649574085 tempest-VolumesSnapshotTestJSON-1649574085-project] [instance: c48d3c23-3b4b-4220-8ead-d04a670ec64f] Fetching instance by UUID {{(pid=116063) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 13:00:51.226896 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-d6dc6bc3-9298-4bdb-9c4d-36b0348adcab tempest-VolumesSnapshotTestJSON-1649574085 tempest-VolumesSnapshotTestJSON-1649574085-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 13:00:51.227373 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-d6dc6bc3-9298-4bdb-9c4d-36b0348adcab tempest-VolumesSnapshotTestJSON-1649574085 tempest-VolumesSnapshotTestJSON-1649574085-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 13:00:51.228163 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-d6dc6bc3-9298-4bdb-9c4d-36b0348adcab tempest-VolumesSnapshotTestJSON-1649574085 tempest-VolumesSnapshotTestJSON-1649574085-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 13:00:51.228604 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-d6dc6bc3-9298-4bdb-9c4d-36b0348adcab tempest-VolumesSnapshotTestJSON-1649574085 tempest-VolumesSnapshotTestJSON-1649574085-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 13:00:51.263953 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.compute.api [None req-d6dc6bc3-9298-4bdb-9c4d-36b0348adcab tempest-VolumesSnapshotTestJSON-1649574085 tempest-VolumesSnapshotTestJSON-1649574085-project] [instance: c48d3c23-3b4b-4220-8ead-d04a670ec64f] Going to try to terminate instance {{(pid=116063) delete /opt/stack/nova/nova/compute/api.py:2614}} Dec 14 13:00:51.363727 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: INFO nova.api.openstack.requestlog [None req-d6dc6bc3-9298-4bdb-9c4d-36b0348adcab tempest-VolumesSnapshotTestJSON-1649574085 tempest-VolumesSnapshotTestJSON-1649574085-project] 10.222.0.49 "DELETE /compute/v2.1/servers/c48d3c23-3b4b-4220-8ead-d04a670ec64f" status: 204 len: 0 microversion: 2.1 time: 0.147487 Dec 14 13:00:51.373272 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.api.openstack.wsgi [None req-d802a81c-9200-4ff6-8bd4-bc694f77aafd tempest-VolumesSnapshotTestJSON-1649574085 tempest-VolumesSnapshotTestJSON-1649574085-project] Calling method '>' {{(pid=116064) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 13:00:51.373905 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.compute.api [None req-d802a81c-9200-4ff6-8bd4-bc694f77aafd tempest-VolumesSnapshotTestJSON-1649574085 tempest-VolumesSnapshotTestJSON-1649574085-project] [instance: c48d3c23-3b4b-4220-8ead-d04a670ec64f] Fetching instance by UUID {{(pid=116064) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 13:00:51.378686 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: [pid: 116063|app: 0|req: 256/489] 10.222.0.49 () {58 vars in 1238 bytes} [Tue Dec 14 13:00:51 2021] DELETE /compute/v2.1/servers/c48d3c23-3b4b-4220-8ead-d04a670ec64f => generated 0 bytes in 149 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Dec 14 13:00:51.381067 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-d802a81c-9200-4ff6-8bd4-bc694f77aafd tempest-VolumesSnapshotTestJSON-1649574085 tempest-VolumesSnapshotTestJSON-1649574085-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 13:00:51.381391 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-d802a81c-9200-4ff6-8bd4-bc694f77aafd tempest-VolumesSnapshotTestJSON-1649574085 tempest-VolumesSnapshotTestJSON-1649574085-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 13:00:51.382400 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-d802a81c-9200-4ff6-8bd4-bc694f77aafd tempest-VolumesSnapshotTestJSON-1649574085 tempest-VolumesSnapshotTestJSON-1649574085-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 13:00:51.383069 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-d802a81c-9200-4ff6-8bd4-bc694f77aafd tempest-VolumesSnapshotTestJSON-1649574085 tempest-VolumesSnapshotTestJSON-1649574085-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 13:00:51.544627 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.policy [None req-d802a81c-9200-4ff6-8bd4-bc694f77aafd tempest-VolumesSnapshotTestJSON-1649574085 tempest-VolumesSnapshotTestJSON-1649574085-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e18311fd2704616a778d36332f199ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1bf776f341b4721b28eb9a5c84ba866', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116064) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 13:00:51.553651 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: INFO nova.api.openstack.requestlog [None req-d802a81c-9200-4ff6-8bd4-bc694f77aafd tempest-VolumesSnapshotTestJSON-1649574085 tempest-VolumesSnapshotTestJSON-1649574085-project] 10.222.0.49 "GET /compute/v2.1/servers/c48d3c23-3b4b-4220-8ead-d04a670ec64f" status: 200 len: 1514 microversion: 2.1 time: 0.184382 Dec 14 13:00:51.554376 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: [pid: 116064|app: 0|req: 234/490] 10.222.0.49 () {58 vars in 1235 bytes} [Tue Dec 14 13:00:51 2021] GET /compute/v2.1/servers/c48d3c23-3b4b-4220-8ead-d04a670ec64f => generated 1514 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 14 13:00:51.724192 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.api.openstack.wsgi [None req-dca39475-3550-4b4b-81f9-92d543402cf7 tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] Calling method '>' {{(pid=116063) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 13:00:51.725216 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.compute.api [None req-dca39475-3550-4b4b-81f9-92d543402cf7 tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] [instance: c8de7730-62f2-4a77-b1e9-cf6a74fa366d] Fetching instance by UUID {{(pid=116063) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 13:00:51.732125 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-dca39475-3550-4b4b-81f9-92d543402cf7 tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 13:00:51.732578 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-dca39475-3550-4b4b-81f9-92d543402cf7 tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 13:00:51.733393 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-dca39475-3550-4b4b-81f9-92d543402cf7 tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 13:00:51.733831 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-dca39475-3550-4b4b-81f9-92d543402cf7 tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 13:00:51.888664 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.policy [None req-dca39475-3550-4b4b-81f9-92d543402cf7 tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79d74a2ea1e541d28d085c15cec34032', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68a8770b8dbe489a8119016fbee64eb5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116063) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 13:00:51.897046 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.policy [None req-dca39475-3550-4b4b-81f9-92d543402cf7 tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '79d74a2ea1e541d28d085c15cec34032', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68a8770b8dbe489a8119016fbee64eb5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116063) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 13:00:51.899147 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.policy [None req-dca39475-3550-4b4b-81f9-92d543402cf7 tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '79d74a2ea1e541d28d085c15cec34032', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68a8770b8dbe489a8119016fbee64eb5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116063) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 13:00:51.900524 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: INFO nova.api.openstack.requestlog [None req-dca39475-3550-4b4b-81f9-92d543402cf7 tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] 10.222.0.49 "GET /compute/v2.1/servers/c8de7730-62f2-4a77-b1e9-cf6a74fa366d" status: 200 len: 1740 microversion: 2.20 time: 0.189992 Dec 14 13:00:51.912353 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: [pid: 116063|app: 0|req: 257/491] 10.222.0.49 () {60 vars in 1276 bytes} [Tue Dec 14 13:00:51 2021] GET /compute/v2.1/servers/c8de7730-62f2-4a77-b1e9-cf6a74fa366d => generated 1740 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 14 13:00:52.228181 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.api.openstack.wsgi [None req-9554e846-2cc5-414c-9511-02cd431d8823 tempest-AttachVolumeNegativeTest-1000400951 tempest-AttachVolumeNegativeTest-1000400951-project] Calling method '>' {{(pid=116064) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 13:00:52.229454 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.compute.api [None req-9554e846-2cc5-414c-9511-02cd431d8823 tempest-AttachVolumeNegativeTest-1000400951 tempest-AttachVolumeNegativeTest-1000400951-project] [instance: e79e4c5e-a1c6-4f80-9a63-d340231e3359] Fetching instance by UUID {{(pid=116064) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 13:00:52.237515 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-9554e846-2cc5-414c-9511-02cd431d8823 tempest-AttachVolumeNegativeTest-1000400951 tempest-AttachVolumeNegativeTest-1000400951-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 13:00:52.238025 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-9554e846-2cc5-414c-9511-02cd431d8823 tempest-AttachVolumeNegativeTest-1000400951 tempest-AttachVolumeNegativeTest-1000400951-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 13:00:52.238871 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-9554e846-2cc5-414c-9511-02cd431d8823 tempest-AttachVolumeNegativeTest-1000400951 tempest-AttachVolumeNegativeTest-1000400951-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 13:00:52.239352 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-9554e846-2cc5-414c-9511-02cd431d8823 tempest-AttachVolumeNegativeTest-1000400951 tempest-AttachVolumeNegativeTest-1000400951-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 13:00:52.394440 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.policy [None req-9554e846-2cc5-414c-9511-02cd431d8823 tempest-AttachVolumeNegativeTest-1000400951 tempest-AttachVolumeNegativeTest-1000400951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57d0ec01f0784c8ea87d339980bed3cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad27b8951cae4eeeafa257f45217653a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116064) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 13:00:52.403090 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: INFO nova.api.openstack.requestlog [None req-9554e846-2cc5-414c-9511-02cd431d8823 tempest-AttachVolumeNegativeTest-1000400951 tempest-AttachVolumeNegativeTest-1000400951-project] 10.222.0.49 "GET /compute/v2.1/servers/e79e4c5e-a1c6-4f80-9a63-d340231e3359" status: 200 len: 1513 microversion: 2.1 time: 0.179224 Dec 14 13:00:52.405209 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: [pid: 116064|app: 0|req: 235/492] 10.222.0.49 () {58 vars in 1235 bytes} [Tue Dec 14 13:00:52 2021] GET /compute/v2.1/servers/e79e4c5e-a1c6-4f80-9a63-d340231e3359 => generated 1513 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 14 13:00:52.573555 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.api.openstack.wsgi [None req-1884f404-570a-4c29-96ba-897d388a5f89 tempest-VolumesSnapshotTestJSON-1649574085 tempest-VolumesSnapshotTestJSON-1649574085-project] Calling method '>' {{(pid=116063) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 13:00:52.574173 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.compute.api [None req-1884f404-570a-4c29-96ba-897d388a5f89 tempest-VolumesSnapshotTestJSON-1649574085 tempest-VolumesSnapshotTestJSON-1649574085-project] [instance: c48d3c23-3b4b-4220-8ead-d04a670ec64f] Fetching instance by UUID {{(pid=116063) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 13:00:52.581928 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-1884f404-570a-4c29-96ba-897d388a5f89 tempest-VolumesSnapshotTestJSON-1649574085 tempest-VolumesSnapshotTestJSON-1649574085-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 13:00:52.582482 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-1884f404-570a-4c29-96ba-897d388a5f89 tempest-VolumesSnapshotTestJSON-1649574085 tempest-VolumesSnapshotTestJSON-1649574085-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 13:00:52.583145 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-1884f404-570a-4c29-96ba-897d388a5f89 tempest-VolumesSnapshotTestJSON-1649574085 tempest-VolumesSnapshotTestJSON-1649574085-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 13:00:52.583578 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-1884f404-570a-4c29-96ba-897d388a5f89 tempest-VolumesSnapshotTestJSON-1649574085 tempest-VolumesSnapshotTestJSON-1649574085-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 13:00:52.919980 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.api.openstack.wsgi [None req-30ca4951-9272-47f9-ac22-547aea0f893d tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] Calling method '>' {{(pid=116064) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 13:00:52.921367 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.compute.api [None req-30ca4951-9272-47f9-ac22-547aea0f893d tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] [instance: c8de7730-62f2-4a77-b1e9-cf6a74fa366d] Fetching instance by UUID {{(pid=116064) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 13:00:52.941760 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-30ca4951-9272-47f9-ac22-547aea0f893d tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 13:00:52.945725 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-30ca4951-9272-47f9-ac22-547aea0f893d tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 13:00:52.946887 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-30ca4951-9272-47f9-ac22-547aea0f893d tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 13:00:52.948341 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-30ca4951-9272-47f9-ac22-547aea0f893d tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 13:00:52.987771 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.policy [None req-1884f404-570a-4c29-96ba-897d388a5f89 tempest-VolumesSnapshotTestJSON-1649574085 tempest-VolumesSnapshotTestJSON-1649574085-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e18311fd2704616a778d36332f199ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1bf776f341b4721b28eb9a5c84ba866', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116063) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 13:00:52.997946 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: INFO nova.api.openstack.requestlog [None req-1884f404-570a-4c29-96ba-897d388a5f89 tempest-VolumesSnapshotTestJSON-1649574085 tempest-VolumesSnapshotTestJSON-1649574085-project] 10.222.0.49 "GET /compute/v2.1/servers/c48d3c23-3b4b-4220-8ead-d04a670ec64f" status: 200 len: 1514 microversion: 2.1 time: 0.430191 Dec 14 13:00:52.999107 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: [pid: 116063|app: 0|req: 258/493] 10.222.0.49 () {58 vars in 1235 bytes} [Tue Dec 14 13:00:52 2021] GET /compute/v2.1/servers/c48d3c23-3b4b-4220-8ead-d04a670ec64f => generated 1514 bytes in 432 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 14 13:00:53.165588 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.policy [None req-30ca4951-9272-47f9-ac22-547aea0f893d tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79d74a2ea1e541d28d085c15cec34032', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68a8770b8dbe489a8119016fbee64eb5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116064) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 13:00:53.182939 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.policy [None req-30ca4951-9272-47f9-ac22-547aea0f893d tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '79d74a2ea1e541d28d085c15cec34032', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68a8770b8dbe489a8119016fbee64eb5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116064) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 13:00:53.184518 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.policy [None req-30ca4951-9272-47f9-ac22-547aea0f893d tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '79d74a2ea1e541d28d085c15cec34032', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68a8770b8dbe489a8119016fbee64eb5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116064) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 13:00:53.186132 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: INFO nova.api.openstack.requestlog [None req-30ca4951-9272-47f9-ac22-547aea0f893d tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] 10.222.0.49 "GET /compute/v2.1/servers/c8de7730-62f2-4a77-b1e9-cf6a74fa366d" status: 200 len: 1740 microversion: 2.20 time: 0.270427 Dec 14 13:00:53.199633 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: [pid: 116064|app: 0|req: 236/494] 10.222.0.49 () {60 vars in 1276 bytes} [Tue Dec 14 13:00:52 2021] GET /compute/v2.1/servers/c8de7730-62f2-4a77-b1e9-cf6a74fa366d => generated 1740 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 14 13:00:53.279550 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.api.openstack.wsgi [req-85325ac1-a370-4ef9-8634-b740ce5c237f req-9d820386-9aa4-49d7-9769-b5c28085eba1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e79e4c5e-a1c6-4f80-9a63-d340231e3359", "name": "network-vif-deleted", "tag": "bf021cb5-24d6-405a-94a5-01c51e16436f"}]} {{(pid=116063) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 14 13:00:53.281485 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 14 13:00:53.281485 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: warnings.warn(msg) Dec 14 13:00:53.292579 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [req-85325ac1-a370-4ef9-8634-b740ce5c237f req-9d820386-9aa4-49d7-9769-b5c28085eba1 service nova] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 13:00:53.293394 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [req-85325ac1-a370-4ef9-8634-b740ce5c237f req-9d820386-9aa4-49d7-9769-b5c28085eba1 service nova] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 13:00:53.307474 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: INFO nova.api.openstack.compute.server_external_events [req-85325ac1-a370-4ef9-8634-b740ce5c237f req-9d820386-9aa4-49d7-9769-b5c28085eba1 service nova] Creating event network-vif-deleted:bf021cb5-24d6-405a-94a5-01c51e16436f for instance e79e4c5e-a1c6-4f80-9a63-d340231e3359 on hv-cinder-78447 Dec 14 13:00:53.315283 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: INFO nova.api.openstack.requestlog [req-85325ac1-a370-4ef9-8634-b740ce5c237f req-9d820386-9aa4-49d7-9769-b5c28085eba1 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039564 Dec 14 13:00:53.324434 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: [pid: 116063|app: 0|req: 259/495] 10.222.0.49 () {64 vars in 1317 bytes} [Tue Dec 14 13:00:53 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 14 13:00:53.421635 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.api.openstack.wsgi [None req-d2673f9c-874b-4245-b64a-00e8d8409952 tempest-AttachVolumeNegativeTest-1000400951 tempest-AttachVolumeNegativeTest-1000400951-project] Calling method '>' {{(pid=116064) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 13:00:53.422471 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.compute.api [None req-d2673f9c-874b-4245-b64a-00e8d8409952 tempest-AttachVolumeNegativeTest-1000400951 tempest-AttachVolumeNegativeTest-1000400951-project] [instance: e79e4c5e-a1c6-4f80-9a63-d340231e3359] Fetching instance by UUID {{(pid=116064) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 13:00:53.436611 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-d2673f9c-874b-4245-b64a-00e8d8409952 tempest-AttachVolumeNegativeTest-1000400951 tempest-AttachVolumeNegativeTest-1000400951-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 13:00:53.436711 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-d2673f9c-874b-4245-b64a-00e8d8409952 tempest-AttachVolumeNegativeTest-1000400951 tempest-AttachVolumeNegativeTest-1000400951-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 13:00:53.437545 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-d2673f9c-874b-4245-b64a-00e8d8409952 tempest-AttachVolumeNegativeTest-1000400951 tempest-AttachVolumeNegativeTest-1000400951-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 13:00:53.442938 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-d2673f9c-874b-4245-b64a-00e8d8409952 tempest-AttachVolumeNegativeTest-1000400951 tempest-AttachVolumeNegativeTest-1000400951-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 13:00:53.487159 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-d2673f9c-874b-4245-b64a-00e8d8409952 tempest-AttachVolumeNegativeTest-1000400951 tempest-AttachVolumeNegativeTest-1000400951-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 13:00:53.487793 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-d2673f9c-874b-4245-b64a-00e8d8409952 tempest-AttachVolumeNegativeTest-1000400951 tempest-AttachVolumeNegativeTest-1000400951-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 13:00:53.488498 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.objects.instance [None req-d2673f9c-874b-4245-b64a-00e8d8409952 tempest-AttachVolumeNegativeTest-1000400951 tempest-AttachVolumeNegativeTest-1000400951-project] Lazy-loading 'fault' on Instance uuid e79e4c5e-a1c6-4f80-9a63-d340231e3359 {{(pid=116064) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Dec 14 13:00:53.558602 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.policy [None req-d2673f9c-874b-4245-b64a-00e8d8409952 tempest-AttachVolumeNegativeTest-1000400951 tempest-AttachVolumeNegativeTest-1000400951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57d0ec01f0784c8ea87d339980bed3cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad27b8951cae4eeeafa257f45217653a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116064) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 13:00:53.568937 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: INFO nova.api.openstack.requestlog [None req-d2673f9c-874b-4245-b64a-00e8d8409952 tempest-AttachVolumeNegativeTest-1000400951 tempest-AttachVolumeNegativeTest-1000400951-project] 10.222.0.49 "GET /compute/v2.1/servers/e79e4c5e-a1c6-4f80-9a63-d340231e3359" status: 200 len: 1308 microversion: 2.1 time: 0.151198 Dec 14 13:00:53.569642 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: [pid: 116064|app: 0|req: 237/496] 10.222.0.49 () {58 vars in 1235 bytes} [Tue Dec 14 13:00:53 2021] GET /compute/v2.1/servers/e79e4c5e-a1c6-4f80-9a63-d340231e3359 => generated 1308 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 14 13:00:54.020546 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.api.openstack.wsgi [None req-72d19be0-f0a9-4f9c-9702-f05644741b56 tempest-VolumesSnapshotTestJSON-1649574085 tempest-VolumesSnapshotTestJSON-1649574085-project] Calling method '>' {{(pid=116063) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 13:00:54.021496 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.compute.api [None req-72d19be0-f0a9-4f9c-9702-f05644741b56 tempest-VolumesSnapshotTestJSON-1649574085 tempest-VolumesSnapshotTestJSON-1649574085-project] [instance: c48d3c23-3b4b-4220-8ead-d04a670ec64f] Fetching instance by UUID {{(pid=116063) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 13:00:54.037266 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-72d19be0-f0a9-4f9c-9702-f05644741b56 tempest-VolumesSnapshotTestJSON-1649574085 tempest-VolumesSnapshotTestJSON-1649574085-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 13:00:54.038273 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-72d19be0-f0a9-4f9c-9702-f05644741b56 tempest-VolumesSnapshotTestJSON-1649574085 tempest-VolumesSnapshotTestJSON-1649574085-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 13:00:54.039366 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-72d19be0-f0a9-4f9c-9702-f05644741b56 tempest-VolumesSnapshotTestJSON-1649574085 tempest-VolumesSnapshotTestJSON-1649574085-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 13:00:54.039798 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-72d19be0-f0a9-4f9c-9702-f05644741b56 tempest-VolumesSnapshotTestJSON-1649574085 tempest-VolumesSnapshotTestJSON-1649574085-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 13:00:54.197600 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.policy [None req-72d19be0-f0a9-4f9c-9702-f05644741b56 tempest-VolumesSnapshotTestJSON-1649574085 tempest-VolumesSnapshotTestJSON-1649574085-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e18311fd2704616a778d36332f199ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1bf776f341b4721b28eb9a5c84ba866', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116063) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 13:00:54.205704 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: INFO nova.api.openstack.requestlog [None req-72d19be0-f0a9-4f9c-9702-f05644741b56 tempest-VolumesSnapshotTestJSON-1649574085 tempest-VolumesSnapshotTestJSON-1649574085-project] 10.222.0.49 "GET /compute/v2.1/servers/c48d3c23-3b4b-4220-8ead-d04a670ec64f" status: 200 len: 1514 microversion: 2.1 time: 0.189893 Dec 14 13:00:54.206291 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.api.openstack.wsgi [None req-9401967b-8757-4660-ae02-0d31950f0b8d tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] Calling method '>' {{(pid=116064) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 13:00:54.206432 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: [pid: 116063|app: 0|req: 260/497] 10.222.0.49 () {58 vars in 1235 bytes} [Tue Dec 14 13:00:54 2021] GET /compute/v2.1/servers/c48d3c23-3b4b-4220-8ead-d04a670ec64f => generated 1514 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 14 13:00:54.207005 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.compute.api [None req-9401967b-8757-4660-ae02-0d31950f0b8d tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] [instance: c8de7730-62f2-4a77-b1e9-cf6a74fa366d] Fetching instance by UUID {{(pid=116064) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 13:00:54.214058 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-9401967b-8757-4660-ae02-0d31950f0b8d tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 13:00:54.218305 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-9401967b-8757-4660-ae02-0d31950f0b8d tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 13:00:54.219359 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-9401967b-8757-4660-ae02-0d31950f0b8d tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 13:00:54.219804 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-9401967b-8757-4660-ae02-0d31950f0b8d tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 13:00:54.385794 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.policy [None req-9401967b-8757-4660-ae02-0d31950f0b8d tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79d74a2ea1e541d28d085c15cec34032', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68a8770b8dbe489a8119016fbee64eb5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116064) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 13:00:54.394648 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.policy [None req-9401967b-8757-4660-ae02-0d31950f0b8d tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '79d74a2ea1e541d28d085c15cec34032', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68a8770b8dbe489a8119016fbee64eb5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116064) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 13:00:54.397523 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.policy [None req-9401967b-8757-4660-ae02-0d31950f0b8d tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '79d74a2ea1e541d28d085c15cec34032', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68a8770b8dbe489a8119016fbee64eb5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116064) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 13:00:54.398949 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: INFO nova.api.openstack.requestlog [None req-9401967b-8757-4660-ae02-0d31950f0b8d tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] 10.222.0.49 "GET /compute/v2.1/servers/c8de7730-62f2-4a77-b1e9-cf6a74fa366d" status: 200 len: 1740 microversion: 2.20 time: 0.196713 Dec 14 13:00:54.400809 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: [pid: 116064|app: 0|req: 238/498] 10.222.0.49 () {60 vars in 1276 bytes} [Tue Dec 14 13:00:54 2021] GET /compute/v2.1/servers/c8de7730-62f2-4a77-b1e9-cf6a74fa366d => generated 1740 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Dec 14 13:00:54.585973 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.api.openstack.wsgi [None req-a31d101c-67de-4fe2-930d-01c8c8ad0729 tempest-AttachVolumeNegativeTest-1000400951 tempest-AttachVolumeNegativeTest-1000400951-project] Calling method '>' {{(pid=116063) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 13:00:54.586974 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.compute.api [None req-a31d101c-67de-4fe2-930d-01c8c8ad0729 tempest-AttachVolumeNegativeTest-1000400951 tempest-AttachVolumeNegativeTest-1000400951-project] [instance: e79e4c5e-a1c6-4f80-9a63-d340231e3359] Fetching instance by UUID {{(pid=116063) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 13:00:54.597942 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-a31d101c-67de-4fe2-930d-01c8c8ad0729 tempest-AttachVolumeNegativeTest-1000400951 tempest-AttachVolumeNegativeTest-1000400951-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 13:00:54.598843 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-a31d101c-67de-4fe2-930d-01c8c8ad0729 tempest-AttachVolumeNegativeTest-1000400951 tempest-AttachVolumeNegativeTest-1000400951-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 13:00:54.599945 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-a31d101c-67de-4fe2-930d-01c8c8ad0729 tempest-AttachVolumeNegativeTest-1000400951 tempest-AttachVolumeNegativeTest-1000400951-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 13:00:54.600606 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-a31d101c-67de-4fe2-930d-01c8c8ad0729 tempest-AttachVolumeNegativeTest-1000400951 tempest-AttachVolumeNegativeTest-1000400951-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 13:00:54.616620 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: INFO nova.api.openstack.wsgi [None req-a31d101c-67de-4fe2-930d-01c8c8ad0729 tempest-AttachVolumeNegativeTest-1000400951 tempest-AttachVolumeNegativeTest-1000400951-project] HTTP exception thrown: Instance e79e4c5e-a1c6-4f80-9a63-d340231e3359 could not be found. Dec 14 13:00:54.617281 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.api.openstack.wsgi [None req-a31d101c-67de-4fe2-930d-01c8c8ad0729 tempest-AttachVolumeNegativeTest-1000400951 tempest-AttachVolumeNegativeTest-1000400951-project] Returning 404 to user: Instance e79e4c5e-a1c6-4f80-9a63-d340231e3359 could not be found. {{(pid=116063) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 14 13:00:54.618973 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: INFO nova.api.openstack.requestlog [None req-a31d101c-67de-4fe2-930d-01c8c8ad0729 tempest-AttachVolumeNegativeTest-1000400951 tempest-AttachVolumeNegativeTest-1000400951-project] 10.222.0.49 "GET /compute/v2.1/servers/e79e4c5e-a1c6-4f80-9a63-d340231e3359" status: 404 len: 111 microversion: 2.1 time: 0.036068 Dec 14 13:00:54.619555 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: [pid: 116063|app: 0|req: 261/499] 10.222.0.49 () {58 vars in 1235 bytes} [Tue Dec 14 13:00:54 2021] GET /compute/v2.1/servers/e79e4c5e-a1c6-4f80-9a63-d340231e3359 => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Dec 14 13:00:55.223251 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.api.openstack.wsgi [None req-8b73c9c6-aa87-410e-9b1f-d6d24b0ced96 tempest-VolumesSnapshotTestJSON-1649574085 tempest-VolumesSnapshotTestJSON-1649574085-project] Calling method '>' {{(pid=116064) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 13:00:55.223935 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.compute.api [None req-8b73c9c6-aa87-410e-9b1f-d6d24b0ced96 tempest-VolumesSnapshotTestJSON-1649574085 tempest-VolumesSnapshotTestJSON-1649574085-project] [instance: c48d3c23-3b4b-4220-8ead-d04a670ec64f] Fetching instance by UUID {{(pid=116064) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 13:00:55.236572 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-8b73c9c6-aa87-410e-9b1f-d6d24b0ced96 tempest-VolumesSnapshotTestJSON-1649574085 tempest-VolumesSnapshotTestJSON-1649574085-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 13:00:55.237393 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-8b73c9c6-aa87-410e-9b1f-d6d24b0ced96 tempest-VolumesSnapshotTestJSON-1649574085 tempest-VolumesSnapshotTestJSON-1649574085-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 13:00:55.238331 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-8b73c9c6-aa87-410e-9b1f-d6d24b0ced96 tempest-VolumesSnapshotTestJSON-1649574085 tempest-VolumesSnapshotTestJSON-1649574085-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 13:00:55.238822 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-8b73c9c6-aa87-410e-9b1f-d6d24b0ced96 tempest-VolumesSnapshotTestJSON-1649574085 tempest-VolumesSnapshotTestJSON-1649574085-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 13:00:55.394016 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.policy [None req-8b73c9c6-aa87-410e-9b1f-d6d24b0ced96 tempest-VolumesSnapshotTestJSON-1649574085 tempest-VolumesSnapshotTestJSON-1649574085-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e18311fd2704616a778d36332f199ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1bf776f341b4721b28eb9a5c84ba866', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116064) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 13:00:55.401981 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: INFO nova.api.openstack.requestlog [None req-8b73c9c6-aa87-410e-9b1f-d6d24b0ced96 tempest-VolumesSnapshotTestJSON-1649574085 tempest-VolumesSnapshotTestJSON-1649574085-project] 10.222.0.49 "GET /compute/v2.1/servers/c48d3c23-3b4b-4220-8ead-d04a670ec64f" status: 200 len: 1514 microversion: 2.1 time: 0.182415 Dec 14 13:00:55.420622 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.api.openstack.wsgi [None req-16f6c017-008a-4edd-9006-cd831ebd6144 tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] Calling method '>' {{(pid=116063) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 13:00:55.422261 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.compute.api [None req-16f6c017-008a-4edd-9006-cd831ebd6144 tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] [instance: c8de7730-62f2-4a77-b1e9-cf6a74fa366d] Fetching instance by UUID {{(pid=116063) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 13:00:55.428480 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: [pid: 116064|app: 0|req: 239/500] 10.222.0.49 () {58 vars in 1235 bytes} [Tue Dec 14 13:00:55 2021] GET /compute/v2.1/servers/c48d3c23-3b4b-4220-8ead-d04a670ec64f => generated 1514 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 14 13:00:55.431559 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-16f6c017-008a-4edd-9006-cd831ebd6144 tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 13:00:55.432263 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-16f6c017-008a-4edd-9006-cd831ebd6144 tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 13:00:55.433135 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-16f6c017-008a-4edd-9006-cd831ebd6144 tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 13:00:55.437427 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-16f6c017-008a-4edd-9006-cd831ebd6144 tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 13:00:55.664383 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.policy [None req-16f6c017-008a-4edd-9006-cd831ebd6144 tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79d74a2ea1e541d28d085c15cec34032', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68a8770b8dbe489a8119016fbee64eb5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116063) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 13:00:55.675162 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.policy [None req-16f6c017-008a-4edd-9006-cd831ebd6144 tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '79d74a2ea1e541d28d085c15cec34032', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68a8770b8dbe489a8119016fbee64eb5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116063) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 13:00:55.677397 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.policy [None req-16f6c017-008a-4edd-9006-cd831ebd6144 tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '79d74a2ea1e541d28d085c15cec34032', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68a8770b8dbe489a8119016fbee64eb5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116063) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 13:00:55.681232 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: INFO nova.api.openstack.requestlog [None req-16f6c017-008a-4edd-9006-cd831ebd6144 tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] 10.222.0.49 "GET /compute/v2.1/servers/c8de7730-62f2-4a77-b1e9-cf6a74fa366d" status: 200 len: 1740 microversion: 2.20 time: 0.262145 Dec 14 13:00:55.692872 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: [pid: 116063|app: 0|req: 262/501] 10.222.0.49 () {60 vars in 1276 bytes} [Tue Dec 14 13:00:55 2021] GET /compute/v2.1/servers/c8de7730-62f2-4a77-b1e9-cf6a74fa366d => generated 1740 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 14 13:00:55.775885 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.api.openstack.wsgi [None req-7245e9ee-bb40-425f-8798-255d8b8856e9 tempest-AttachVolumeNegativeTest-1000400951 tempest-AttachVolumeNegativeTest-1000400951-project] Calling method '>' {{(pid=116064) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 13:00:55.776391 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.compute.api [None req-7245e9ee-bb40-425f-8798-255d8b8856e9 tempest-AttachVolumeNegativeTest-1000400951 tempest-AttachVolumeNegativeTest-1000400951-project] [instance: 8d264701-aaa0-465f-a4aa-0cffa41351ef] Fetching instance by UUID {{(pid=116064) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 13:00:55.783003 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-7245e9ee-bb40-425f-8798-255d8b8856e9 tempest-AttachVolumeNegativeTest-1000400951 tempest-AttachVolumeNegativeTest-1000400951-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 13:00:55.783448 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-7245e9ee-bb40-425f-8798-255d8b8856e9 tempest-AttachVolumeNegativeTest-1000400951 tempest-AttachVolumeNegativeTest-1000400951-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 13:00:55.784232 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-7245e9ee-bb40-425f-8798-255d8b8856e9 tempest-AttachVolumeNegativeTest-1000400951 tempest-AttachVolumeNegativeTest-1000400951-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 13:00:55.784674 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-7245e9ee-bb40-425f-8798-255d8b8856e9 tempest-AttachVolumeNegativeTest-1000400951 tempest-AttachVolumeNegativeTest-1000400951-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 13:00:55.797982 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.api.openstack.wsgi [req-ab58f7ae-925f-4146-b937-371d233e2dcf req-40ffc0c1-0cb3-41b9-aa5e-673884517d00 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c48d3c23-3b4b-4220-8ead-d04a670ec64f", "name": "network-vif-deleted", "tag": "c342614d-9975-4aaa-a444-6e5c731f8f7a"}]} {{(pid=116063) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 14 13:00:55.799993 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 14 13:00:55.799993 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: warnings.warn(msg) Dec 14 13:00:55.809512 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [req-ab58f7ae-925f-4146-b937-371d233e2dcf req-40ffc0c1-0cb3-41b9-aa5e-673884517d00 service nova] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 13:00:55.810225 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [req-ab58f7ae-925f-4146-b937-371d233e2dcf req-40ffc0c1-0cb3-41b9-aa5e-673884517d00 service nova] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 13:00:55.824628 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.compute.api [None req-7245e9ee-bb40-425f-8798-255d8b8856e9 tempest-AttachVolumeNegativeTest-1000400951 tempest-AttachVolumeNegativeTest-1000400951-project] [instance: 8d264701-aaa0-465f-a4aa-0cffa41351ef] Going to try to terminate instance {{(pid=116064) delete /opt/stack/nova/nova/compute/api.py:2614}} Dec 14 13:00:55.826341 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: INFO nova.api.openstack.compute.server_external_events [req-ab58f7ae-925f-4146-b937-371d233e2dcf req-40ffc0c1-0cb3-41b9-aa5e-673884517d00 service nova] Creating event network-vif-deleted:c342614d-9975-4aaa-a444-6e5c731f8f7a for instance c48d3c23-3b4b-4220-8ead-d04a670ec64f on hv-cinder-78447 Dec 14 13:00:55.835792 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: INFO nova.api.openstack.requestlog [req-ab58f7ae-925f-4146-b937-371d233e2dcf req-40ffc0c1-0cb3-41b9-aa5e-673884517d00 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041909 Dec 14 13:00:55.840637 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: [pid: 116063|app: 0|req: 263/502] 10.222.0.49 () {64 vars in 1317 bytes} [Tue Dec 14 13:00:55 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Dec 14 13:00:55.957178 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: INFO nova.api.openstack.requestlog [None req-7245e9ee-bb40-425f-8798-255d8b8856e9 tempest-AttachVolumeNegativeTest-1000400951 tempest-AttachVolumeNegativeTest-1000400951-project] 10.222.0.49 "DELETE /compute/v2.1/servers/8d264701-aaa0-465f-a4aa-0cffa41351ef" status: 204 len: 0 microversion: 2.1 time: 0.180947 Dec 14 13:00:55.958015 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: [pid: 116064|app: 0|req: 240/503] 10.222.0.49 () {58 vars in 1238 bytes} [Tue Dec 14 13:00:55 2021] DELETE /compute/v2.1/servers/8d264701-aaa0-465f-a4aa-0cffa41351ef => generated 0 bytes in 187 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Dec 14 13:00:55.975414 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.api.openstack.wsgi [None req-85cb5192-cd32-4ab9-8a31-824d9e1a7058 tempest-AttachVolumeNegativeTest-1000400951 tempest-AttachVolumeNegativeTest-1000400951-project] Calling method '>' {{(pid=116063) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 13:00:55.976159 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.compute.api [None req-85cb5192-cd32-4ab9-8a31-824d9e1a7058 tempest-AttachVolumeNegativeTest-1000400951 tempest-AttachVolumeNegativeTest-1000400951-project] [instance: 8d264701-aaa0-465f-a4aa-0cffa41351ef] Fetching instance by UUID {{(pid=116063) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 13:00:55.982972 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-85cb5192-cd32-4ab9-8a31-824d9e1a7058 tempest-AttachVolumeNegativeTest-1000400951 tempest-AttachVolumeNegativeTest-1000400951-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 13:00:55.983423 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-85cb5192-cd32-4ab9-8a31-824d9e1a7058 tempest-AttachVolumeNegativeTest-1000400951 tempest-AttachVolumeNegativeTest-1000400951-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 13:00:55.984228 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-85cb5192-cd32-4ab9-8a31-824d9e1a7058 tempest-AttachVolumeNegativeTest-1000400951 tempest-AttachVolumeNegativeTest-1000400951-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 13:00:55.984665 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-85cb5192-cd32-4ab9-8a31-824d9e1a7058 tempest-AttachVolumeNegativeTest-1000400951 tempest-AttachVolumeNegativeTest-1000400951-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 13:00:56.127056 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.policy [None req-85cb5192-cd32-4ab9-8a31-824d9e1a7058 tempest-AttachVolumeNegativeTest-1000400951 tempest-AttachVolumeNegativeTest-1000400951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57d0ec01f0784c8ea87d339980bed3cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad27b8951cae4eeeafa257f45217653a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116063) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 13:00:56.134971 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: INFO nova.api.openstack.requestlog [None req-85cb5192-cd32-4ab9-8a31-824d9e1a7058 tempest-AttachVolumeNegativeTest-1000400951 tempest-AttachVolumeNegativeTest-1000400951-project] 10.222.0.49 "GET /compute/v2.1/servers/8d264701-aaa0-465f-a4aa-0cffa41351ef" status: 200 len: 1513 microversion: 2.1 time: 0.165784 Dec 14 13:00:56.135511 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: [pid: 116063|app: 0|req: 264/504] 10.222.0.49 () {58 vars in 1235 bytes} [Tue Dec 14 13:00:55 2021] GET /compute/v2.1/servers/8d264701-aaa0-465f-a4aa-0cffa41351ef => generated 1513 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 14 13:00:56.421300 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.api.openstack.wsgi [None req-6f9ee12d-e81a-49ef-a307-51113cd69cc4 tempest-VolumesSnapshotTestJSON-1649574085 tempest-VolumesSnapshotTestJSON-1649574085-project] Calling method '>' {{(pid=116064) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 13:00:56.422057 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.compute.api [None req-6f9ee12d-e81a-49ef-a307-51113cd69cc4 tempest-VolumesSnapshotTestJSON-1649574085 tempest-VolumesSnapshotTestJSON-1649574085-project] [instance: c48d3c23-3b4b-4220-8ead-d04a670ec64f] Fetching instance by UUID {{(pid=116064) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 13:00:56.428654 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-6f9ee12d-e81a-49ef-a307-51113cd69cc4 tempest-VolumesSnapshotTestJSON-1649574085 tempest-VolumesSnapshotTestJSON-1649574085-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 13:00:56.429146 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-6f9ee12d-e81a-49ef-a307-51113cd69cc4 tempest-VolumesSnapshotTestJSON-1649574085 tempest-VolumesSnapshotTestJSON-1649574085-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 13:00:56.429931 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-6f9ee12d-e81a-49ef-a307-51113cd69cc4 tempest-VolumesSnapshotTestJSON-1649574085 tempest-VolumesSnapshotTestJSON-1649574085-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 13:00:56.430382 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-6f9ee12d-e81a-49ef-a307-51113cd69cc4 tempest-VolumesSnapshotTestJSON-1649574085 tempest-VolumesSnapshotTestJSON-1649574085-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 13:00:56.464151 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-6f9ee12d-e81a-49ef-a307-51113cd69cc4 tempest-VolumesSnapshotTestJSON-1649574085 tempest-VolumesSnapshotTestJSON-1649574085-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 13:00:56.464600 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-6f9ee12d-e81a-49ef-a307-51113cd69cc4 tempest-VolumesSnapshotTestJSON-1649574085 tempest-VolumesSnapshotTestJSON-1649574085-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 13:00:56.465082 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.objects.instance [None req-6f9ee12d-e81a-49ef-a307-51113cd69cc4 tempest-VolumesSnapshotTestJSON-1649574085 tempest-VolumesSnapshotTestJSON-1649574085-project] Lazy-loading 'fault' on Instance uuid c48d3c23-3b4b-4220-8ead-d04a670ec64f {{(pid=116064) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Dec 14 13:00:56.504526 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.policy [None req-6f9ee12d-e81a-49ef-a307-51113cd69cc4 tempest-VolumesSnapshotTestJSON-1649574085 tempest-VolumesSnapshotTestJSON-1649574085-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e18311fd2704616a778d36332f199ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1bf776f341b4721b28eb9a5c84ba866', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116064) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 13:00:56.512280 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: INFO nova.api.openstack.requestlog [None req-6f9ee12d-e81a-49ef-a307-51113cd69cc4 tempest-VolumesSnapshotTestJSON-1649574085 tempest-VolumesSnapshotTestJSON-1649574085-project] 10.222.0.49 "GET /compute/v2.1/servers/c48d3c23-3b4b-4220-8ead-d04a670ec64f" status: 200 len: 1309 microversion: 2.1 time: 0.096028 Dec 14 13:00:56.512841 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: [pid: 116064|app: 0|req: 241/505] 10.222.0.49 () {58 vars in 1235 bytes} [Tue Dec 14 13:00:56 2021] GET /compute/v2.1/servers/c48d3c23-3b4b-4220-8ead-d04a670ec64f => generated 1309 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 14 13:00:56.699701 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.api.openstack.wsgi [None req-836c9047-4ac5-4a1f-a8fc-afb10357c565 tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] Calling method '>' {{(pid=116063) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 13:00:56.700309 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.compute.api [None req-836c9047-4ac5-4a1f-a8fc-afb10357c565 tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] [instance: c8de7730-62f2-4a77-b1e9-cf6a74fa366d] Fetching instance by UUID {{(pid=116063) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 13:00:56.707020 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-836c9047-4ac5-4a1f-a8fc-afb10357c565 tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 13:00:56.707451 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-836c9047-4ac5-4a1f-a8fc-afb10357c565 tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 13:00:56.708263 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-836c9047-4ac5-4a1f-a8fc-afb10357c565 tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 13:00:56.708695 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-836c9047-4ac5-4a1f-a8fc-afb10357c565 tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 13:00:56.858239 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.policy [None req-836c9047-4ac5-4a1f-a8fc-afb10357c565 tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79d74a2ea1e541d28d085c15cec34032', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68a8770b8dbe489a8119016fbee64eb5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116063) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 13:00:56.866193 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.policy [None req-836c9047-4ac5-4a1f-a8fc-afb10357c565 tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '79d74a2ea1e541d28d085c15cec34032', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68a8770b8dbe489a8119016fbee64eb5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116063) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 13:00:56.868011 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.policy [None req-836c9047-4ac5-4a1f-a8fc-afb10357c565 tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '79d74a2ea1e541d28d085c15cec34032', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68a8770b8dbe489a8119016fbee64eb5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116063) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 13:00:56.869441 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: INFO nova.api.openstack.requestlog [None req-836c9047-4ac5-4a1f-a8fc-afb10357c565 tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] 10.222.0.49 "GET /compute/v2.1/servers/c8de7730-62f2-4a77-b1e9-cf6a74fa366d" status: 200 len: 1740 microversion: 2.20 time: 0.173623 Dec 14 13:00:56.870077 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: [pid: 116063|app: 0|req: 265/506] 10.222.0.49 () {60 vars in 1276 bytes} [Tue Dec 14 13:00:56 2021] GET /compute/v2.1/servers/c8de7730-62f2-4a77-b1e9-cf6a74fa366d => generated 1740 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 14 13:00:57.151850 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.api.openstack.wsgi [None req-acc10e5e-404e-4170-88d9-c2df03da67bc tempest-AttachVolumeNegativeTest-1000400951 tempest-AttachVolumeNegativeTest-1000400951-project] Calling method '>' {{(pid=116064) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 13:00:57.152551 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.compute.api [None req-acc10e5e-404e-4170-88d9-c2df03da67bc tempest-AttachVolumeNegativeTest-1000400951 tempest-AttachVolumeNegativeTest-1000400951-project] [instance: 8d264701-aaa0-465f-a4aa-0cffa41351ef] Fetching instance by UUID {{(pid=116064) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 13:00:57.159683 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-acc10e5e-404e-4170-88d9-c2df03da67bc tempest-AttachVolumeNegativeTest-1000400951 tempest-AttachVolumeNegativeTest-1000400951-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 13:00:57.160138 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-acc10e5e-404e-4170-88d9-c2df03da67bc tempest-AttachVolumeNegativeTest-1000400951 tempest-AttachVolumeNegativeTest-1000400951-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 13:00:57.160950 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-acc10e5e-404e-4170-88d9-c2df03da67bc tempest-AttachVolumeNegativeTest-1000400951 tempest-AttachVolumeNegativeTest-1000400951-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 13:00:57.161387 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-acc10e5e-404e-4170-88d9-c2df03da67bc tempest-AttachVolumeNegativeTest-1000400951 tempest-AttachVolumeNegativeTest-1000400951-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 13:00:57.299257 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.policy [None req-acc10e5e-404e-4170-88d9-c2df03da67bc tempest-AttachVolumeNegativeTest-1000400951 tempest-AttachVolumeNegativeTest-1000400951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57d0ec01f0784c8ea87d339980bed3cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad27b8951cae4eeeafa257f45217653a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116064) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 13:00:57.307582 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: INFO nova.api.openstack.requestlog [None req-acc10e5e-404e-4170-88d9-c2df03da67bc tempest-AttachVolumeNegativeTest-1000400951 tempest-AttachVolumeNegativeTest-1000400951-project] 10.222.0.49 "GET /compute/v2.1/servers/8d264701-aaa0-465f-a4aa-0cffa41351ef" status: 200 len: 1513 microversion: 2.1 time: 0.159738 Dec 14 13:00:57.317236 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: [pid: 116064|app: 0|req: 242/507] 10.222.0.49 () {58 vars in 1235 bytes} [Tue Dec 14 13:00:57 2021] GET /compute/v2.1/servers/8d264701-aaa0-465f-a4aa-0cffa41351ef => generated 1513 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 14 13:00:57.531656 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.api.openstack.wsgi [None req-f5dcf8a9-70ea-4a77-9615-17d43dda8397 tempest-VolumesSnapshotTestJSON-1649574085 tempest-VolumesSnapshotTestJSON-1649574085-project] Calling method '>' {{(pid=116063) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 13:00:57.532494 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.compute.api [None req-f5dcf8a9-70ea-4a77-9615-17d43dda8397 tempest-VolumesSnapshotTestJSON-1649574085 tempest-VolumesSnapshotTestJSON-1649574085-project] [instance: c48d3c23-3b4b-4220-8ead-d04a670ec64f] Fetching instance by UUID {{(pid=116063) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 13:00:57.540209 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-f5dcf8a9-70ea-4a77-9615-17d43dda8397 tempest-VolumesSnapshotTestJSON-1649574085 tempest-VolumesSnapshotTestJSON-1649574085-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 13:00:57.540732 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-f5dcf8a9-70ea-4a77-9615-17d43dda8397 tempest-VolumesSnapshotTestJSON-1649574085 tempest-VolumesSnapshotTestJSON-1649574085-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 13:00:57.542055 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-f5dcf8a9-70ea-4a77-9615-17d43dda8397 tempest-VolumesSnapshotTestJSON-1649574085 tempest-VolumesSnapshotTestJSON-1649574085-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 13:00:57.542547 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-f5dcf8a9-70ea-4a77-9615-17d43dda8397 tempest-VolumesSnapshotTestJSON-1649574085 tempest-VolumesSnapshotTestJSON-1649574085-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 13:00:57.558764 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: INFO nova.api.openstack.wsgi [None req-f5dcf8a9-70ea-4a77-9615-17d43dda8397 tempest-VolumesSnapshotTestJSON-1649574085 tempest-VolumesSnapshotTestJSON-1649574085-project] HTTP exception thrown: Instance c48d3c23-3b4b-4220-8ead-d04a670ec64f could not be found. Dec 14 13:00:57.559274 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.api.openstack.wsgi [None req-f5dcf8a9-70ea-4a77-9615-17d43dda8397 tempest-VolumesSnapshotTestJSON-1649574085 tempest-VolumesSnapshotTestJSON-1649574085-project] Returning 404 to user: Instance c48d3c23-3b4b-4220-8ead-d04a670ec64f could not be found. {{(pid=116063) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 14 13:00:57.560124 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: INFO nova.api.openstack.requestlog [None req-f5dcf8a9-70ea-4a77-9615-17d43dda8397 tempest-VolumesSnapshotTestJSON-1649574085 tempest-VolumesSnapshotTestJSON-1649574085-project] 10.222.0.49 "GET /compute/v2.1/servers/c48d3c23-3b4b-4220-8ead-d04a670ec64f" status: 404 len: 111 microversion: 2.1 time: 0.033646 Dec 14 13:00:57.560685 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: [pid: 116063|app: 0|req: 266/508] 10.222.0.49 () {58 vars in 1235 bytes} [Tue Dec 14 13:00:57 2021] GET /compute/v2.1/servers/c48d3c23-3b4b-4220-8ead-d04a670ec64f => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Dec 14 13:00:57.843921 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.api.openstack.wsgi [None req-098a98ad-382f-4fc5-b717-920e70790f0e tempest-ServerRescueNegativeTestJSON-1573931620 tempest-ServerRescueNegativeTestJSON-1573931620-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=116064) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 14 13:00:57.844983 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.compute.api [None req-098a98ad-382f-4fc5-b717-920e70790f0e tempest-ServerRescueNegativeTestJSON-1573931620 tempest-ServerRescueNegativeTestJSON-1573931620-project] [instance: eb6e04a4-8901-47df-9b51-7c1664bd3f6c] Fetching instance by UUID {{(pid=116064) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 13:00:57.852356 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-098a98ad-382f-4fc5-b717-920e70790f0e tempest-ServerRescueNegativeTestJSON-1573931620 tempest-ServerRescueNegativeTestJSON-1573931620-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 13:00:57.852805 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-098a98ad-382f-4fc5-b717-920e70790f0e tempest-ServerRescueNegativeTestJSON-1573931620 tempest-ServerRescueNegativeTestJSON-1573931620-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 13:00:57.853614 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-098a98ad-382f-4fc5-b717-920e70790f0e tempest-ServerRescueNegativeTestJSON-1573931620 tempest-ServerRescueNegativeTestJSON-1573931620-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 13:00:57.854032 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-098a98ad-382f-4fc5-b717-920e70790f0e tempest-ServerRescueNegativeTestJSON-1573931620 tempest-ServerRescueNegativeTestJSON-1573931620-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 13:00:57.878017 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.objects.instance [None req-098a98ad-382f-4fc5-b717-920e70790f0e tempest-ServerRescueNegativeTestJSON-1573931620 tempest-ServerRescueNegativeTestJSON-1573931620-project] Lazy-loading 'flavor' on Instance uuid eb6e04a4-8901-47df-9b51-7c1664bd3f6c {{(pid=116064) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Dec 14 13:00:57.887399 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.api.openstack.wsgi [None req-dabe9ef8-2751-4d8f-8912-7575edebdb73 tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] Calling method '>' {{(pid=116063) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 13:00:57.888030 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.compute.api [None req-dabe9ef8-2751-4d8f-8912-7575edebdb73 tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] [instance: c8de7730-62f2-4a77-b1e9-cf6a74fa366d] Fetching instance by UUID {{(pid=116063) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 13:00:57.894200 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-dabe9ef8-2751-4d8f-8912-7575edebdb73 tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 13:00:57.894720 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-dabe9ef8-2751-4d8f-8912-7575edebdb73 tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 13:00:57.895562 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-dabe9ef8-2751-4d8f-8912-7575edebdb73 tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 13:00:57.896062 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-dabe9ef8-2751-4d8f-8912-7575edebdb73 tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 13:00:58.001673 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: INFO nova.api.openstack.requestlog [None req-098a98ad-382f-4fc5-b717-920e70790f0e tempest-ServerRescueNegativeTestJSON-1573931620 tempest-ServerRescueNegativeTestJSON-1573931620-project] 10.222.0.49 "POST /compute/v2.1/servers/eb6e04a4-8901-47df-9b51-7c1664bd3f6c/action" status: 200 len: 32 microversion: 2.1 time: 0.161511 Dec 14 13:00:58.002837 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: [pid: 116064|app: 0|req: 243/509] 10.222.0.49 () {60 vars in 1277 bytes} [Tue Dec 14 13:00:57 2021] POST /compute/v2.1/servers/eb6e04a4-8901-47df-9b51-7c1664bd3f6c/action => generated 32 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Dec 14 13:00:58.012649 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.api.openstack.wsgi [None req-59d1a12e-3ed8-4c82-b63d-ab32c30dbe19 tempest-ServerRescueNegativeTestJSON-1573931620 tempest-ServerRescueNegativeTestJSON-1573931620-project] Calling method '>' {{(pid=116064) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 13:00:58.013659 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.compute.api [None req-59d1a12e-3ed8-4c82-b63d-ab32c30dbe19 tempest-ServerRescueNegativeTestJSON-1573931620 tempest-ServerRescueNegativeTestJSON-1573931620-project] [instance: eb6e04a4-8901-47df-9b51-7c1664bd3f6c] Fetching instance by UUID {{(pid=116064) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 13:00:58.020201 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-59d1a12e-3ed8-4c82-b63d-ab32c30dbe19 tempest-ServerRescueNegativeTestJSON-1573931620 tempest-ServerRescueNegativeTestJSON-1573931620-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 13:00:58.020667 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-59d1a12e-3ed8-4c82-b63d-ab32c30dbe19 tempest-ServerRescueNegativeTestJSON-1573931620 tempest-ServerRescueNegativeTestJSON-1573931620-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 13:00:58.021564 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-59d1a12e-3ed8-4c82-b63d-ab32c30dbe19 tempest-ServerRescueNegativeTestJSON-1573931620 tempest-ServerRescueNegativeTestJSON-1573931620-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 13:00:58.022023 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-59d1a12e-3ed8-4c82-b63d-ab32c30dbe19 tempest-ServerRescueNegativeTestJSON-1573931620 tempest-ServerRescueNegativeTestJSON-1573931620-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 13:00:58.027781 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.policy [None req-dabe9ef8-2751-4d8f-8912-7575edebdb73 tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79d74a2ea1e541d28d085c15cec34032', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68a8770b8dbe489a8119016fbee64eb5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116063) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 13:00:58.035697 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.policy [None req-dabe9ef8-2751-4d8f-8912-7575edebdb73 tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '79d74a2ea1e541d28d085c15cec34032', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68a8770b8dbe489a8119016fbee64eb5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116063) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 13:00:58.037320 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.policy [None req-dabe9ef8-2751-4d8f-8912-7575edebdb73 tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '79d74a2ea1e541d28d085c15cec34032', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68a8770b8dbe489a8119016fbee64eb5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116063) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 13:00:58.038498 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: INFO nova.api.openstack.requestlog [None req-dabe9ef8-2751-4d8f-8912-7575edebdb73 tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] 10.222.0.49 "GET /compute/v2.1/servers/c8de7730-62f2-4a77-b1e9-cf6a74fa366d" status: 200 len: 1722 microversion: 2.20 time: 0.154837 Dec 14 13:00:58.039579 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: [pid: 116063|app: 0|req: 267/510] 10.222.0.49 () {60 vars in 1276 bytes} [Tue Dec 14 13:00:57 2021] GET /compute/v2.1/servers/c8de7730-62f2-4a77-b1e9-cf6a74fa366d => generated 1722 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 14 13:00:58.158405 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.policy [None req-59d1a12e-3ed8-4c82-b63d-ab32c30dbe19 tempest-ServerRescueNegativeTestJSON-1573931620 tempest-ServerRescueNegativeTestJSON-1573931620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '731cbbfe17214ded8ac66299d66dfc45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '010919ea84eb4eb8b936c63153600eba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116064) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 13:00:58.166621 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: INFO nova.api.openstack.requestlog [None req-59d1a12e-3ed8-4c82-b63d-ab32c30dbe19 tempest-ServerRescueNegativeTestJSON-1573931620 tempest-ServerRescueNegativeTestJSON-1573931620-project] 10.222.0.49 "GET /compute/v2.1/servers/eb6e04a4-8901-47df-9b51-7c1664bd3f6c" status: 200 len: 1569 microversion: 2.1 time: 0.158704 Dec 14 13:00:58.167196 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: [pid: 116064|app: 0|req: 244/511] 10.222.0.49 () {58 vars in 1235 bytes} [Tue Dec 14 13:00:58 2021] GET /compute/v2.1/servers/eb6e04a4-8901-47df-9b51-7c1664bd3f6c => generated 1569 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 14 13:00:58.324948 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.api.openstack.wsgi [None req-29cd55e2-0bb8-4c1c-9e46-dffb26918858 tempest-AttachVolumeNegativeTest-1000400951 tempest-AttachVolumeNegativeTest-1000400951-project] Calling method '>' {{(pid=116063) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 13:00:58.325550 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.compute.api [None req-29cd55e2-0bb8-4c1c-9e46-dffb26918858 tempest-AttachVolumeNegativeTest-1000400951 tempest-AttachVolumeNegativeTest-1000400951-project] [instance: 8d264701-aaa0-465f-a4aa-0cffa41351ef] Fetching instance by UUID {{(pid=116063) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 13:00:58.331918 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-29cd55e2-0bb8-4c1c-9e46-dffb26918858 tempest-AttachVolumeNegativeTest-1000400951 tempest-AttachVolumeNegativeTest-1000400951-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 13:00:58.332400 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-29cd55e2-0bb8-4c1c-9e46-dffb26918858 tempest-AttachVolumeNegativeTest-1000400951 tempest-AttachVolumeNegativeTest-1000400951-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 13:00:58.333172 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-29cd55e2-0bb8-4c1c-9e46-dffb26918858 tempest-AttachVolumeNegativeTest-1000400951 tempest-AttachVolumeNegativeTest-1000400951-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 13:00:58.333608 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-29cd55e2-0bb8-4c1c-9e46-dffb26918858 tempest-AttachVolumeNegativeTest-1000400951 tempest-AttachVolumeNegativeTest-1000400951-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 13:00:58.472426 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.policy [None req-29cd55e2-0bb8-4c1c-9e46-dffb26918858 tempest-AttachVolumeNegativeTest-1000400951 tempest-AttachVolumeNegativeTest-1000400951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57d0ec01f0784c8ea87d339980bed3cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad27b8951cae4eeeafa257f45217653a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116063) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 13:00:58.480496 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: INFO nova.api.openstack.requestlog [None req-29cd55e2-0bb8-4c1c-9e46-dffb26918858 tempest-AttachVolumeNegativeTest-1000400951 tempest-AttachVolumeNegativeTest-1000400951-project] 10.222.0.49 "GET /compute/v2.1/servers/8d264701-aaa0-465f-a4aa-0cffa41351ef" status: 200 len: 1513 microversion: 2.1 time: 0.159308 Dec 14 13:00:58.481300 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: [pid: 116063|app: 0|req: 268/512] 10.222.0.49 () {58 vars in 1235 bytes} [Tue Dec 14 13:00:58 2021] GET /compute/v2.1/servers/8d264701-aaa0-465f-a4aa-0cffa41351ef => generated 1513 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 14 13:00:59.059296 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.api.openstack.wsgi [None req-ca8ea215-4c9e-4c6d-82aa-93e81ac87c5c tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] Calling method '>' {{(pid=116064) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 13:00:59.059925 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.compute.api [None req-ca8ea215-4c9e-4c6d-82aa-93e81ac87c5c tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] [instance: c8de7730-62f2-4a77-b1e9-cf6a74fa366d] Fetching instance by UUID {{(pid=116064) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 13:00:59.068768 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-ca8ea215-4c9e-4c6d-82aa-93e81ac87c5c tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 13:00:59.069252 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-ca8ea215-4c9e-4c6d-82aa-93e81ac87c5c tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 13:00:59.070032 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-ca8ea215-4c9e-4c6d-82aa-93e81ac87c5c tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 13:00:59.070465 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-ca8ea215-4c9e-4c6d-82aa-93e81ac87c5c tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 13:00:59.183509 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.api.openstack.wsgi [None req-f90042f2-667f-4fbd-a6fd-8234d817e91f tempest-ServerRescueNegativeTestJSON-1573931620 tempest-ServerRescueNegativeTestJSON-1573931620-project] Calling method '>' {{(pid=116063) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 13:00:59.184178 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.compute.api [None req-f90042f2-667f-4fbd-a6fd-8234d817e91f tempest-ServerRescueNegativeTestJSON-1573931620 tempest-ServerRescueNegativeTestJSON-1573931620-project] [instance: eb6e04a4-8901-47df-9b51-7c1664bd3f6c] Fetching instance by UUID {{(pid=116063) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 13:00:59.190777 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-f90042f2-667f-4fbd-a6fd-8234d817e91f tempest-ServerRescueNegativeTestJSON-1573931620 tempest-ServerRescueNegativeTestJSON-1573931620-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 13:00:59.191219 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-f90042f2-667f-4fbd-a6fd-8234d817e91f tempest-ServerRescueNegativeTestJSON-1573931620 tempest-ServerRescueNegativeTestJSON-1573931620-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 13:00:59.192033 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-f90042f2-667f-4fbd-a6fd-8234d817e91f tempest-ServerRescueNegativeTestJSON-1573931620 tempest-ServerRescueNegativeTestJSON-1573931620-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 13:00:59.192455 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-f90042f2-667f-4fbd-a6fd-8234d817e91f tempest-ServerRescueNegativeTestJSON-1573931620 tempest-ServerRescueNegativeTestJSON-1573931620-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 13:00:59.218359 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.policy [None req-ca8ea215-4c9e-4c6d-82aa-93e81ac87c5c tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79d74a2ea1e541d28d085c15cec34032', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68a8770b8dbe489a8119016fbee64eb5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116064) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 13:00:59.226807 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.policy [None req-ca8ea215-4c9e-4c6d-82aa-93e81ac87c5c tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '79d74a2ea1e541d28d085c15cec34032', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68a8770b8dbe489a8119016fbee64eb5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116064) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 13:00:59.228320 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.policy [None req-ca8ea215-4c9e-4c6d-82aa-93e81ac87c5c tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '79d74a2ea1e541d28d085c15cec34032', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68a8770b8dbe489a8119016fbee64eb5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116064) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 13:00:59.229533 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: INFO nova.api.openstack.requestlog [None req-ca8ea215-4c9e-4c6d-82aa-93e81ac87c5c tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] 10.222.0.49 "GET /compute/v2.1/servers/c8de7730-62f2-4a77-b1e9-cf6a74fa366d" status: 200 len: 1722 microversion: 2.20 time: 0.174527 Dec 14 13:00:59.230163 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: [pid: 116064|app: 0|req: 245/513] 10.222.0.49 () {60 vars in 1276 bytes} [Tue Dec 14 13:00:59 2021] GET /compute/v2.1/servers/c8de7730-62f2-4a77-b1e9-cf6a74fa366d => generated 1722 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 14 13:00:59.325497 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.policy [None req-f90042f2-667f-4fbd-a6fd-8234d817e91f tempest-ServerRescueNegativeTestJSON-1573931620 tempest-ServerRescueNegativeTestJSON-1573931620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '731cbbfe17214ded8ac66299d66dfc45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '010919ea84eb4eb8b936c63153600eba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116063) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 13:00:59.333582 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: INFO nova.api.openstack.requestlog [None req-f90042f2-667f-4fbd-a6fd-8234d817e91f tempest-ServerRescueNegativeTestJSON-1573931620 tempest-ServerRescueNegativeTestJSON-1573931620-project] 10.222.0.49 "GET /compute/v2.1/servers/eb6e04a4-8901-47df-9b51-7c1664bd3f6c" status: 200 len: 1569 microversion: 2.1 time: 0.153796 Dec 14 13:00:59.334420 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: [pid: 116063|app: 0|req: 269/514] 10.222.0.49 () {58 vars in 1235 bytes} [Tue Dec 14 13:00:59 2021] GET /compute/v2.1/servers/eb6e04a4-8901-47df-9b51-7c1664bd3f6c => generated 1569 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 14 13:00:59.497934 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.api.openstack.wsgi [None req-c16757d2-c6b8-4da8-823f-8a9ca4fd1967 tempest-AttachVolumeNegativeTest-1000400951 tempest-AttachVolumeNegativeTest-1000400951-project] Calling method '>' {{(pid=116064) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 13:00:59.498726 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.compute.api [None req-c16757d2-c6b8-4da8-823f-8a9ca4fd1967 tempest-AttachVolumeNegativeTest-1000400951 tempest-AttachVolumeNegativeTest-1000400951-project] [instance: 8d264701-aaa0-465f-a4aa-0cffa41351ef] Fetching instance by UUID {{(pid=116064) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 13:00:59.505118 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-c16757d2-c6b8-4da8-823f-8a9ca4fd1967 tempest-AttachVolumeNegativeTest-1000400951 tempest-AttachVolumeNegativeTest-1000400951-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 13:00:59.505569 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-c16757d2-c6b8-4da8-823f-8a9ca4fd1967 tempest-AttachVolumeNegativeTest-1000400951 tempest-AttachVolumeNegativeTest-1000400951-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 13:00:59.506343 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-c16757d2-c6b8-4da8-823f-8a9ca4fd1967 tempest-AttachVolumeNegativeTest-1000400951 tempest-AttachVolumeNegativeTest-1000400951-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 13:00:59.506767 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-c16757d2-c6b8-4da8-823f-8a9ca4fd1967 tempest-AttachVolumeNegativeTest-1000400951 tempest-AttachVolumeNegativeTest-1000400951-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 13:00:59.644040 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.policy [None req-c16757d2-c6b8-4da8-823f-8a9ca4fd1967 tempest-AttachVolumeNegativeTest-1000400951 tempest-AttachVolumeNegativeTest-1000400951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57d0ec01f0784c8ea87d339980bed3cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad27b8951cae4eeeafa257f45217653a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116064) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 13:00:59.653480 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: INFO nova.api.openstack.requestlog [None req-c16757d2-c6b8-4da8-823f-8a9ca4fd1967 tempest-AttachVolumeNegativeTest-1000400951 tempest-AttachVolumeNegativeTest-1000400951-project] 10.222.0.49 "GET /compute/v2.1/servers/8d264701-aaa0-465f-a4aa-0cffa41351ef" status: 200 len: 1513 microversion: 2.1 time: 0.159549 Dec 14 13:00:59.654099 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: [pid: 116064|app: 0|req: 246/515] 10.222.0.49 () {58 vars in 1235 bytes} [Tue Dec 14 13:00:59 2021] GET /compute/v2.1/servers/8d264701-aaa0-465f-a4aa-0cffa41351ef => generated 1513 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 14 13:01:00.248563 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.api.openstack.wsgi [None req-cc96f593-dc6d-4e9f-8ef0-c74bc3e50469 tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] Calling method '>' {{(pid=116063) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 13:01:00.249169 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.compute.api [None req-cc96f593-dc6d-4e9f-8ef0-c74bc3e50469 tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] [instance: c8de7730-62f2-4a77-b1e9-cf6a74fa366d] Fetching instance by UUID {{(pid=116063) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 13:01:00.255870 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-cc96f593-dc6d-4e9f-8ef0-c74bc3e50469 tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 13:01:00.256315 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-cc96f593-dc6d-4e9f-8ef0-c74bc3e50469 tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 13:01:00.257125 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-cc96f593-dc6d-4e9f-8ef0-c74bc3e50469 tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 13:01:00.257563 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-cc96f593-dc6d-4e9f-8ef0-c74bc3e50469 tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 13:01:00.351305 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.api.openstack.wsgi [None req-e3fc9606-92e7-420b-a773-4637fcf13719 tempest-ServerRescueNegativeTestJSON-1573931620 tempest-ServerRescueNegativeTestJSON-1573931620-project] Calling method '>' {{(pid=116064) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 13:01:00.351996 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.compute.api [None req-e3fc9606-92e7-420b-a773-4637fcf13719 tempest-ServerRescueNegativeTestJSON-1573931620 tempest-ServerRescueNegativeTestJSON-1573931620-project] [instance: eb6e04a4-8901-47df-9b51-7c1664bd3f6c] Fetching instance by UUID {{(pid=116064) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 13:01:00.359197 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-e3fc9606-92e7-420b-a773-4637fcf13719 tempest-ServerRescueNegativeTestJSON-1573931620 tempest-ServerRescueNegativeTestJSON-1573931620-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 13:01:00.359614 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-e3fc9606-92e7-420b-a773-4637fcf13719 tempest-ServerRescueNegativeTestJSON-1573931620 tempest-ServerRescueNegativeTestJSON-1573931620-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 13:01:00.360655 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-e3fc9606-92e7-420b-a773-4637fcf13719 tempest-ServerRescueNegativeTestJSON-1573931620 tempest-ServerRescueNegativeTestJSON-1573931620-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 13:01:00.361364 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-e3fc9606-92e7-420b-a773-4637fcf13719 tempest-ServerRescueNegativeTestJSON-1573931620 tempest-ServerRescueNegativeTestJSON-1573931620-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 13:01:00.396671 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.policy [None req-cc96f593-dc6d-4e9f-8ef0-c74bc3e50469 tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79d74a2ea1e541d28d085c15cec34032', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68a8770b8dbe489a8119016fbee64eb5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116063) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 13:01:00.405404 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.policy [None req-cc96f593-dc6d-4e9f-8ef0-c74bc3e50469 tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '79d74a2ea1e541d28d085c15cec34032', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68a8770b8dbe489a8119016fbee64eb5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116063) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 13:01:00.406915 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.policy [None req-cc96f593-dc6d-4e9f-8ef0-c74bc3e50469 tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '79d74a2ea1e541d28d085c15cec34032', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68a8770b8dbe489a8119016fbee64eb5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116063) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 13:01:00.408113 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: INFO nova.api.openstack.requestlog [None req-cc96f593-dc6d-4e9f-8ef0-c74bc3e50469 tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] 10.222.0.49 "GET /compute/v2.1/servers/c8de7730-62f2-4a77-b1e9-cf6a74fa366d" status: 200 len: 1722 microversion: 2.20 time: 0.163462 Dec 14 13:01:00.408680 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: [pid: 116063|app: 0|req: 270/516] 10.222.0.49 () {60 vars in 1276 bytes} [Tue Dec 14 13:01:00 2021] GET /compute/v2.1/servers/c8de7730-62f2-4a77-b1e9-cf6a74fa366d => generated 1722 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 14 13:01:00.519128 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.policy [None req-e3fc9606-92e7-420b-a773-4637fcf13719 tempest-ServerRescueNegativeTestJSON-1573931620 tempest-ServerRescueNegativeTestJSON-1573931620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '731cbbfe17214ded8ac66299d66dfc45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '010919ea84eb4eb8b936c63153600eba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116064) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 13:01:00.527675 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: INFO nova.api.openstack.requestlog [None req-e3fc9606-92e7-420b-a773-4637fcf13719 tempest-ServerRescueNegativeTestJSON-1573931620 tempest-ServerRescueNegativeTestJSON-1573931620-project] 10.222.0.49 "GET /compute/v2.1/servers/eb6e04a4-8901-47df-9b51-7c1664bd3f6c" status: 200 len: 1569 microversion: 2.1 time: 0.180294 Dec 14 13:01:00.528248 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: [pid: 116064|app: 0|req: 247/517] 10.222.0.49 () {58 vars in 1235 bytes} [Tue Dec 14 13:01:00 2021] GET /compute/v2.1/servers/eb6e04a4-8901-47df-9b51-7c1664bd3f6c => generated 1569 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 14 13:01:00.671310 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.api.openstack.wsgi [None req-12ee3f51-b69b-41e9-86b4-5dda060a4d8b tempest-AttachVolumeNegativeTest-1000400951 tempest-AttachVolumeNegativeTest-1000400951-project] Calling method '>' {{(pid=116063) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 13:01:00.671935 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.compute.api [None req-12ee3f51-b69b-41e9-86b4-5dda060a4d8b tempest-AttachVolumeNegativeTest-1000400951 tempest-AttachVolumeNegativeTest-1000400951-project] [instance: 8d264701-aaa0-465f-a4aa-0cffa41351ef] Fetching instance by UUID {{(pid=116063) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 13:01:00.678613 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-12ee3f51-b69b-41e9-86b4-5dda060a4d8b tempest-AttachVolumeNegativeTest-1000400951 tempest-AttachVolumeNegativeTest-1000400951-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 13:01:00.679071 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-12ee3f51-b69b-41e9-86b4-5dda060a4d8b tempest-AttachVolumeNegativeTest-1000400951 tempest-AttachVolumeNegativeTest-1000400951-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 13:01:00.679884 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-12ee3f51-b69b-41e9-86b4-5dda060a4d8b tempest-AttachVolumeNegativeTest-1000400951 tempest-AttachVolumeNegativeTest-1000400951-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 13:01:00.680318 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-12ee3f51-b69b-41e9-86b4-5dda060a4d8b tempest-AttachVolumeNegativeTest-1000400951 tempest-AttachVolumeNegativeTest-1000400951-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 13:01:00.821333 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.policy [None req-12ee3f51-b69b-41e9-86b4-5dda060a4d8b tempest-AttachVolumeNegativeTest-1000400951 tempest-AttachVolumeNegativeTest-1000400951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57d0ec01f0784c8ea87d339980bed3cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad27b8951cae4eeeafa257f45217653a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116063) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 13:01:00.830414 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: INFO nova.api.openstack.requestlog [None req-12ee3f51-b69b-41e9-86b4-5dda060a4d8b tempest-AttachVolumeNegativeTest-1000400951 tempest-AttachVolumeNegativeTest-1000400951-project] 10.222.0.49 "GET /compute/v2.1/servers/8d264701-aaa0-465f-a4aa-0cffa41351ef" status: 200 len: 1513 microversion: 2.1 time: 0.163538 Dec 14 13:01:00.830942 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: [pid: 116063|app: 0|req: 271/518] 10.222.0.49 () {58 vars in 1235 bytes} [Tue Dec 14 13:01:00 2021] GET /compute/v2.1/servers/8d264701-aaa0-465f-a4aa-0cffa41351ef => generated 1513 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 14 13:01:01.426855 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.api.openstack.wsgi [None req-1faa498b-1e64-4d21-8e73-bd12b88c20e9 tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] Calling method '>' {{(pid=116064) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 13:01:01.427458 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.compute.api [None req-1faa498b-1e64-4d21-8e73-bd12b88c20e9 tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] [instance: c8de7730-62f2-4a77-b1e9-cf6a74fa366d] Fetching instance by UUID {{(pid=116064) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 13:01:01.433799 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-1faa498b-1e64-4d21-8e73-bd12b88c20e9 tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 13:01:01.434241 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-1faa498b-1e64-4d21-8e73-bd12b88c20e9 tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 13:01:01.435020 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-1faa498b-1e64-4d21-8e73-bd12b88c20e9 tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 13:01:01.435459 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-1faa498b-1e64-4d21-8e73-bd12b88c20e9 tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 13:01:01.545589 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.api.openstack.wsgi [None req-5e6414dd-ca63-4566-9020-ffd0a5f96de2 tempest-ServerRescueNegativeTestJSON-1573931620 tempest-ServerRescueNegativeTestJSON-1573931620-project] Calling method '>' {{(pid=116063) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 13:01:01.546771 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.compute.api [None req-5e6414dd-ca63-4566-9020-ffd0a5f96de2 tempest-ServerRescueNegativeTestJSON-1573931620 tempest-ServerRescueNegativeTestJSON-1573931620-project] [instance: eb6e04a4-8901-47df-9b51-7c1664bd3f6c] Fetching instance by UUID {{(pid=116063) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 13:01:01.553496 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-5e6414dd-ca63-4566-9020-ffd0a5f96de2 tempest-ServerRescueNegativeTestJSON-1573931620 tempest-ServerRescueNegativeTestJSON-1573931620-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 13:01:01.553946 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-5e6414dd-ca63-4566-9020-ffd0a5f96de2 tempest-ServerRescueNegativeTestJSON-1573931620 tempest-ServerRescueNegativeTestJSON-1573931620-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 13:01:01.554729 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-5e6414dd-ca63-4566-9020-ffd0a5f96de2 tempest-ServerRescueNegativeTestJSON-1573931620 tempest-ServerRescueNegativeTestJSON-1573931620-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 13:01:01.555194 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-5e6414dd-ca63-4566-9020-ffd0a5f96de2 tempest-ServerRescueNegativeTestJSON-1573931620 tempest-ServerRescueNegativeTestJSON-1573931620-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 13:01:01.573807 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.policy [None req-1faa498b-1e64-4d21-8e73-bd12b88c20e9 tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79d74a2ea1e541d28d085c15cec34032', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68a8770b8dbe489a8119016fbee64eb5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116064) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 13:01:01.582016 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.policy [None req-1faa498b-1e64-4d21-8e73-bd12b88c20e9 tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '79d74a2ea1e541d28d085c15cec34032', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68a8770b8dbe489a8119016fbee64eb5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116064) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 13:01:01.583510 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.policy [None req-1faa498b-1e64-4d21-8e73-bd12b88c20e9 tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '79d74a2ea1e541d28d085c15cec34032', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68a8770b8dbe489a8119016fbee64eb5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116064) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 13:01:01.584657 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: INFO nova.api.openstack.requestlog [None req-1faa498b-1e64-4d21-8e73-bd12b88c20e9 tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] 10.222.0.49 "GET /compute/v2.1/servers/c8de7730-62f2-4a77-b1e9-cf6a74fa366d" status: 200 len: 1722 microversion: 2.20 time: 0.161495 Dec 14 13:01:01.585502 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: [pid: 116064|app: 0|req: 248/519] 10.222.0.49 () {60 vars in 1276 bytes} [Tue Dec 14 13:01:01 2021] GET /compute/v2.1/servers/c8de7730-62f2-4a77-b1e9-cf6a74fa366d => generated 1722 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 14 13:01:01.696342 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.policy [None req-5e6414dd-ca63-4566-9020-ffd0a5f96de2 tempest-ServerRescueNegativeTestJSON-1573931620 tempest-ServerRescueNegativeTestJSON-1573931620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '731cbbfe17214ded8ac66299d66dfc45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '010919ea84eb4eb8b936c63153600eba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116063) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 13:01:01.705495 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: INFO nova.api.openstack.requestlog [None req-5e6414dd-ca63-4566-9020-ffd0a5f96de2 tempest-ServerRescueNegativeTestJSON-1573931620 tempest-ServerRescueNegativeTestJSON-1573931620-project] 10.222.0.49 "GET /compute/v2.1/servers/eb6e04a4-8901-47df-9b51-7c1664bd3f6c" status: 200 len: 1569 microversion: 2.1 time: 0.164222 Dec 14 13:01:01.706305 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: [pid: 116063|app: 0|req: 272/520] 10.222.0.49 () {58 vars in 1235 bytes} [Tue Dec 14 13:01:01 2021] GET /compute/v2.1/servers/eb6e04a4-8901-47df-9b51-7c1664bd3f6c => generated 1569 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 14 13:01:01.795110 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.api.openstack.wsgi [req-91f756ad-5055-45f6-a99b-3160af0d833b req-b9eccdf1-59b5-45e6-a0e9-6d4c602a6e0c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c8de7730-62f2-4a77-b1e9-cf6a74fa366d", "name": "network-vif-unplugged", "status": "completed", "tag": "45d34d58-1ff8-4ce3-a024-e2acb9451196"}]} {{(pid=116064) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 14 13:01:01.797478 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 14 13:01:01.797478 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: warnings.warn(msg) Dec 14 13:01:01.806572 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [req-91f756ad-5055-45f6-a99b-3160af0d833b req-b9eccdf1-59b5-45e6-a0e9-6d4c602a6e0c service nova] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 13:01:01.807069 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [req-91f756ad-5055-45f6-a99b-3160af0d833b req-b9eccdf1-59b5-45e6-a0e9-6d4c602a6e0c service nova] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 13:01:01.819899 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: INFO nova.api.openstack.compute.server_external_events [req-91f756ad-5055-45f6-a99b-3160af0d833b req-b9eccdf1-59b5-45e6-a0e9-6d4c602a6e0c service nova] Creating event network-vif-unplugged:45d34d58-1ff8-4ce3-a024-e2acb9451196 for instance c8de7730-62f2-4a77-b1e9-cf6a74fa366d on hv-cinder-78447 Dec 14 13:01:01.825839 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: INFO nova.api.openstack.requestlog [req-91f756ad-5055-45f6-a99b-3160af0d833b req-b9eccdf1-59b5-45e6-a0e9-6d4c602a6e0c service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.034885 Dec 14 13:01:01.826648 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: [pid: 116064|app: 0|req: 249/521] 10.222.0.49 () {64 vars in 1317 bytes} [Tue Dec 14 13:01:01 2021] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 14 13:01:01.849194 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.api.openstack.wsgi [None req-588e972a-4531-47f3-bcac-d6fe2e6bd909 tempest-AttachVolumeNegativeTest-1000400951 tempest-AttachVolumeNegativeTest-1000400951-project] Calling method '>' {{(pid=116063) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 13:01:01.849909 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.compute.api [None req-588e972a-4531-47f3-bcac-d6fe2e6bd909 tempest-AttachVolumeNegativeTest-1000400951 tempest-AttachVolumeNegativeTest-1000400951-project] [instance: 8d264701-aaa0-465f-a4aa-0cffa41351ef] Fetching instance by UUID {{(pid=116063) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 13:01:01.855979 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-588e972a-4531-47f3-bcac-d6fe2e6bd909 tempest-AttachVolumeNegativeTest-1000400951 tempest-AttachVolumeNegativeTest-1000400951-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 13:01:01.856506 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-588e972a-4531-47f3-bcac-d6fe2e6bd909 tempest-AttachVolumeNegativeTest-1000400951 tempest-AttachVolumeNegativeTest-1000400951-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 13:01:01.857634 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-588e972a-4531-47f3-bcac-d6fe2e6bd909 tempest-AttachVolumeNegativeTest-1000400951 tempest-AttachVolumeNegativeTest-1000400951-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 13:01:01.858124 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-588e972a-4531-47f3-bcac-d6fe2e6bd909 tempest-AttachVolumeNegativeTest-1000400951 tempest-AttachVolumeNegativeTest-1000400951-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 13:01:01.996390 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.policy [None req-588e972a-4531-47f3-bcac-d6fe2e6bd909 tempest-AttachVolumeNegativeTest-1000400951 tempest-AttachVolumeNegativeTest-1000400951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57d0ec01f0784c8ea87d339980bed3cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad27b8951cae4eeeafa257f45217653a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116063) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 13:01:02.004135 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: INFO nova.api.openstack.requestlog [None req-588e972a-4531-47f3-bcac-d6fe2e6bd909 tempest-AttachVolumeNegativeTest-1000400951 tempest-AttachVolumeNegativeTest-1000400951-project] 10.222.0.49 "GET /compute/v2.1/servers/8d264701-aaa0-465f-a4aa-0cffa41351ef" status: 200 len: 1513 microversion: 2.1 time: 0.159548 Dec 14 13:01:02.004418 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: [pid: 116063|app: 0|req: 273/522] 10.222.0.49 () {58 vars in 1235 bytes} [Tue Dec 14 13:01:01 2021] GET /compute/v2.1/servers/8d264701-aaa0-465f-a4aa-0cffa41351ef => generated 1513 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 14 13:01:02.608411 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.api.openstack.wsgi [None req-f0bb56e7-775a-4a82-a0ef-d43af94348bd tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] Calling method '>' {{(pid=116064) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 13:01:02.609813 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.compute.api [None req-f0bb56e7-775a-4a82-a0ef-d43af94348bd tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] [instance: c8de7730-62f2-4a77-b1e9-cf6a74fa366d] Fetching instance by UUID {{(pid=116064) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 13:01:02.622333 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-f0bb56e7-775a-4a82-a0ef-d43af94348bd tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 13:01:02.623185 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-f0bb56e7-775a-4a82-a0ef-d43af94348bd tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 13:01:02.624535 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-f0bb56e7-775a-4a82-a0ef-d43af94348bd tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 13:01:02.624981 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-f0bb56e7-775a-4a82-a0ef-d43af94348bd tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 13:01:02.722967 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.api.openstack.wsgi [None req-470177b7-8c18-47d7-b355-cfd98fc4b42b tempest-ServerRescueNegativeTestJSON-1573931620 tempest-ServerRescueNegativeTestJSON-1573931620-project] Calling method '>' {{(pid=116063) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 13:01:02.723584 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.compute.api [None req-470177b7-8c18-47d7-b355-cfd98fc4b42b tempest-ServerRescueNegativeTestJSON-1573931620 tempest-ServerRescueNegativeTestJSON-1573931620-project] [instance: eb6e04a4-8901-47df-9b51-7c1664bd3f6c] Fetching instance by UUID {{(pid=116063) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 13:01:02.730375 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-470177b7-8c18-47d7-b355-cfd98fc4b42b tempest-ServerRescueNegativeTestJSON-1573931620 tempest-ServerRescueNegativeTestJSON-1573931620-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 13:01:02.730820 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-470177b7-8c18-47d7-b355-cfd98fc4b42b tempest-ServerRescueNegativeTestJSON-1573931620 tempest-ServerRescueNegativeTestJSON-1573931620-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 13:01:02.731601 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-470177b7-8c18-47d7-b355-cfd98fc4b42b tempest-ServerRescueNegativeTestJSON-1573931620 tempest-ServerRescueNegativeTestJSON-1573931620-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 13:01:02.732027 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-470177b7-8c18-47d7-b355-cfd98fc4b42b tempest-ServerRescueNegativeTestJSON-1573931620 tempest-ServerRescueNegativeTestJSON-1573931620-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 13:01:02.766804 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.policy [None req-f0bb56e7-775a-4a82-a0ef-d43af94348bd tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79d74a2ea1e541d28d085c15cec34032', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68a8770b8dbe489a8119016fbee64eb5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116064) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 13:01:02.775450 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.policy [None req-f0bb56e7-775a-4a82-a0ef-d43af94348bd tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '79d74a2ea1e541d28d085c15cec34032', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68a8770b8dbe489a8119016fbee64eb5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116064) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 13:01:02.777129 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.policy [None req-f0bb56e7-775a-4a82-a0ef-d43af94348bd tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '79d74a2ea1e541d28d085c15cec34032', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68a8770b8dbe489a8119016fbee64eb5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116064) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 13:01:02.778280 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: INFO nova.api.openstack.requestlog [None req-f0bb56e7-775a-4a82-a0ef-d43af94348bd tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] 10.222.0.49 "GET /compute/v2.1/servers/c8de7730-62f2-4a77-b1e9-cf6a74fa366d" status: 200 len: 1722 microversion: 2.20 time: 0.176738 Dec 14 13:01:02.780085 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: [pid: 116064|app: 0|req: 250/523] 10.222.0.49 () {60 vars in 1276 bytes} [Tue Dec 14 13:01:02 2021] GET /compute/v2.1/servers/c8de7730-62f2-4a77-b1e9-cf6a74fa366d => generated 1722 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 14 13:01:02.881045 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.policy [None req-470177b7-8c18-47d7-b355-cfd98fc4b42b tempest-ServerRescueNegativeTestJSON-1573931620 tempest-ServerRescueNegativeTestJSON-1573931620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '731cbbfe17214ded8ac66299d66dfc45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '010919ea84eb4eb8b936c63153600eba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116063) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 13:01:02.889704 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: INFO nova.api.openstack.requestlog [None req-470177b7-8c18-47d7-b355-cfd98fc4b42b tempest-ServerRescueNegativeTestJSON-1573931620 tempest-ServerRescueNegativeTestJSON-1573931620-project] 10.222.0.49 "GET /compute/v2.1/servers/eb6e04a4-8901-47df-9b51-7c1664bd3f6c" status: 200 len: 1569 microversion: 2.1 time: 0.170430 Dec 14 13:01:02.900480 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: [pid: 116063|app: 0|req: 274/524] 10.222.0.49 () {58 vars in 1235 bytes} [Tue Dec 14 13:01:02 2021] GET /compute/v2.1/servers/eb6e04a4-8901-47df-9b51-7c1664bd3f6c => generated 1569 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 14 13:01:03.021123 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.api.openstack.wsgi [None req-3db3027b-7438-4e36-ba83-920d2c20b977 tempest-AttachVolumeNegativeTest-1000400951 tempest-AttachVolumeNegativeTest-1000400951-project] Calling method '>' {{(pid=116064) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 13:01:03.022039 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.compute.api [None req-3db3027b-7438-4e36-ba83-920d2c20b977 tempest-AttachVolumeNegativeTest-1000400951 tempest-AttachVolumeNegativeTest-1000400951-project] [instance: 8d264701-aaa0-465f-a4aa-0cffa41351ef] Fetching instance by UUID {{(pid=116064) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 13:01:03.028429 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-3db3027b-7438-4e36-ba83-920d2c20b977 tempest-AttachVolumeNegativeTest-1000400951 tempest-AttachVolumeNegativeTest-1000400951-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 13:01:03.028941 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-3db3027b-7438-4e36-ba83-920d2c20b977 tempest-AttachVolumeNegativeTest-1000400951 tempest-AttachVolumeNegativeTest-1000400951-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 13:01:03.029827 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-3db3027b-7438-4e36-ba83-920d2c20b977 tempest-AttachVolumeNegativeTest-1000400951 tempest-AttachVolumeNegativeTest-1000400951-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 13:01:03.030253 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-3db3027b-7438-4e36-ba83-920d2c20b977 tempest-AttachVolumeNegativeTest-1000400951 tempest-AttachVolumeNegativeTest-1000400951-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 13:01:03.180393 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.policy [None req-3db3027b-7438-4e36-ba83-920d2c20b977 tempest-AttachVolumeNegativeTest-1000400951 tempest-AttachVolumeNegativeTest-1000400951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57d0ec01f0784c8ea87d339980bed3cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad27b8951cae4eeeafa257f45217653a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116064) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 13:01:03.188527 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: INFO nova.api.openstack.requestlog [None req-3db3027b-7438-4e36-ba83-920d2c20b977 tempest-AttachVolumeNegativeTest-1000400951 tempest-AttachVolumeNegativeTest-1000400951-project] 10.222.0.49 "GET /compute/v2.1/servers/8d264701-aaa0-465f-a4aa-0cffa41351ef" status: 200 len: 1513 microversion: 2.1 time: 0.171414 Dec 14 13:01:03.189426 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: [pid: 116064|app: 0|req: 251/525] 10.222.0.49 () {58 vars in 1235 bytes} [Tue Dec 14 13:01:03 2021] GET /compute/v2.1/servers/8d264701-aaa0-465f-a4aa-0cffa41351ef => generated 1513 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 14 13:01:03.271198 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.api.openstack.wsgi [req-24703907-b414-4778-8ad5-6a4193fe8056 req-53fa0640-62b0-4c44-b438-d9fab5dd809f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8d264701-aaa0-465f-a4aa-0cffa41351ef", "name": "network-vif-deleted", "tag": "3c4c685c-25bf-4592-b1c9-40dc336ec707"}]} {{(pid=116063) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 14 13:01:03.273272 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 14 13:01:03.273272 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: warnings.warn(msg) Dec 14 13:01:03.284626 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [req-24703907-b414-4778-8ad5-6a4193fe8056 req-53fa0640-62b0-4c44-b438-d9fab5dd809f service nova] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 13:01:03.285625 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [req-24703907-b414-4778-8ad5-6a4193fe8056 req-53fa0640-62b0-4c44-b438-d9fab5dd809f service nova] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 13:01:03.301883 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: INFO nova.api.openstack.compute.server_external_events [req-24703907-b414-4778-8ad5-6a4193fe8056 req-53fa0640-62b0-4c44-b438-d9fab5dd809f service nova] Creating event network-vif-deleted:3c4c685c-25bf-4592-b1c9-40dc336ec707 for instance 8d264701-aaa0-465f-a4aa-0cffa41351ef on hv-cinder-78447 Dec 14 13:01:03.307494 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: INFO nova.api.openstack.requestlog [req-24703907-b414-4778-8ad5-6a4193fe8056 req-53fa0640-62b0-4c44-b438-d9fab5dd809f service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041914 Dec 14 13:01:03.308101 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: [pid: 116063|app: 0|req: 275/526] 10.222.0.49 () {64 vars in 1317 bytes} [Tue Dec 14 13:01:03 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 14 13:01:03.796540 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.api.openstack.wsgi [None req-7619877c-e955-4eac-9c1f-e04816a2a91e tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] Calling method '>' {{(pid=116064) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 13:01:03.797919 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.compute.api [None req-7619877c-e955-4eac-9c1f-e04816a2a91e tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] [instance: c8de7730-62f2-4a77-b1e9-cf6a74fa366d] Fetching instance by UUID {{(pid=116064) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 13:01:03.805115 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-7619877c-e955-4eac-9c1f-e04816a2a91e tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 13:01:03.805599 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-7619877c-e955-4eac-9c1f-e04816a2a91e tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 13:01:03.806414 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-7619877c-e955-4eac-9c1f-e04816a2a91e tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 13:01:03.806859 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-7619877c-e955-4eac-9c1f-e04816a2a91e tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 13:01:03.907509 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.api.openstack.wsgi [None req-b4eb1cd7-dffd-450a-95d3-28dad8f7bab0 tempest-ServerRescueNegativeTestJSON-1573931620 tempest-ServerRescueNegativeTestJSON-1573931620-project] Calling method '>' {{(pid=116063) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 13:01:03.908200 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.compute.api [None req-b4eb1cd7-dffd-450a-95d3-28dad8f7bab0 tempest-ServerRescueNegativeTestJSON-1573931620 tempest-ServerRescueNegativeTestJSON-1573931620-project] [instance: eb6e04a4-8901-47df-9b51-7c1664bd3f6c] Fetching instance by UUID {{(pid=116063) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 13:01:03.915852 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-b4eb1cd7-dffd-450a-95d3-28dad8f7bab0 tempest-ServerRescueNegativeTestJSON-1573931620 tempest-ServerRescueNegativeTestJSON-1573931620-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 13:01:03.916331 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-b4eb1cd7-dffd-450a-95d3-28dad8f7bab0 tempest-ServerRescueNegativeTestJSON-1573931620 tempest-ServerRescueNegativeTestJSON-1573931620-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 13:01:03.917259 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-b4eb1cd7-dffd-450a-95d3-28dad8f7bab0 tempest-ServerRescueNegativeTestJSON-1573931620 tempest-ServerRescueNegativeTestJSON-1573931620-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 13:01:03.918041 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-b4eb1cd7-dffd-450a-95d3-28dad8f7bab0 tempest-ServerRescueNegativeTestJSON-1573931620 tempest-ServerRescueNegativeTestJSON-1573931620-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 13:01:03.947119 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.policy [None req-7619877c-e955-4eac-9c1f-e04816a2a91e tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79d74a2ea1e541d28d085c15cec34032', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68a8770b8dbe489a8119016fbee64eb5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116064) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 13:01:03.955997 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.policy [None req-7619877c-e955-4eac-9c1f-e04816a2a91e tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '79d74a2ea1e541d28d085c15cec34032', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68a8770b8dbe489a8119016fbee64eb5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116064) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 13:01:03.957549 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.policy [None req-7619877c-e955-4eac-9c1f-e04816a2a91e tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '79d74a2ea1e541d28d085c15cec34032', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68a8770b8dbe489a8119016fbee64eb5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116064) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 13:01:03.958683 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: INFO nova.api.openstack.requestlog [None req-7619877c-e955-4eac-9c1f-e04816a2a91e tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] 10.222.0.49 "GET /compute/v2.1/servers/c8de7730-62f2-4a77-b1e9-cf6a74fa366d" status: 200 len: 1725 microversion: 2.20 time: 0.166374 Dec 14 13:01:03.959245 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: [pid: 116064|app: 0|req: 252/527] 10.222.0.49 () {60 vars in 1276 bytes} [Tue Dec 14 13:01:03 2021] GET /compute/v2.1/servers/c8de7730-62f2-4a77-b1e9-cf6a74fa366d => generated 1725 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 14 13:01:03.976454 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.api.openstack.wsgi [None req-b88ee91f-71d4-4c12-8542-84e03bf7c403 tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "1953b13d-3968-4f69-986c-5bb69c65f2c2"}} {{(pid=116064) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 14 13:01:03.977694 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.compute.api [None req-b88ee91f-71d4-4c12-8542-84e03bf7c403 tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] [instance: c8de7730-62f2-4a77-b1e9-cf6a74fa366d] Fetching instance by UUID {{(pid=116064) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 13:01:03.984136 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-b88ee91f-71d4-4c12-8542-84e03bf7c403 tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 13:01:03.984624 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-b88ee91f-71d4-4c12-8542-84e03bf7c403 tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 13:01:03.985864 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-b88ee91f-71d4-4c12-8542-84e03bf7c403 tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 13:01:03.986447 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-b88ee91f-71d4-4c12-8542-84e03bf7c403 tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 13:01:04.060627 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.policy [None req-b4eb1cd7-dffd-450a-95d3-28dad8f7bab0 tempest-ServerRescueNegativeTestJSON-1573931620 tempest-ServerRescueNegativeTestJSON-1573931620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '731cbbfe17214ded8ac66299d66dfc45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '010919ea84eb4eb8b936c63153600eba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116063) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 13:01:04.068842 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: INFO nova.api.openstack.requestlog [None req-b4eb1cd7-dffd-450a-95d3-28dad8f7bab0 tempest-ServerRescueNegativeTestJSON-1573931620 tempest-ServerRescueNegativeTestJSON-1573931620-project] 10.222.0.49 "GET /compute/v2.1/servers/eb6e04a4-8901-47df-9b51-7c1664bd3f6c" status: 200 len: 1569 microversion: 2.1 time: 0.165736 Dec 14 13:01:04.069423 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: [pid: 116063|app: 0|req: 276/528] 10.222.0.49 () {58 vars in 1235 bytes} [Tue Dec 14 13:01:03 2021] GET /compute/v2.1/servers/eb6e04a4-8901-47df-9b51-7c1664bd3f6c => generated 1569 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 14 13:01:04.207035 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.api.openstack.wsgi [None req-0ae263a7-8d2e-4771-9e1c-29e5860a37b3 tempest-AttachVolumeNegativeTest-1000400951 tempest-AttachVolumeNegativeTest-1000400951-project] Calling method '>' {{(pid=116063) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 13:01:04.207911 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.compute.api [None req-0ae263a7-8d2e-4771-9e1c-29e5860a37b3 tempest-AttachVolumeNegativeTest-1000400951 tempest-AttachVolumeNegativeTest-1000400951-project] [instance: 8d264701-aaa0-465f-a4aa-0cffa41351ef] Fetching instance by UUID {{(pid=116063) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 13:01:04.214139 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-0ae263a7-8d2e-4771-9e1c-29e5860a37b3 tempest-AttachVolumeNegativeTest-1000400951 tempest-AttachVolumeNegativeTest-1000400951-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 13:01:04.214581 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-0ae263a7-8d2e-4771-9e1c-29e5860a37b3 tempest-AttachVolumeNegativeTest-1000400951 tempest-AttachVolumeNegativeTest-1000400951-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 13:01:04.215582 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-0ae263a7-8d2e-4771-9e1c-29e5860a37b3 tempest-AttachVolumeNegativeTest-1000400951 tempest-AttachVolumeNegativeTest-1000400951-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 13:01:04.216244 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-0ae263a7-8d2e-4771-9e1c-29e5860a37b3 tempest-AttachVolumeNegativeTest-1000400951 tempest-AttachVolumeNegativeTest-1000400951-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 13:01:04.238338 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: INFO nova.api.openstack.wsgi [None req-0ae263a7-8d2e-4771-9e1c-29e5860a37b3 tempest-AttachVolumeNegativeTest-1000400951 tempest-AttachVolumeNegativeTest-1000400951-project] HTTP exception thrown: Instance 8d264701-aaa0-465f-a4aa-0cffa41351ef could not be found. Dec 14 13:01:04.239324 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.api.openstack.wsgi [None req-0ae263a7-8d2e-4771-9e1c-29e5860a37b3 tempest-AttachVolumeNegativeTest-1000400951 tempest-AttachVolumeNegativeTest-1000400951-project] Returning 404 to user: Instance 8d264701-aaa0-465f-a4aa-0cffa41351ef could not be found. {{(pid=116063) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 14 13:01:04.253078 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: INFO nova.api.openstack.requestlog [None req-0ae263a7-8d2e-4771-9e1c-29e5860a37b3 tempest-AttachVolumeNegativeTest-1000400951 tempest-AttachVolumeNegativeTest-1000400951-project] 10.222.0.49 "GET /compute/v2.1/servers/8d264701-aaa0-465f-a4aa-0cffa41351ef" status: 404 len: 111 microversion: 2.1 time: 0.038744 Dec 14 13:01:04.255267 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: [pid: 116063|app: 0|req: 277/529] 10.222.0.49 () {58 vars in 1235 bytes} [Tue Dec 14 13:01:04 2021] GET /compute/v2.1/servers/8d264701-aaa0-465f-a4aa-0cffa41351ef => generated 111 bytes in 54 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Dec 14 13:01:04.264833 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.api.openstack.wsgi [None req-79edab08-c62c-4969-9fd3-7af401580ee6 tempest-AttachVolumeNegativeTest-1000400951 tempest-AttachVolumeNegativeTest-1000400951-project] Calling method '>' {{(pid=116063) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 13:01:04.265761 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.compute.api [None req-79edab08-c62c-4969-9fd3-7af401580ee6 tempest-AttachVolumeNegativeTest-1000400951 tempest-AttachVolumeNegativeTest-1000400951-project] [instance: 6601be22-57ed-4f24-a26d-d909c51113c8] Fetching instance by UUID {{(pid=116063) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 13:01:04.275547 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-79edab08-c62c-4969-9fd3-7af401580ee6 tempest-AttachVolumeNegativeTest-1000400951 tempest-AttachVolumeNegativeTest-1000400951-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 13:01:04.276010 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-79edab08-c62c-4969-9fd3-7af401580ee6 tempest-AttachVolumeNegativeTest-1000400951 tempest-AttachVolumeNegativeTest-1000400951-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 13:01:04.277737 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-79edab08-c62c-4969-9fd3-7af401580ee6 tempest-AttachVolumeNegativeTest-1000400951 tempest-AttachVolumeNegativeTest-1000400951-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 13:01:04.278170 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-79edab08-c62c-4969-9fd3-7af401580ee6 tempest-AttachVolumeNegativeTest-1000400951 tempest-AttachVolumeNegativeTest-1000400951-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 13:01:04.311750 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.compute.api [None req-79edab08-c62c-4969-9fd3-7af401580ee6 tempest-AttachVolumeNegativeTest-1000400951 tempest-AttachVolumeNegativeTest-1000400951-project] [instance: 6601be22-57ed-4f24-a26d-d909c51113c8] Going to try to terminate instance {{(pid=116063) delete /opt/stack/nova/nova/compute/api.py:2614}} Dec 14 13:01:04.341912 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: INFO nova.api.openstack.requestlog [None req-b88ee91f-71d4-4c12-8542-84e03bf7c403 tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] 10.222.0.49 "POST /compute/v2.1/servers/c8de7730-62f2-4a77-b1e9-cf6a74fa366d/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.369341 Dec 14 13:01:04.342594 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: [pid: 116064|app: 0|req: 253/530] 10.222.0.49 () {62 vars in 1363 bytes} [Tue Dec 14 13:01:03 2021] POST /compute/v2.1/servers/c8de7730-62f2-4a77-b1e9-cf6a74fa366d/os-volume_attachments => generated 188 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 14 13:01:04.421362 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: INFO nova.api.openstack.requestlog [None req-79edab08-c62c-4969-9fd3-7af401580ee6 tempest-AttachVolumeNegativeTest-1000400951 tempest-AttachVolumeNegativeTest-1000400951-project] 10.222.0.49 "DELETE /compute/v2.1/servers/6601be22-57ed-4f24-a26d-d909c51113c8" status: 204 len: 0 microversion: 2.1 time: 0.160200 Dec 14 13:01:04.422322 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: [pid: 116063|app: 0|req: 278/531] 10.222.0.49 () {58 vars in 1238 bytes} [Tue Dec 14 13:01:04 2021] DELETE /compute/v2.1/servers/6601be22-57ed-4f24-a26d-d909c51113c8 => generated 0 bytes in 163 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Dec 14 13:01:04.432980 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.api.openstack.wsgi [None req-007c11a0-6172-45bc-8a53-e18245ef7931 tempest-AttachVolumeNegativeTest-1000400951 tempest-AttachVolumeNegativeTest-1000400951-project] Calling method '>' {{(pid=116064) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 13:01:04.434301 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.compute.api [None req-007c11a0-6172-45bc-8a53-e18245ef7931 tempest-AttachVolumeNegativeTest-1000400951 tempest-AttachVolumeNegativeTest-1000400951-project] [instance: 6601be22-57ed-4f24-a26d-d909c51113c8] Fetching instance by UUID {{(pid=116064) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 13:01:04.445996 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-007c11a0-6172-45bc-8a53-e18245ef7931 tempest-AttachVolumeNegativeTest-1000400951 tempest-AttachVolumeNegativeTest-1000400951-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 13:01:04.446643 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-007c11a0-6172-45bc-8a53-e18245ef7931 tempest-AttachVolumeNegativeTest-1000400951 tempest-AttachVolumeNegativeTest-1000400951-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 13:01:04.447626 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-007c11a0-6172-45bc-8a53-e18245ef7931 tempest-AttachVolumeNegativeTest-1000400951 tempest-AttachVolumeNegativeTest-1000400951-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 13:01:04.448063 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-007c11a0-6172-45bc-8a53-e18245ef7931 tempest-AttachVolumeNegativeTest-1000400951 tempest-AttachVolumeNegativeTest-1000400951-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 13:01:04.469349 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.api.openstack.wsgi [None req-445b2e3c-10a4-4502-ad9c-fc8fd5c481aa tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=116063) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 14 13:01:04.470197 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.compute.api [None req-445b2e3c-10a4-4502-ad9c-fc8fd5c481aa tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] [instance: c8de7730-62f2-4a77-b1e9-cf6a74fa366d] Fetching instance by UUID {{(pid=116063) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 13:01:04.477600 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-445b2e3c-10a4-4502-ad9c-fc8fd5c481aa tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 13:01:04.478593 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-445b2e3c-10a4-4502-ad9c-fc8fd5c481aa tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 13:01:04.480016 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-445b2e3c-10a4-4502-ad9c-fc8fd5c481aa tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 13:01:04.480712 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-445b2e3c-10a4-4502-ad9c-fc8fd5c481aa tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 13:01:04.617543 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.policy [None req-007c11a0-6172-45bc-8a53-e18245ef7931 tempest-AttachVolumeNegativeTest-1000400951 tempest-AttachVolumeNegativeTest-1000400951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57d0ec01f0784c8ea87d339980bed3cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad27b8951cae4eeeafa257f45217653a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116064) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 13:01:04.626883 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: INFO nova.api.openstack.requestlog [None req-007c11a0-6172-45bc-8a53-e18245ef7931 tempest-AttachVolumeNegativeTest-1000400951 tempest-AttachVolumeNegativeTest-1000400951-project] 10.222.0.49 "GET /compute/v2.1/servers/6601be22-57ed-4f24-a26d-d909c51113c8" status: 200 len: 1512 microversion: 2.1 time: 0.200174 Dec 14 13:01:04.627461 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: [pid: 116064|app: 0|req: 254/532] 10.222.0.49 () {58 vars in 1235 bytes} [Tue Dec 14 13:01:04 2021] GET /compute/v2.1/servers/6601be22-57ed-4f24-a26d-d909c51113c8 => generated 1512 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 14 13:01:04.642295 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: INFO nova.api.openstack.requestlog [None req-445b2e3c-10a4-4502-ad9c-fc8fd5c481aa tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] 10.222.0.49 "POST /compute/v2.1/servers/c8de7730-62f2-4a77-b1e9-cf6a74fa366d/action" status: 202 len: 0 microversion: 2.20 time: 0.177205 Dec 14 13:01:04.642937 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: [pid: 116063|app: 0|req: 279/533] 10.222.0.49 () {62 vars in 1318 bytes} [Tue Dec 14 13:01:04 2021] POST /compute/v2.1/servers/c8de7730-62f2-4a77-b1e9-cf6a74fa366d/action => generated 0 bytes in 179 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Dec 14 13:01:04.650965 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.api.openstack.wsgi [None req-f92b2902-8f49-4f78-8053-178140ec52c5 tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] Calling method '>' {{(pid=116064) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 13:01:04.651630 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.compute.api [None req-f92b2902-8f49-4f78-8053-178140ec52c5 tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] [instance: c8de7730-62f2-4a77-b1e9-cf6a74fa366d] Fetching instance by UUID {{(pid=116064) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 13:01:04.657881 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-f92b2902-8f49-4f78-8053-178140ec52c5 tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 13:01:04.658590 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-f92b2902-8f49-4f78-8053-178140ec52c5 tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 13:01:04.659438 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-f92b2902-8f49-4f78-8053-178140ec52c5 tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 13:01:04.659932 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-f92b2902-8f49-4f78-8053-178140ec52c5 tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 13:01:04.791479 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.policy [None req-f92b2902-8f49-4f78-8053-178140ec52c5 tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79d74a2ea1e541d28d085c15cec34032', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68a8770b8dbe489a8119016fbee64eb5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116064) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 13:01:04.800417 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.policy [None req-f92b2902-8f49-4f78-8053-178140ec52c5 tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '79d74a2ea1e541d28d085c15cec34032', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68a8770b8dbe489a8119016fbee64eb5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116064) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 13:01:04.802019 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.policy [None req-f92b2902-8f49-4f78-8053-178140ec52c5 tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '79d74a2ea1e541d28d085c15cec34032', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68a8770b8dbe489a8119016fbee64eb5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116064) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 13:01:04.803271 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: INFO nova.api.openstack.requestlog [None req-f92b2902-8f49-4f78-8053-178140ec52c5 tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] 10.222.0.49 "GET /compute/v2.1/servers/c8de7730-62f2-4a77-b1e9-cf6a74fa366d" status: 200 len: 1751 microversion: 2.20 time: 0.156219 Dec 14 13:01:04.804152 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: [pid: 116064|app: 0|req: 255/534] 10.222.0.49 () {60 vars in 1276 bytes} [Tue Dec 14 13:01:04 2021] GET /compute/v2.1/servers/c8de7730-62f2-4a77-b1e9-cf6a74fa366d => generated 1751 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 14 13:01:05.086876 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.api.openstack.wsgi [None req-c05c05ec-33cf-462f-98d7-7947cb06a2bb tempest-ServerRescueNegativeTestJSON-1573931620 tempest-ServerRescueNegativeTestJSON-1573931620-project] Calling method '>' {{(pid=116063) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 13:01:05.087443 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.compute.api [None req-c05c05ec-33cf-462f-98d7-7947cb06a2bb tempest-ServerRescueNegativeTestJSON-1573931620 tempest-ServerRescueNegativeTestJSON-1573931620-project] [instance: eb6e04a4-8901-47df-9b51-7c1664bd3f6c] Fetching instance by UUID {{(pid=116063) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 13:01:05.093843 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-c05c05ec-33cf-462f-98d7-7947cb06a2bb tempest-ServerRescueNegativeTestJSON-1573931620 tempest-ServerRescueNegativeTestJSON-1573931620-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 13:01:05.094301 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-c05c05ec-33cf-462f-98d7-7947cb06a2bb tempest-ServerRescueNegativeTestJSON-1573931620 tempest-ServerRescueNegativeTestJSON-1573931620-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 13:01:05.095073 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-c05c05ec-33cf-462f-98d7-7947cb06a2bb tempest-ServerRescueNegativeTestJSON-1573931620 tempest-ServerRescueNegativeTestJSON-1573931620-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 13:01:05.095502 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-c05c05ec-33cf-462f-98d7-7947cb06a2bb tempest-ServerRescueNegativeTestJSON-1573931620 tempest-ServerRescueNegativeTestJSON-1573931620-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 13:01:05.283242 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.policy [None req-c05c05ec-33cf-462f-98d7-7947cb06a2bb tempest-ServerRescueNegativeTestJSON-1573931620 tempest-ServerRescueNegativeTestJSON-1573931620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '731cbbfe17214ded8ac66299d66dfc45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '010919ea84eb4eb8b936c63153600eba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116063) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 13:01:05.291247 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: INFO nova.api.openstack.requestlog [None req-c05c05ec-33cf-462f-98d7-7947cb06a2bb tempest-ServerRescueNegativeTestJSON-1573931620 tempest-ServerRescueNegativeTestJSON-1573931620-project] 10.222.0.49 "GET /compute/v2.1/servers/eb6e04a4-8901-47df-9b51-7c1664bd3f6c" status: 200 len: 1569 microversion: 2.1 time: 0.208479 Dec 14 13:01:05.291829 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: [pid: 116063|app: 0|req: 280/535] 10.222.0.49 () {58 vars in 1235 bytes} [Tue Dec 14 13:01:05 2021] GET /compute/v2.1/servers/eb6e04a4-8901-47df-9b51-7c1664bd3f6c => generated 1569 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 14 13:01:05.643513 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.api.openstack.wsgi [None req-f6fe180f-7b1f-4b2e-96f2-415b0d514d9d tempest-AttachVolumeNegativeTest-1000400951 tempest-AttachVolumeNegativeTest-1000400951-project] Calling method '>' {{(pid=116064) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 13:01:05.644259 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.compute.api [None req-f6fe180f-7b1f-4b2e-96f2-415b0d514d9d tempest-AttachVolumeNegativeTest-1000400951 tempest-AttachVolumeNegativeTest-1000400951-project] [instance: 6601be22-57ed-4f24-a26d-d909c51113c8] Fetching instance by UUID {{(pid=116064) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 13:01:05.650550 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-f6fe180f-7b1f-4b2e-96f2-415b0d514d9d tempest-AttachVolumeNegativeTest-1000400951 tempest-AttachVolumeNegativeTest-1000400951-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 13:01:05.651308 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-f6fe180f-7b1f-4b2e-96f2-415b0d514d9d tempest-AttachVolumeNegativeTest-1000400951 tempest-AttachVolumeNegativeTest-1000400951-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 13:01:05.652130 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-f6fe180f-7b1f-4b2e-96f2-415b0d514d9d tempest-AttachVolumeNegativeTest-1000400951 tempest-AttachVolumeNegativeTest-1000400951-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 13:01:05.652567 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-f6fe180f-7b1f-4b2e-96f2-415b0d514d9d tempest-AttachVolumeNegativeTest-1000400951 tempest-AttachVolumeNegativeTest-1000400951-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 13:01:05.806131 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.policy [None req-f6fe180f-7b1f-4b2e-96f2-415b0d514d9d tempest-AttachVolumeNegativeTest-1000400951 tempest-AttachVolumeNegativeTest-1000400951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57d0ec01f0784c8ea87d339980bed3cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad27b8951cae4eeeafa257f45217653a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116064) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 13:01:05.817231 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: INFO nova.api.openstack.requestlog [None req-f6fe180f-7b1f-4b2e-96f2-415b0d514d9d tempest-AttachVolumeNegativeTest-1000400951 tempest-AttachVolumeNegativeTest-1000400951-project] 10.222.0.49 "GET /compute/v2.1/servers/6601be22-57ed-4f24-a26d-d909c51113c8" status: 200 len: 1512 microversion: 2.1 time: 0.177670 Dec 14 13:01:05.817784 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: [pid: 116064|app: 0|req: 256/536] 10.222.0.49 () {58 vars in 1235 bytes} [Tue Dec 14 13:01:05 2021] GET /compute/v2.1/servers/6601be22-57ed-4f24-a26d-d909c51113c8 => generated 1512 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 14 13:01:05.822579 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.api.openstack.wsgi [None req-9e5b72ac-1d29-44ef-a198-e7855aeb7279 tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] Calling method '>' {{(pid=116063) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 13:01:05.823178 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.compute.api [None req-9e5b72ac-1d29-44ef-a198-e7855aeb7279 tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] [instance: c8de7730-62f2-4a77-b1e9-cf6a74fa366d] Fetching instance by UUID {{(pid=116063) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 13:01:05.829521 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-9e5b72ac-1d29-44ef-a198-e7855aeb7279 tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 13:01:05.829961 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-9e5b72ac-1d29-44ef-a198-e7855aeb7279 tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 13:01:05.830747 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-9e5b72ac-1d29-44ef-a198-e7855aeb7279 tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 13:01:05.831162 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-9e5b72ac-1d29-44ef-a198-e7855aeb7279 tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 13:01:05.963709 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.policy [None req-9e5b72ac-1d29-44ef-a198-e7855aeb7279 tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79d74a2ea1e541d28d085c15cec34032', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68a8770b8dbe489a8119016fbee64eb5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116063) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 13:01:05.974387 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.policy [None req-9e5b72ac-1d29-44ef-a198-e7855aeb7279 tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '79d74a2ea1e541d28d085c15cec34032', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68a8770b8dbe489a8119016fbee64eb5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116063) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 13:01:05.975935 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.policy [None req-9e5b72ac-1d29-44ef-a198-e7855aeb7279 tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '79d74a2ea1e541d28d085c15cec34032', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68a8770b8dbe489a8119016fbee64eb5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116063) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 13:01:05.977155 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: INFO nova.api.openstack.requestlog [None req-9e5b72ac-1d29-44ef-a198-e7855aeb7279 tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] 10.222.0.49 "GET /compute/v2.1/servers/c8de7730-62f2-4a77-b1e9-cf6a74fa366d" status: 200 len: 1751 microversion: 2.20 time: 0.158252 Dec 14 13:01:05.977726 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: [pid: 116063|app: 0|req: 281/537] 10.222.0.49 () {60 vars in 1276 bytes} [Tue Dec 14 13:01:05 2021] GET /compute/v2.1/servers/c8de7730-62f2-4a77-b1e9-cf6a74fa366d => generated 1751 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 14 13:01:06.312357 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.api.openstack.wsgi [None req-1a3d59fd-2cb5-4f17-94b6-0744d0ec425b tempest-ServerRescueNegativeTestJSON-1573931620 tempest-ServerRescueNegativeTestJSON-1573931620-project] Calling method '>' {{(pid=116064) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 13:01:06.313064 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.compute.api [None req-1a3d59fd-2cb5-4f17-94b6-0744d0ec425b tempest-ServerRescueNegativeTestJSON-1573931620 tempest-ServerRescueNegativeTestJSON-1573931620-project] [instance: eb6e04a4-8901-47df-9b51-7c1664bd3f6c] Fetching instance by UUID {{(pid=116064) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 13:01:06.320164 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-1a3d59fd-2cb5-4f17-94b6-0744d0ec425b tempest-ServerRescueNegativeTestJSON-1573931620 tempest-ServerRescueNegativeTestJSON-1573931620-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 13:01:06.320661 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-1a3d59fd-2cb5-4f17-94b6-0744d0ec425b tempest-ServerRescueNegativeTestJSON-1573931620 tempest-ServerRescueNegativeTestJSON-1573931620-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 13:01:06.321580 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-1a3d59fd-2cb5-4f17-94b6-0744d0ec425b tempest-ServerRescueNegativeTestJSON-1573931620 tempest-ServerRescueNegativeTestJSON-1573931620-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 13:01:06.322059 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-1a3d59fd-2cb5-4f17-94b6-0744d0ec425b tempest-ServerRescueNegativeTestJSON-1573931620 tempest-ServerRescueNegativeTestJSON-1573931620-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 13:01:06.484339 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.policy [None req-1a3d59fd-2cb5-4f17-94b6-0744d0ec425b tempest-ServerRescueNegativeTestJSON-1573931620 tempest-ServerRescueNegativeTestJSON-1573931620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '731cbbfe17214ded8ac66299d66dfc45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '010919ea84eb4eb8b936c63153600eba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116064) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 13:01:06.492612 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: INFO nova.api.openstack.requestlog [None req-1a3d59fd-2cb5-4f17-94b6-0744d0ec425b tempest-ServerRescueNegativeTestJSON-1573931620 tempest-ServerRescueNegativeTestJSON-1573931620-project] 10.222.0.49 "GET /compute/v2.1/servers/eb6e04a4-8901-47df-9b51-7c1664bd3f6c" status: 200 len: 1569 microversion: 2.1 time: 0.186232 Dec 14 13:01:06.497642 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: [pid: 116064|app: 0|req: 257/538] 10.222.0.49 () {58 vars in 1235 bytes} [Tue Dec 14 13:01:06 2021] GET /compute/v2.1/servers/eb6e04a4-8901-47df-9b51-7c1664bd3f6c => generated 1569 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 14 13:01:06.837479 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.api.openstack.wsgi [None req-5fd49706-f457-4504-a721-b64db222af70 tempest-AttachVolumeNegativeTest-1000400951 tempest-AttachVolumeNegativeTest-1000400951-project] Calling method '>' {{(pid=116063) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 13:01:06.838527 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.compute.api [None req-5fd49706-f457-4504-a721-b64db222af70 tempest-AttachVolumeNegativeTest-1000400951 tempest-AttachVolumeNegativeTest-1000400951-project] [instance: 6601be22-57ed-4f24-a26d-d909c51113c8] Fetching instance by UUID {{(pid=116063) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 13:01:06.846943 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-5fd49706-f457-4504-a721-b64db222af70 tempest-AttachVolumeNegativeTest-1000400951 tempest-AttachVolumeNegativeTest-1000400951-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 13:01:06.847386 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-5fd49706-f457-4504-a721-b64db222af70 tempest-AttachVolumeNegativeTest-1000400951 tempest-AttachVolumeNegativeTest-1000400951-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 13:01:06.848154 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-5fd49706-f457-4504-a721-b64db222af70 tempest-AttachVolumeNegativeTest-1000400951 tempest-AttachVolumeNegativeTest-1000400951-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 13:01:06.848578 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-5fd49706-f457-4504-a721-b64db222af70 tempest-AttachVolumeNegativeTest-1000400951 tempest-AttachVolumeNegativeTest-1000400951-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 13:01:06.989238 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.policy [None req-5fd49706-f457-4504-a721-b64db222af70 tempest-AttachVolumeNegativeTest-1000400951 tempest-AttachVolumeNegativeTest-1000400951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57d0ec01f0784c8ea87d339980bed3cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad27b8951cae4eeeafa257f45217653a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116063) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 13:01:06.995609 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.api.openstack.wsgi [None req-8f454c08-cd27-4cd5-a744-06f752202e0a tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] Calling method '>' {{(pid=116064) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 13:01:06.996350 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.compute.api [None req-8f454c08-cd27-4cd5-a744-06f752202e0a tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] [instance: c8de7730-62f2-4a77-b1e9-cf6a74fa366d] Fetching instance by UUID {{(pid=116064) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 13:01:06.997040 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: INFO nova.api.openstack.requestlog [None req-5fd49706-f457-4504-a721-b64db222af70 tempest-AttachVolumeNegativeTest-1000400951 tempest-AttachVolumeNegativeTest-1000400951-project] 10.222.0.49 "GET /compute/v2.1/servers/6601be22-57ed-4f24-a26d-d909c51113c8" status: 200 len: 1512 microversion: 2.1 time: 0.165750 Dec 14 13:01:06.997612 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: [pid: 116063|app: 0|req: 282/539] 10.222.0.49 () {58 vars in 1235 bytes} [Tue Dec 14 13:01:06 2021] GET /compute/v2.1/servers/6601be22-57ed-4f24-a26d-d909c51113c8 => generated 1512 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 14 13:01:07.003160 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-8f454c08-cd27-4cd5-a744-06f752202e0a tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 13:01:07.003747 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-8f454c08-cd27-4cd5-a744-06f752202e0a tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 13:01:07.004623 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-8f454c08-cd27-4cd5-a744-06f752202e0a tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 13:01:07.005153 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-8f454c08-cd27-4cd5-a744-06f752202e0a tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 13:01:07.139812 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.policy [None req-8f454c08-cd27-4cd5-a744-06f752202e0a tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79d74a2ea1e541d28d085c15cec34032', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68a8770b8dbe489a8119016fbee64eb5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116064) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 13:01:07.153128 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.policy [None req-8f454c08-cd27-4cd5-a744-06f752202e0a tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '79d74a2ea1e541d28d085c15cec34032', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68a8770b8dbe489a8119016fbee64eb5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116064) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 13:01:07.155595 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.policy [None req-8f454c08-cd27-4cd5-a744-06f752202e0a tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '79d74a2ea1e541d28d085c15cec34032', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68a8770b8dbe489a8119016fbee64eb5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116064) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 13:01:07.156753 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: INFO nova.api.openstack.requestlog [None req-8f454c08-cd27-4cd5-a744-06f752202e0a tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] 10.222.0.49 "GET /compute/v2.1/servers/c8de7730-62f2-4a77-b1e9-cf6a74fa366d" status: 200 len: 1753 microversion: 2.20 time: 0.165120 Dec 14 13:01:07.157332 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: [pid: 116064|app: 0|req: 258/540] 10.222.0.49 () {60 vars in 1276 bytes} [Tue Dec 14 13:01:06 2021] GET /compute/v2.1/servers/c8de7730-62f2-4a77-b1e9-cf6a74fa366d => generated 1753 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Dec 14 13:01:07.513600 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.api.openstack.wsgi [None req-69e1a74e-50b3-414d-bfac-714d413ad126 tempest-ServerRescueNegativeTestJSON-1573931620 tempest-ServerRescueNegativeTestJSON-1573931620-project] Calling method '>' {{(pid=116063) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 13:01:07.514551 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.compute.api [None req-69e1a74e-50b3-414d-bfac-714d413ad126 tempest-ServerRescueNegativeTestJSON-1573931620 tempest-ServerRescueNegativeTestJSON-1573931620-project] [instance: eb6e04a4-8901-47df-9b51-7c1664bd3f6c] Fetching instance by UUID {{(pid=116063) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 13:01:07.521062 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-69e1a74e-50b3-414d-bfac-714d413ad126 tempest-ServerRescueNegativeTestJSON-1573931620 tempest-ServerRescueNegativeTestJSON-1573931620-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 13:01:07.521492 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-69e1a74e-50b3-414d-bfac-714d413ad126 tempest-ServerRescueNegativeTestJSON-1573931620 tempest-ServerRescueNegativeTestJSON-1573931620-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 13:01:07.522287 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-69e1a74e-50b3-414d-bfac-714d413ad126 tempest-ServerRescueNegativeTestJSON-1573931620 tempest-ServerRescueNegativeTestJSON-1573931620-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 13:01:07.522691 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-69e1a74e-50b3-414d-bfac-714d413ad126 tempest-ServerRescueNegativeTestJSON-1573931620 tempest-ServerRescueNegativeTestJSON-1573931620-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 13:01:07.664458 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.policy [None req-69e1a74e-50b3-414d-bfac-714d413ad126 tempest-ServerRescueNegativeTestJSON-1573931620 tempest-ServerRescueNegativeTestJSON-1573931620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '731cbbfe17214ded8ac66299d66dfc45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '010919ea84eb4eb8b936c63153600eba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116063) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 13:01:07.673375 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: INFO nova.api.openstack.requestlog [None req-69e1a74e-50b3-414d-bfac-714d413ad126 tempest-ServerRescueNegativeTestJSON-1573931620 tempest-ServerRescueNegativeTestJSON-1573931620-project] 10.222.0.49 "GET /compute/v2.1/servers/eb6e04a4-8901-47df-9b51-7c1664bd3f6c" status: 200 len: 1569 microversion: 2.1 time: 0.165968 Dec 14 13:01:07.673995 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: [pid: 116063|app: 0|req: 283/541] 10.222.0.49 () {58 vars in 1235 bytes} [Tue Dec 14 13:01:07 2021] GET /compute/v2.1/servers/eb6e04a4-8901-47df-9b51-7c1664bd3f6c => generated 1569 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 14 13:01:08.014469 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.api.openstack.wsgi [None req-5425b9e6-afe0-4571-904e-59f0e3cf904e tempest-AttachVolumeNegativeTest-1000400951 tempest-AttachVolumeNegativeTest-1000400951-project] Calling method '>' {{(pid=116064) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 13:01:08.015084 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.compute.api [None req-5425b9e6-afe0-4571-904e-59f0e3cf904e tempest-AttachVolumeNegativeTest-1000400951 tempest-AttachVolumeNegativeTest-1000400951-project] [instance: 6601be22-57ed-4f24-a26d-d909c51113c8] Fetching instance by UUID {{(pid=116064) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 13:01:08.021759 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-5425b9e6-afe0-4571-904e-59f0e3cf904e tempest-AttachVolumeNegativeTest-1000400951 tempest-AttachVolumeNegativeTest-1000400951-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 13:01:08.022209 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-5425b9e6-afe0-4571-904e-59f0e3cf904e tempest-AttachVolumeNegativeTest-1000400951 tempest-AttachVolumeNegativeTest-1000400951-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 13:01:08.022986 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-5425b9e6-afe0-4571-904e-59f0e3cf904e tempest-AttachVolumeNegativeTest-1000400951 tempest-AttachVolumeNegativeTest-1000400951-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 13:01:08.023418 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-5425b9e6-afe0-4571-904e-59f0e3cf904e tempest-AttachVolumeNegativeTest-1000400951 tempest-AttachVolumeNegativeTest-1000400951-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 13:01:08.159161 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.policy [None req-5425b9e6-afe0-4571-904e-59f0e3cf904e tempest-AttachVolumeNegativeTest-1000400951 tempest-AttachVolumeNegativeTest-1000400951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57d0ec01f0784c8ea87d339980bed3cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad27b8951cae4eeeafa257f45217653a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116064) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 13:01:08.166969 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: INFO nova.api.openstack.requestlog [None req-5425b9e6-afe0-4571-904e-59f0e3cf904e tempest-AttachVolumeNegativeTest-1000400951 tempest-AttachVolumeNegativeTest-1000400951-project] 10.222.0.49 "GET /compute/v2.1/servers/6601be22-57ed-4f24-a26d-d909c51113c8" status: 200 len: 1512 microversion: 2.1 time: 0.156301 Dec 14 13:01:08.167544 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: [pid: 116064|app: 0|req: 259/542] 10.222.0.49 () {58 vars in 1235 bytes} [Tue Dec 14 13:01:08 2021] GET /compute/v2.1/servers/6601be22-57ed-4f24-a26d-d909c51113c8 => generated 1512 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 14 13:01:08.175623 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.api.openstack.wsgi [None req-cbd7ee66-f570-46d6-adcd-4458e1516a12 tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] Calling method '>' {{(pid=116063) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 13:01:08.176310 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.compute.api [None req-cbd7ee66-f570-46d6-adcd-4458e1516a12 tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] [instance: c8de7730-62f2-4a77-b1e9-cf6a74fa366d] Fetching instance by UUID {{(pid=116063) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 13:01:08.183155 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-cbd7ee66-f570-46d6-adcd-4458e1516a12 tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 13:01:08.183603 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-cbd7ee66-f570-46d6-adcd-4458e1516a12 tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 13:01:08.184393 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-cbd7ee66-f570-46d6-adcd-4458e1516a12 tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 13:01:08.184828 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-cbd7ee66-f570-46d6-adcd-4458e1516a12 tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 13:01:08.320420 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.policy [None req-cbd7ee66-f570-46d6-adcd-4458e1516a12 tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79d74a2ea1e541d28d085c15cec34032', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68a8770b8dbe489a8119016fbee64eb5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116063) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 13:01:08.329192 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.policy [None req-cbd7ee66-f570-46d6-adcd-4458e1516a12 tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '79d74a2ea1e541d28d085c15cec34032', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68a8770b8dbe489a8119016fbee64eb5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116063) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 13:01:08.330696 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.policy [None req-cbd7ee66-f570-46d6-adcd-4458e1516a12 tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '79d74a2ea1e541d28d085c15cec34032', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68a8770b8dbe489a8119016fbee64eb5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116063) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 13:01:08.331847 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: INFO nova.api.openstack.requestlog [None req-cbd7ee66-f570-46d6-adcd-4458e1516a12 tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] 10.222.0.49 "GET /compute/v2.1/servers/c8de7730-62f2-4a77-b1e9-cf6a74fa366d" status: 200 len: 1753 microversion: 2.20 time: 0.159969 Dec 14 13:01:08.332409 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: [pid: 116063|app: 0|req: 284/543] 10.222.0.49 () {60 vars in 1276 bytes} [Tue Dec 14 13:01:08 2021] GET /compute/v2.1/servers/c8de7730-62f2-4a77-b1e9-cf6a74fa366d => generated 1753 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 14 13:01:08.551668 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.api.openstack.wsgi [None req-7ffcf3f9-9061-4d02-a7f0-676cbdfb9004 tempest-VolumesSnapshotTestJSON-1649574085 tempest-VolumesSnapshotTestJSON-1649574085-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-1777297222", "imageRef": "1733dcd4-5ded-44e1-8b8d-392adb05c67a", "flavorRef": "452", "networks": [{"uuid": "5a723a9f-3224-4b49-afa4-08d253222330"}]}} {{(pid=116064) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 14 13:01:08.607210 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.network.neutron [None req-7ffcf3f9-9061-4d02-a7f0-676cbdfb9004 tempest-VolumesSnapshotTestJSON-1649574085 tempest-VolumesSnapshotTestJSON-1649574085-project] validate_networks() for [('5a723a9f-3224-4b49-afa4-08d253222330', None, None, None, None, None)] {{(pid=116064) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Dec 14 13:01:08.690643 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.api.openstack.wsgi [None req-2653227f-1239-49c3-bc0a-d6a5f4ca19d5 tempest-ServerRescueNegativeTestJSON-1573931620 tempest-ServerRescueNegativeTestJSON-1573931620-project] Calling method '>' {{(pid=116063) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 13:01:08.691349 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.compute.api [None req-2653227f-1239-49c3-bc0a-d6a5f4ca19d5 tempest-ServerRescueNegativeTestJSON-1573931620 tempest-ServerRescueNegativeTestJSON-1573931620-project] [instance: eb6e04a4-8901-47df-9b51-7c1664bd3f6c] Fetching instance by UUID {{(pid=116063) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 13:01:08.697935 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-2653227f-1239-49c3-bc0a-d6a5f4ca19d5 tempest-ServerRescueNegativeTestJSON-1573931620 tempest-ServerRescueNegativeTestJSON-1573931620-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 13:01:08.698446 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-2653227f-1239-49c3-bc0a-d6a5f4ca19d5 tempest-ServerRescueNegativeTestJSON-1573931620 tempest-ServerRescueNegativeTestJSON-1573931620-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 13:01:08.699293 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-2653227f-1239-49c3-bc0a-d6a5f4ca19d5 tempest-ServerRescueNegativeTestJSON-1573931620 tempest-ServerRescueNegativeTestJSON-1573931620-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 13:01:08.699803 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-2653227f-1239-49c3-bc0a-d6a5f4ca19d5 tempest-ServerRescueNegativeTestJSON-1573931620 tempest-ServerRescueNegativeTestJSON-1573931620-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 13:01:08.928837 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.policy [None req-2653227f-1239-49c3-bc0a-d6a5f4ca19d5 tempest-ServerRescueNegativeTestJSON-1573931620 tempest-ServerRescueNegativeTestJSON-1573931620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '731cbbfe17214ded8ac66299d66dfc45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '010919ea84eb4eb8b936c63153600eba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116063) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 13:01:08.937456 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: INFO nova.api.openstack.requestlog [None req-2653227f-1239-49c3-bc0a-d6a5f4ca19d5 tempest-ServerRescueNegativeTestJSON-1573931620 tempest-ServerRescueNegativeTestJSON-1573931620-project] 10.222.0.49 "GET /compute/v2.1/servers/eb6e04a4-8901-47df-9b51-7c1664bd3f6c" status: 200 len: 1569 microversion: 2.1 time: 0.250633 Dec 14 13:01:08.938039 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: [pid: 116063|app: 0|req: 285/544] 10.222.0.49 () {58 vars in 1235 bytes} [Tue Dec 14 13:01:08 2021] GET /compute/v2.1/servers/eb6e04a4-8901-47df-9b51-7c1664bd3f6c => generated 1569 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 14 13:01:09.010995 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.virt.hardware [None req-7ffcf3f9-9061-4d02-a7f0-676cbdfb9004 tempest-VolumesSnapshotTestJSON-1649574085 tempest-VolumesSnapshotTestJSON-1649574085-project] Flavor limits 0:0:0 {{(pid=116064) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Dec 14 13:01:09.011443 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.virt.hardware [None req-7ffcf3f9-9061-4d02-a7f0-676cbdfb9004 tempest-VolumesSnapshotTestJSON-1649574085 tempest-VolumesSnapshotTestJSON-1649574085-project] Image limits 0:0:0 {{(pid=116064) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Dec 14 13:01:09.011904 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.virt.hardware [None req-7ffcf3f9-9061-4d02-a7f0-676cbdfb9004 tempest-VolumesSnapshotTestJSON-1649574085 tempest-VolumesSnapshotTestJSON-1649574085-project] Flavor pref 0:0:0 {{(pid=116064) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Dec 14 13:01:09.012322 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.virt.hardware [None req-7ffcf3f9-9061-4d02-a7f0-676cbdfb9004 tempest-VolumesSnapshotTestJSON-1649574085 tempest-VolumesSnapshotTestJSON-1649574085-project] Image pref 0:0:0 {{(pid=116064) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Dec 14 13:01:09.012738 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.virt.hardware [None req-7ffcf3f9-9061-4d02-a7f0-676cbdfb9004 tempest-VolumesSnapshotTestJSON-1649574085 tempest-VolumesSnapshotTestJSON-1649574085-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=116064) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Dec 14 13:01:09.023583 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-7ffcf3f9-9061-4d02-a7f0-676cbdfb9004 tempest-VolumesSnapshotTestJSON-1649574085 tempest-VolumesSnapshotTestJSON-1649574085-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 13:01:09.024231 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-7ffcf3f9-9061-4d02-a7f0-676cbdfb9004 tempest-VolumesSnapshotTestJSON-1649574085 tempest-VolumesSnapshotTestJSON-1649574085-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 13:01:09.024839 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-7ffcf3f9-9061-4d02-a7f0-676cbdfb9004 tempest-VolumesSnapshotTestJSON-1649574085 tempest-VolumesSnapshotTestJSON-1649574085-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 13:01:09.025322 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-7ffcf3f9-9061-4d02-a7f0-676cbdfb9004 tempest-VolumesSnapshotTestJSON-1649574085 tempest-VolumesSnapshotTestJSON-1649574085-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 13:01:09.042353 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.quota [None req-7ffcf3f9-9061-4d02-a7f0-676cbdfb9004 tempest-VolumesSnapshotTestJSON-1649574085 tempest-VolumesSnapshotTestJSON-1649574085-project] Getting quotas for project e1bf776f341b4721b28eb9a5c84ba866. Resources: {'cores', 'instances', 'ram'} {{(pid=116064) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 14 13:01:09.047074 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.quota [None req-7ffcf3f9-9061-4d02-a7f0-676cbdfb9004 tempest-VolumesSnapshotTestJSON-1649574085 tempest-VolumesSnapshotTestJSON-1649574085-project] Getting quotas for user 0e18311fd2704616a778d36332f199ea and project e1bf776f341b4721b28eb9a5c84ba866. Resources: {'cores', 'instances', 'ram'} {{(pid=116064) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 14 13:01:09.059004 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.compute.api [None req-7ffcf3f9-9061-4d02-a7f0-676cbdfb9004 tempest-VolumesSnapshotTestJSON-1649574085 tempest-VolumesSnapshotTestJSON-1649574085-project] Going to run 1 instances... {{(pid=116064) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Dec 14 13:01:09.061331 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.compute.api [None req-7ffcf3f9-9061-4d02-a7f0-676cbdfb9004 tempest-VolumesSnapshotTestJSON-1649574085 tempest-VolumesSnapshotTestJSON-1649574085-project] [instance: 02c92efa-769b-4b6a-94a9-5d059de29e2c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='1733dcd4-5ded-44e1-8b8d-392adb05c67a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=116064) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Dec 14 13:01:09.110176 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: INFO nova.api.openstack.requestlog [None req-7ffcf3f9-9061-4d02-a7f0-676cbdfb9004 tempest-VolumesSnapshotTestJSON-1649574085 tempest-VolumesSnapshotTestJSON-1649574085-project] 10.222.0.49 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.562196 Dec 14 13:01:09.110823 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: [pid: 116064|app: 0|req: 260/545] 10.222.0.49 () {60 vars in 1146 bytes} [Tue Dec 14 13:01:08 2021] POST /compute/v2.1/servers => generated 380 bytes in 564 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Dec 14 13:01:09.120621 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.api.openstack.wsgi [None req-03679e58-8ea7-419f-86b8-d1b9f647ccc3 tempest-VolumesSnapshotTestJSON-1649574085 tempest-VolumesSnapshotTestJSON-1649574085-project] Calling method '>' {{(pid=116063) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 13:01:09.121258 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.compute.api [None req-03679e58-8ea7-419f-86b8-d1b9f647ccc3 tempest-VolumesSnapshotTestJSON-1649574085 tempest-VolumesSnapshotTestJSON-1649574085-project] [instance: 02c92efa-769b-4b6a-94a9-5d059de29e2c] Fetching instance by UUID {{(pid=116063) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 13:01:09.176040 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.policy [None req-03679e58-8ea7-419f-86b8-d1b9f647ccc3 tempest-VolumesSnapshotTestJSON-1649574085 tempest-VolumesSnapshotTestJSON-1649574085-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e18311fd2704616a778d36332f199ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1bf776f341b4721b28eb9a5c84ba866', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116063) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 13:01:09.183353 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: INFO nova.api.openstack.requestlog [None req-03679e58-8ea7-419f-86b8-d1b9f647ccc3 tempest-VolumesSnapshotTestJSON-1649574085 tempest-VolumesSnapshotTestJSON-1649574085-project] 10.222.0.49 "GET /compute/v2.1/servers/02c92efa-769b-4b6a-94a9-5d059de29e2c" status: 200 len: 1219 microversion: 2.1 time: 0.066424 Dec 14 13:01:09.183916 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: [pid: 116063|app: 0|req: 286/546] 10.222.0.49 () {58 vars in 1235 bytes} [Tue Dec 14 13:01:09 2021] GET /compute/v2.1/servers/02c92efa-769b-4b6a-94a9-5d059de29e2c => generated 1219 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 14 13:01:09.185556 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.api.openstack.wsgi [None req-d0bd2cb4-d023-4f34-bb13-83d446c411a5 tempest-AttachVolumeNegativeTest-1000400951 tempest-AttachVolumeNegativeTest-1000400951-project] Calling method '>' {{(pid=116064) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 13:01:09.186179 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.compute.api [None req-d0bd2cb4-d023-4f34-bb13-83d446c411a5 tempest-AttachVolumeNegativeTest-1000400951 tempest-AttachVolumeNegativeTest-1000400951-project] [instance: 6601be22-57ed-4f24-a26d-d909c51113c8] Fetching instance by UUID {{(pid=116064) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 13:01:09.192496 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-d0bd2cb4-d023-4f34-bb13-83d446c411a5 tempest-AttachVolumeNegativeTest-1000400951 tempest-AttachVolumeNegativeTest-1000400951-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 13:01:09.192940 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-d0bd2cb4-d023-4f34-bb13-83d446c411a5 tempest-AttachVolumeNegativeTest-1000400951 tempest-AttachVolumeNegativeTest-1000400951-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 13:01:09.193748 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-d0bd2cb4-d023-4f34-bb13-83d446c411a5 tempest-AttachVolumeNegativeTest-1000400951 tempest-AttachVolumeNegativeTest-1000400951-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 13:01:09.194181 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-d0bd2cb4-d023-4f34-bb13-83d446c411a5 tempest-AttachVolumeNegativeTest-1000400951 tempest-AttachVolumeNegativeTest-1000400951-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 13:01:09.335441 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.policy [None req-d0bd2cb4-d023-4f34-bb13-83d446c411a5 tempest-AttachVolumeNegativeTest-1000400951 tempest-AttachVolumeNegativeTest-1000400951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57d0ec01f0784c8ea87d339980bed3cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad27b8951cae4eeeafa257f45217653a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116064) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 13:01:09.342945 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: INFO nova.api.openstack.requestlog [None req-d0bd2cb4-d023-4f34-bb13-83d446c411a5 tempest-AttachVolumeNegativeTest-1000400951 tempest-AttachVolumeNegativeTest-1000400951-project] 10.222.0.49 "GET /compute/v2.1/servers/6601be22-57ed-4f24-a26d-d909c51113c8" status: 200 len: 1512 microversion: 2.1 time: 0.162040 Dec 14 13:01:09.347675 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: [pid: 116064|app: 0|req: 261/547] 10.222.0.49 () {58 vars in 1235 bytes} [Tue Dec 14 13:01:09 2021] GET /compute/v2.1/servers/6601be22-57ed-4f24-a26d-d909c51113c8 => generated 1512 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 14 13:01:09.352896 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.api.openstack.wsgi [None req-eb2e6771-81df-49f7-b37d-10c0fad55559 tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] Calling method '>' {{(pid=116063) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 13:01:09.353516 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.compute.api [None req-eb2e6771-81df-49f7-b37d-10c0fad55559 tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] [instance: c8de7730-62f2-4a77-b1e9-cf6a74fa366d] Fetching instance by UUID {{(pid=116063) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 13:01:09.359351 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-eb2e6771-81df-49f7-b37d-10c0fad55559 tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 13:01:09.359800 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-eb2e6771-81df-49f7-b37d-10c0fad55559 tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 13:01:09.360574 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-eb2e6771-81df-49f7-b37d-10c0fad55559 tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 13:01:09.361042 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-eb2e6771-81df-49f7-b37d-10c0fad55559 tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 13:01:09.499493 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.policy [None req-eb2e6771-81df-49f7-b37d-10c0fad55559 tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79d74a2ea1e541d28d085c15cec34032', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68a8770b8dbe489a8119016fbee64eb5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116063) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 13:01:09.508209 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.policy [None req-eb2e6771-81df-49f7-b37d-10c0fad55559 tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '79d74a2ea1e541d28d085c15cec34032', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68a8770b8dbe489a8119016fbee64eb5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116063) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 13:01:09.509735 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.policy [None req-eb2e6771-81df-49f7-b37d-10c0fad55559 tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '79d74a2ea1e541d28d085c15cec34032', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68a8770b8dbe489a8119016fbee64eb5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116063) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 13:01:09.510869 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: INFO nova.api.openstack.requestlog [None req-eb2e6771-81df-49f7-b37d-10c0fad55559 tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] 10.222.0.49 "GET /compute/v2.1/servers/c8de7730-62f2-4a77-b1e9-cf6a74fa366d" status: 200 len: 1753 microversion: 2.20 time: 0.162122 Dec 14 13:01:09.511424 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: [pid: 116063|app: 0|req: 287/548] 10.222.0.49 () {60 vars in 1276 bytes} [Tue Dec 14 13:01:09 2021] GET /compute/v2.1/servers/c8de7730-62f2-4a77-b1e9-cf6a74fa366d => generated 1753 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Dec 14 13:01:09.953908 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.api.openstack.wsgi [None req-e34ea267-7a82-48ab-b23b-0322c4623e91 tempest-ServerRescueNegativeTestJSON-1573931620 tempest-ServerRescueNegativeTestJSON-1573931620-project] Calling method '>' {{(pid=116064) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 13:01:09.954489 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.compute.api [None req-e34ea267-7a82-48ab-b23b-0322c4623e91 tempest-ServerRescueNegativeTestJSON-1573931620 tempest-ServerRescueNegativeTestJSON-1573931620-project] [instance: eb6e04a4-8901-47df-9b51-7c1664bd3f6c] Fetching instance by UUID {{(pid=116064) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 13:01:09.961084 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-e34ea267-7a82-48ab-b23b-0322c4623e91 tempest-ServerRescueNegativeTestJSON-1573931620 tempest-ServerRescueNegativeTestJSON-1573931620-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 13:01:09.961545 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-e34ea267-7a82-48ab-b23b-0322c4623e91 tempest-ServerRescueNegativeTestJSON-1573931620 tempest-ServerRescueNegativeTestJSON-1573931620-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 13:01:09.962306 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-e34ea267-7a82-48ab-b23b-0322c4623e91 tempest-ServerRescueNegativeTestJSON-1573931620 tempest-ServerRescueNegativeTestJSON-1573931620-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 13:01:09.962775 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-e34ea267-7a82-48ab-b23b-0322c4623e91 tempest-ServerRescueNegativeTestJSON-1573931620 tempest-ServerRescueNegativeTestJSON-1573931620-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 13:01:10.097952 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.policy [None req-e34ea267-7a82-48ab-b23b-0322c4623e91 tempest-ServerRescueNegativeTestJSON-1573931620 tempest-ServerRescueNegativeTestJSON-1573931620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '731cbbfe17214ded8ac66299d66dfc45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '010919ea84eb4eb8b936c63153600eba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116064) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 13:01:10.106094 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: INFO nova.api.openstack.requestlog [None req-e34ea267-7a82-48ab-b23b-0322c4623e91 tempest-ServerRescueNegativeTestJSON-1573931620 tempest-ServerRescueNegativeTestJSON-1573931620-project] 10.222.0.49 "GET /compute/v2.1/servers/eb6e04a4-8901-47df-9b51-7c1664bd3f6c" status: 200 len: 1569 microversion: 2.1 time: 0.156099 Dec 14 13:01:10.106642 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: [pid: 116064|app: 0|req: 262/549] 10.222.0.49 () {58 vars in 1235 bytes} [Tue Dec 14 13:01:09 2021] GET /compute/v2.1/servers/eb6e04a4-8901-47df-9b51-7c1664bd3f6c => generated 1569 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 14 13:01:10.199571 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.api.openstack.wsgi [None req-426448fe-f806-4c59-9d6e-c133ef2257a9 tempest-VolumesSnapshotTestJSON-1649574085 tempest-VolumesSnapshotTestJSON-1649574085-project] Calling method '>' {{(pid=116063) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 13:01:10.200143 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.compute.api [None req-426448fe-f806-4c59-9d6e-c133ef2257a9 tempest-VolumesSnapshotTestJSON-1649574085 tempest-VolumesSnapshotTestJSON-1649574085-project] [instance: 02c92efa-769b-4b6a-94a9-5d059de29e2c] Fetching instance by UUID {{(pid=116063) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 13:01:10.206914 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-426448fe-f806-4c59-9d6e-c133ef2257a9 tempest-VolumesSnapshotTestJSON-1649574085 tempest-VolumesSnapshotTestJSON-1649574085-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 13:01:10.207291 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-426448fe-f806-4c59-9d6e-c133ef2257a9 tempest-VolumesSnapshotTestJSON-1649574085 tempest-VolumesSnapshotTestJSON-1649574085-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 13:01:10.208075 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-426448fe-f806-4c59-9d6e-c133ef2257a9 tempest-VolumesSnapshotTestJSON-1649574085 tempest-VolumesSnapshotTestJSON-1649574085-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 13:01:10.208507 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-426448fe-f806-4c59-9d6e-c133ef2257a9 tempest-VolumesSnapshotTestJSON-1649574085 tempest-VolumesSnapshotTestJSON-1649574085-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 13:01:10.271578 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.policy [None req-426448fe-f806-4c59-9d6e-c133ef2257a9 tempest-VolumesSnapshotTestJSON-1649574085 tempest-VolumesSnapshotTestJSON-1649574085-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e18311fd2704616a778d36332f199ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1bf776f341b4721b28eb9a5c84ba866', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116063) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 13:01:10.278962 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: INFO nova.api.openstack.requestlog [None req-426448fe-f806-4c59-9d6e-c133ef2257a9 tempest-VolumesSnapshotTestJSON-1649574085 tempest-VolumesSnapshotTestJSON-1649574085-project] 10.222.0.49 "GET /compute/v2.1/servers/02c92efa-769b-4b6a-94a9-5d059de29e2c" status: 200 len: 1223 microversion: 2.1 time: 0.083084 Dec 14 13:01:10.279532 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: [pid: 116063|app: 0|req: 288/550] 10.222.0.49 () {58 vars in 1235 bytes} [Tue Dec 14 13:01:10 2021] GET /compute/v2.1/servers/02c92efa-769b-4b6a-94a9-5d059de29e2c => generated 1223 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 14 13:01:10.361667 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.api.openstack.wsgi [None req-9ec7b5a2-8924-44bc-9f9f-315c70e63cf2 tempest-AttachVolumeNegativeTest-1000400951 tempest-AttachVolumeNegativeTest-1000400951-project] Calling method '>' {{(pid=116064) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 13:01:10.362300 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.compute.api [None req-9ec7b5a2-8924-44bc-9f9f-315c70e63cf2 tempest-AttachVolumeNegativeTest-1000400951 tempest-AttachVolumeNegativeTest-1000400951-project] [instance: 6601be22-57ed-4f24-a26d-d909c51113c8] Fetching instance by UUID {{(pid=116064) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 13:01:10.368720 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-9ec7b5a2-8924-44bc-9f9f-315c70e63cf2 tempest-AttachVolumeNegativeTest-1000400951 tempest-AttachVolumeNegativeTest-1000400951-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 13:01:10.369202 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-9ec7b5a2-8924-44bc-9f9f-315c70e63cf2 tempest-AttachVolumeNegativeTest-1000400951 tempest-AttachVolumeNegativeTest-1000400951-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 13:01:10.369937 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-9ec7b5a2-8924-44bc-9f9f-315c70e63cf2 tempest-AttachVolumeNegativeTest-1000400951 tempest-AttachVolumeNegativeTest-1000400951-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 13:01:10.370400 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-9ec7b5a2-8924-44bc-9f9f-315c70e63cf2 tempest-AttachVolumeNegativeTest-1000400951 tempest-AttachVolumeNegativeTest-1000400951-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 13:01:10.505197 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.policy [None req-9ec7b5a2-8924-44bc-9f9f-315c70e63cf2 tempest-AttachVolumeNegativeTest-1000400951 tempest-AttachVolumeNegativeTest-1000400951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57d0ec01f0784c8ea87d339980bed3cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad27b8951cae4eeeafa257f45217653a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116064) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 13:01:10.512780 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: INFO nova.api.openstack.requestlog [None req-9ec7b5a2-8924-44bc-9f9f-315c70e63cf2 tempest-AttachVolumeNegativeTest-1000400951 tempest-AttachVolumeNegativeTest-1000400951-project] 10.222.0.49 "GET /compute/v2.1/servers/6601be22-57ed-4f24-a26d-d909c51113c8" status: 200 len: 1512 microversion: 2.1 time: 0.155595 Dec 14 13:01:10.513388 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: [pid: 116064|app: 0|req: 263/551] 10.222.0.49 () {58 vars in 1235 bytes} [Tue Dec 14 13:01:10 2021] GET /compute/v2.1/servers/6601be22-57ed-4f24-a26d-d909c51113c8 => generated 1512 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 14 13:01:10.529577 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.api.openstack.wsgi [None req-f99400d9-85b6-4ee2-a930-5e839f35be67 tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] Calling method '>' {{(pid=116063) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 13:01:10.530191 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.compute.api [None req-f99400d9-85b6-4ee2-a930-5e839f35be67 tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] [instance: c8de7730-62f2-4a77-b1e9-cf6a74fa366d] Fetching instance by UUID {{(pid=116063) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 13:01:10.536749 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-f99400d9-85b6-4ee2-a930-5e839f35be67 tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 13:01:10.537251 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-f99400d9-85b6-4ee2-a930-5e839f35be67 tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 13:01:10.538037 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-f99400d9-85b6-4ee2-a930-5e839f35be67 tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 13:01:10.538468 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-f99400d9-85b6-4ee2-a930-5e839f35be67 tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 13:01:10.681924 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.policy [None req-f99400d9-85b6-4ee2-a930-5e839f35be67 tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79d74a2ea1e541d28d085c15cec34032', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68a8770b8dbe489a8119016fbee64eb5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116063) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 13:01:10.690418 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.policy [None req-f99400d9-85b6-4ee2-a930-5e839f35be67 tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '79d74a2ea1e541d28d085c15cec34032', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68a8770b8dbe489a8119016fbee64eb5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116063) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 13:01:10.691928 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.policy [None req-f99400d9-85b6-4ee2-a930-5e839f35be67 tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '79d74a2ea1e541d28d085c15cec34032', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68a8770b8dbe489a8119016fbee64eb5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116063) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 13:01:10.693130 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: INFO nova.api.openstack.requestlog [None req-f99400d9-85b6-4ee2-a930-5e839f35be67 tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] 10.222.0.49 "GET /compute/v2.1/servers/c8de7730-62f2-4a77-b1e9-cf6a74fa366d" status: 200 len: 1753 microversion: 2.20 time: 0.167478 Dec 14 13:01:10.693700 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: [pid: 116063|app: 0|req: 289/552] 10.222.0.49 () {60 vars in 1276 bytes} [Tue Dec 14 13:01:10 2021] GET /compute/v2.1/servers/c8de7730-62f2-4a77-b1e9-cf6a74fa366d => generated 1753 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 14 13:01:11.126252 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.api.openstack.wsgi [None req-73022547-40d6-4eef-b811-d74775b4abc0 tempest-ServerRescueNegativeTestJSON-1573931620 tempest-ServerRescueNegativeTestJSON-1573931620-project] Calling method '>' {{(pid=116064) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 13:01:11.126829 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.compute.api [None req-73022547-40d6-4eef-b811-d74775b4abc0 tempest-ServerRescueNegativeTestJSON-1573931620 tempest-ServerRescueNegativeTestJSON-1573931620-project] [instance: eb6e04a4-8901-47df-9b51-7c1664bd3f6c] Fetching instance by UUID {{(pid=116064) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 13:01:11.134474 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-73022547-40d6-4eef-b811-d74775b4abc0 tempest-ServerRescueNegativeTestJSON-1573931620 tempest-ServerRescueNegativeTestJSON-1573931620-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 13:01:11.135056 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-73022547-40d6-4eef-b811-d74775b4abc0 tempest-ServerRescueNegativeTestJSON-1573931620 tempest-ServerRescueNegativeTestJSON-1573931620-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 13:01:11.135888 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-73022547-40d6-4eef-b811-d74775b4abc0 tempest-ServerRescueNegativeTestJSON-1573931620 tempest-ServerRescueNegativeTestJSON-1573931620-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 13:01:11.136546 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-73022547-40d6-4eef-b811-d74775b4abc0 tempest-ServerRescueNegativeTestJSON-1573931620 tempest-ServerRescueNegativeTestJSON-1573931620-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 13:01:11.281760 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.policy [None req-73022547-40d6-4eef-b811-d74775b4abc0 tempest-ServerRescueNegativeTestJSON-1573931620 tempest-ServerRescueNegativeTestJSON-1573931620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '731cbbfe17214ded8ac66299d66dfc45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '010919ea84eb4eb8b936c63153600eba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116064) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 13:01:11.295351 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.api.openstack.wsgi [None req-26bb8507-17dc-4871-8146-d70b1bdc71c0 tempest-VolumesSnapshotTestJSON-1649574085 tempest-VolumesSnapshotTestJSON-1649574085-project] Calling method '>' {{(pid=116063) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 13:01:11.297198 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.compute.api [None req-26bb8507-17dc-4871-8146-d70b1bdc71c0 tempest-VolumesSnapshotTestJSON-1649574085 tempest-VolumesSnapshotTestJSON-1649574085-project] [instance: 02c92efa-769b-4b6a-94a9-5d059de29e2c] Fetching instance by UUID {{(pid=116063) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 13:01:11.303800 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: INFO nova.api.openstack.requestlog [None req-73022547-40d6-4eef-b811-d74775b4abc0 tempest-ServerRescueNegativeTestJSON-1573931620 tempest-ServerRescueNegativeTestJSON-1573931620-project] 10.222.0.49 "GET /compute/v2.1/servers/eb6e04a4-8901-47df-9b51-7c1664bd3f6c" status: 200 len: 1569 microversion: 2.1 time: 0.184273 Dec 14 13:01:11.306256 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: [pid: 116064|app: 0|req: 264/553] 10.222.0.49 () {58 vars in 1235 bytes} [Tue Dec 14 13:01:11 2021] GET /compute/v2.1/servers/eb6e04a4-8901-47df-9b51-7c1664bd3f6c => generated 1569 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 14 13:01:11.317282 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-26bb8507-17dc-4871-8146-d70b1bdc71c0 tempest-VolumesSnapshotTestJSON-1649574085 tempest-VolumesSnapshotTestJSON-1649574085-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 13:01:11.317978 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-26bb8507-17dc-4871-8146-d70b1bdc71c0 tempest-VolumesSnapshotTestJSON-1649574085 tempest-VolumesSnapshotTestJSON-1649574085-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 13:01:11.318991 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-26bb8507-17dc-4871-8146-d70b1bdc71c0 tempest-VolumesSnapshotTestJSON-1649574085 tempest-VolumesSnapshotTestJSON-1649574085-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 13:01:11.319432 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-26bb8507-17dc-4871-8146-d70b1bdc71c0 tempest-VolumesSnapshotTestJSON-1649574085 tempest-VolumesSnapshotTestJSON-1649574085-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 13:01:11.380160 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.policy [None req-26bb8507-17dc-4871-8146-d70b1bdc71c0 tempest-VolumesSnapshotTestJSON-1649574085 tempest-VolumesSnapshotTestJSON-1649574085-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e18311fd2704616a778d36332f199ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1bf776f341b4721b28eb9a5c84ba866', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116063) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 13:01:11.389043 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: INFO nova.api.openstack.requestlog [None req-26bb8507-17dc-4871-8146-d70b1bdc71c0 tempest-VolumesSnapshotTestJSON-1649574085 tempest-VolumesSnapshotTestJSON-1649574085-project] 10.222.0.49 "GET /compute/v2.1/servers/02c92efa-769b-4b6a-94a9-5d059de29e2c" status: 200 len: 1271 microversion: 2.1 time: 0.097227 Dec 14 13:01:11.396109 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: [pid: 116063|app: 0|req: 290/554] 10.222.0.49 () {58 vars in 1235 bytes} [Tue Dec 14 13:01:11 2021] GET /compute/v2.1/servers/02c92efa-769b-4b6a-94a9-5d059de29e2c => generated 1271 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 14 13:01:11.530627 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.api.openstack.wsgi [None req-3f8fb792-1a73-4ae2-aaf8-b4f94d68fb30 tempest-AttachVolumeNegativeTest-1000400951 tempest-AttachVolumeNegativeTest-1000400951-project] Calling method '>' {{(pid=116064) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 13:01:11.531227 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.compute.api [None req-3f8fb792-1a73-4ae2-aaf8-b4f94d68fb30 tempest-AttachVolumeNegativeTest-1000400951 tempest-AttachVolumeNegativeTest-1000400951-project] [instance: 6601be22-57ed-4f24-a26d-d909c51113c8] Fetching instance by UUID {{(pid=116064) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 13:01:11.537990 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-3f8fb792-1a73-4ae2-aaf8-b4f94d68fb30 tempest-AttachVolumeNegativeTest-1000400951 tempest-AttachVolumeNegativeTest-1000400951-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 13:01:11.538433 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-3f8fb792-1a73-4ae2-aaf8-b4f94d68fb30 tempest-AttachVolumeNegativeTest-1000400951 tempest-AttachVolumeNegativeTest-1000400951-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 13:01:11.539208 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-3f8fb792-1a73-4ae2-aaf8-b4f94d68fb30 tempest-AttachVolumeNegativeTest-1000400951 tempest-AttachVolumeNegativeTest-1000400951-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 13:01:11.539633 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-3f8fb792-1a73-4ae2-aaf8-b4f94d68fb30 tempest-AttachVolumeNegativeTest-1000400951 tempest-AttachVolumeNegativeTest-1000400951-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 13:01:11.679419 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.policy [None req-3f8fb792-1a73-4ae2-aaf8-b4f94d68fb30 tempest-AttachVolumeNegativeTest-1000400951 tempest-AttachVolumeNegativeTest-1000400951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57d0ec01f0784c8ea87d339980bed3cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad27b8951cae4eeeafa257f45217653a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116064) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 13:01:11.688684 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: INFO nova.api.openstack.requestlog [None req-3f8fb792-1a73-4ae2-aaf8-b4f94d68fb30 tempest-AttachVolumeNegativeTest-1000400951 tempest-AttachVolumeNegativeTest-1000400951-project] 10.222.0.49 "GET /compute/v2.1/servers/6601be22-57ed-4f24-a26d-d909c51113c8" status: 200 len: 1512 microversion: 2.1 time: 0.162353 Dec 14 13:01:11.689490 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: [pid: 116064|app: 0|req: 265/555] 10.222.0.49 () {58 vars in 1235 bytes} [Tue Dec 14 13:01:11 2021] GET /compute/v2.1/servers/6601be22-57ed-4f24-a26d-d909c51113c8 => generated 1512 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 14 13:01:11.711820 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.api.openstack.wsgi [None req-901bacba-9733-4e54-964d-dd64ceba4a03 tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] Calling method '>' {{(pid=116063) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 13:01:11.712501 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.compute.api [None req-901bacba-9733-4e54-964d-dd64ceba4a03 tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] [instance: c8de7730-62f2-4a77-b1e9-cf6a74fa366d] Fetching instance by UUID {{(pid=116063) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 13:01:11.719796 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-901bacba-9733-4e54-964d-dd64ceba4a03 tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 13:01:11.720244 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-901bacba-9733-4e54-964d-dd64ceba4a03 tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 13:01:11.723138 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-901bacba-9733-4e54-964d-dd64ceba4a03 tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 13:01:11.725975 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-901bacba-9733-4e54-964d-dd64ceba4a03 tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 13:01:11.873342 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.api.openstack.wsgi [req-d2df7d2c-3660-4858-adbc-ea59f652b8d5 req-cdabe60f-c1ff-49a7-b340-939f514cbbd5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6601be22-57ed-4f24-a26d-d909c51113c8", "name": "network-vif-deleted", "tag": "e2735b0b-3196-41ad-8a1f-2f0ee1dc4cfe"}]} {{(pid=116064) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 14 13:01:11.876034 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 14 13:01:11.876034 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: warnings.warn(msg) Dec 14 13:01:11.887322 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [req-d2df7d2c-3660-4858-adbc-ea59f652b8d5 req-cdabe60f-c1ff-49a7-b340-939f514cbbd5 service nova] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 13:01:11.889591 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [req-d2df7d2c-3660-4858-adbc-ea59f652b8d5 req-cdabe60f-c1ff-49a7-b340-939f514cbbd5 service nova] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 13:01:11.900958 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.policy [None req-901bacba-9733-4e54-964d-dd64ceba4a03 tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79d74a2ea1e541d28d085c15cec34032', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68a8770b8dbe489a8119016fbee64eb5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116063) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 13:01:11.903909 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: INFO nova.api.openstack.compute.server_external_events [req-d2df7d2c-3660-4858-adbc-ea59f652b8d5 req-cdabe60f-c1ff-49a7-b340-939f514cbbd5 service nova] Creating event network-vif-deleted:e2735b0b-3196-41ad-8a1f-2f0ee1dc4cfe for instance 6601be22-57ed-4f24-a26d-d909c51113c8 on hv-cinder-78447 Dec 14 13:01:11.909752 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: INFO nova.api.openstack.requestlog [req-d2df7d2c-3660-4858-adbc-ea59f652b8d5 req-cdabe60f-c1ff-49a7-b340-939f514cbbd5 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041641 Dec 14 13:01:11.910865 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: [pid: 116064|app: 0|req: 266/556] 10.222.0.49 () {64 vars in 1317 bytes} [Tue Dec 14 13:01:11 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Dec 14 13:01:11.913457 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.policy [None req-901bacba-9733-4e54-964d-dd64ceba4a03 tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '79d74a2ea1e541d28d085c15cec34032', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68a8770b8dbe489a8119016fbee64eb5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116063) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 13:01:11.915743 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.policy [None req-901bacba-9733-4e54-964d-dd64ceba4a03 tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '79d74a2ea1e541d28d085c15cec34032', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68a8770b8dbe489a8119016fbee64eb5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116063) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 13:01:11.921973 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: INFO nova.api.openstack.requestlog [None req-901bacba-9733-4e54-964d-dd64ceba4a03 tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] 10.222.0.49 "GET /compute/v2.1/servers/c8de7730-62f2-4a77-b1e9-cf6a74fa366d" status: 200 len: 1753 microversion: 2.20 time: 0.209056 Dec 14 13:01:11.921973 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: [pid: 116063|app: 0|req: 291/557] 10.222.0.49 () {60 vars in 1276 bytes} [Tue Dec 14 13:01:11 2021] GET /compute/v2.1/servers/c8de7730-62f2-4a77-b1e9-cf6a74fa366d => generated 1753 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 14 13:01:12.323097 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.api.openstack.wsgi [None req-3ea4a09e-dd8f-4a32-8a92-b4208971036d tempest-ServerRescueNegativeTestJSON-1573931620 tempest-ServerRescueNegativeTestJSON-1573931620-project] Calling method '>' {{(pid=116064) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 13:01:12.323795 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.compute.api [None req-3ea4a09e-dd8f-4a32-8a92-b4208971036d tempest-ServerRescueNegativeTestJSON-1573931620 tempest-ServerRescueNegativeTestJSON-1573931620-project] [instance: eb6e04a4-8901-47df-9b51-7c1664bd3f6c] Fetching instance by UUID {{(pid=116064) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 13:01:12.330765 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-3ea4a09e-dd8f-4a32-8a92-b4208971036d tempest-ServerRescueNegativeTestJSON-1573931620 tempest-ServerRescueNegativeTestJSON-1573931620-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 13:01:12.331207 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-3ea4a09e-dd8f-4a32-8a92-b4208971036d tempest-ServerRescueNegativeTestJSON-1573931620 tempest-ServerRescueNegativeTestJSON-1573931620-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 13:01:12.332010 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-3ea4a09e-dd8f-4a32-8a92-b4208971036d tempest-ServerRescueNegativeTestJSON-1573931620 tempest-ServerRescueNegativeTestJSON-1573931620-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 13:01:12.332459 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-3ea4a09e-dd8f-4a32-8a92-b4208971036d tempest-ServerRescueNegativeTestJSON-1573931620 tempest-ServerRescueNegativeTestJSON-1573931620-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 13:01:12.408551 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.api.openstack.wsgi [None req-d524b942-c108-4c4c-90f6-534d39837dcb tempest-VolumesSnapshotTestJSON-1649574085 tempest-VolumesSnapshotTestJSON-1649574085-project] Calling method '>' {{(pid=116063) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 13:01:12.410669 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.compute.api [None req-d524b942-c108-4c4c-90f6-534d39837dcb tempest-VolumesSnapshotTestJSON-1649574085 tempest-VolumesSnapshotTestJSON-1649574085-project] [instance: 02c92efa-769b-4b6a-94a9-5d059de29e2c] Fetching instance by UUID {{(pid=116063) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 13:01:12.418832 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-d524b942-c108-4c4c-90f6-534d39837dcb tempest-VolumesSnapshotTestJSON-1649574085 tempest-VolumesSnapshotTestJSON-1649574085-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 13:01:12.419559 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-d524b942-c108-4c4c-90f6-534d39837dcb tempest-VolumesSnapshotTestJSON-1649574085 tempest-VolumesSnapshotTestJSON-1649574085-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 13:01:12.420522 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-d524b942-c108-4c4c-90f6-534d39837dcb tempest-VolumesSnapshotTestJSON-1649574085 tempest-VolumesSnapshotTestJSON-1649574085-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 13:01:12.421805 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-d524b942-c108-4c4c-90f6-534d39837dcb tempest-VolumesSnapshotTestJSON-1649574085 tempest-VolumesSnapshotTestJSON-1649574085-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 13:01:12.513312 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.policy [None req-3ea4a09e-dd8f-4a32-8a92-b4208971036d tempest-ServerRescueNegativeTestJSON-1573931620 tempest-ServerRescueNegativeTestJSON-1573931620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '731cbbfe17214ded8ac66299d66dfc45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '010919ea84eb4eb8b936c63153600eba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116064) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 13:01:12.523001 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: INFO nova.api.openstack.requestlog [None req-3ea4a09e-dd8f-4a32-8a92-b4208971036d tempest-ServerRescueNegativeTestJSON-1573931620 tempest-ServerRescueNegativeTestJSON-1573931620-project] 10.222.0.49 "GET /compute/v2.1/servers/eb6e04a4-8901-47df-9b51-7c1664bd3f6c" status: 200 len: 1569 microversion: 2.1 time: 0.203997 Dec 14 13:01:12.533685 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: [pid: 116064|app: 0|req: 267/558] 10.222.0.49 () {58 vars in 1235 bytes} [Tue Dec 14 13:01:12 2021] GET /compute/v2.1/servers/eb6e04a4-8901-47df-9b51-7c1664bd3f6c => generated 1569 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 14 13:01:12.600515 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.policy [None req-d524b942-c108-4c4c-90f6-534d39837dcb tempest-VolumesSnapshotTestJSON-1649574085 tempest-VolumesSnapshotTestJSON-1649574085-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e18311fd2704616a778d36332f199ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1bf776f341b4721b28eb9a5c84ba866', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116063) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 13:01:12.608393 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: INFO nova.api.openstack.requestlog [None req-d524b942-c108-4c4c-90f6-534d39837dcb tempest-VolumesSnapshotTestJSON-1649574085 tempest-VolumesSnapshotTestJSON-1649574085-project] 10.222.0.49 "GET /compute/v2.1/servers/02c92efa-769b-4b6a-94a9-5d059de29e2c" status: 200 len: 1319 microversion: 2.1 time: 0.205153 Dec 14 13:01:12.618465 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: [pid: 116063|app: 0|req: 292/559] 10.222.0.49 () {58 vars in 1235 bytes} [Tue Dec 14 13:01:12 2021] GET /compute/v2.1/servers/02c92efa-769b-4b6a-94a9-5d059de29e2c => generated 1319 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 14 13:01:12.707885 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.api.openstack.wsgi [None req-1fa0ed91-ff8a-4a18-86d2-46903a73913c tempest-AttachVolumeNegativeTest-1000400951 tempest-AttachVolumeNegativeTest-1000400951-project] Calling method '>' {{(pid=116064) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 13:01:12.708571 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.compute.api [None req-1fa0ed91-ff8a-4a18-86d2-46903a73913c tempest-AttachVolumeNegativeTest-1000400951 tempest-AttachVolumeNegativeTest-1000400951-project] [instance: 6601be22-57ed-4f24-a26d-d909c51113c8] Fetching instance by UUID {{(pid=116064) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 13:01:12.714810 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-1fa0ed91-ff8a-4a18-86d2-46903a73913c tempest-AttachVolumeNegativeTest-1000400951 tempest-AttachVolumeNegativeTest-1000400951-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 13:01:12.715384 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-1fa0ed91-ff8a-4a18-86d2-46903a73913c tempest-AttachVolumeNegativeTest-1000400951 tempest-AttachVolumeNegativeTest-1000400951-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 13:01:12.716276 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-1fa0ed91-ff8a-4a18-86d2-46903a73913c tempest-AttachVolumeNegativeTest-1000400951 tempest-AttachVolumeNegativeTest-1000400951-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 13:01:12.716779 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-1fa0ed91-ff8a-4a18-86d2-46903a73913c tempest-AttachVolumeNegativeTest-1000400951 tempest-AttachVolumeNegativeTest-1000400951-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 13:01:12.729963 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: INFO nova.api.openstack.wsgi [None req-1fa0ed91-ff8a-4a18-86d2-46903a73913c tempest-AttachVolumeNegativeTest-1000400951 tempest-AttachVolumeNegativeTest-1000400951-project] HTTP exception thrown: Instance 6601be22-57ed-4f24-a26d-d909c51113c8 could not be found. Dec 14 13:01:12.730562 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.api.openstack.wsgi [None req-1fa0ed91-ff8a-4a18-86d2-46903a73913c tempest-AttachVolumeNegativeTest-1000400951 tempest-AttachVolumeNegativeTest-1000400951-project] Returning 404 to user: Instance 6601be22-57ed-4f24-a26d-d909c51113c8 could not be found. {{(pid=116064) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 14 13:01:12.731410 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: INFO nova.api.openstack.requestlog [None req-1fa0ed91-ff8a-4a18-86d2-46903a73913c tempest-AttachVolumeNegativeTest-1000400951 tempest-AttachVolumeNegativeTest-1000400951-project] 10.222.0.49 "GET /compute/v2.1/servers/6601be22-57ed-4f24-a26d-d909c51113c8" status: 404 len: 111 microversion: 2.1 time: 0.029587 Dec 14 13:01:12.731969 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: [pid: 116064|app: 0|req: 268/560] 10.222.0.49 () {58 vars in 1235 bytes} [Tue Dec 14 13:01:12 2021] GET /compute/v2.1/servers/6601be22-57ed-4f24-a26d-d909c51113c8 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Dec 14 13:01:12.937256 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.api.openstack.wsgi [None req-b7225628-7ac9-4423-ac9d-f9ac040204b4 tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] Calling method '>' {{(pid=116063) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 13:01:12.937933 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.compute.api [None req-b7225628-7ac9-4423-ac9d-f9ac040204b4 tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] [instance: c8de7730-62f2-4a77-b1e9-cf6a74fa366d] Fetching instance by UUID {{(pid=116063) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 13:01:12.945197 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-b7225628-7ac9-4423-ac9d-f9ac040204b4 tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 13:01:12.945544 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-b7225628-7ac9-4423-ac9d-f9ac040204b4 tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 13:01:12.946325 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-b7225628-7ac9-4423-ac9d-f9ac040204b4 tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 13:01:12.946757 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-b7225628-7ac9-4423-ac9d-f9ac040204b4 tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 13:01:13.089782 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.policy [None req-b7225628-7ac9-4423-ac9d-f9ac040204b4 tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79d74a2ea1e541d28d085c15cec34032', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68a8770b8dbe489a8119016fbee64eb5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116063) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 13:01:13.106363 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.policy [None req-b7225628-7ac9-4423-ac9d-f9ac040204b4 tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '79d74a2ea1e541d28d085c15cec34032', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68a8770b8dbe489a8119016fbee64eb5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116063) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 13:01:13.106363 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.policy [None req-b7225628-7ac9-4423-ac9d-f9ac040204b4 tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '79d74a2ea1e541d28d085c15cec34032', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68a8770b8dbe489a8119016fbee64eb5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116063) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 13:01:13.106363 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: INFO nova.api.openstack.requestlog [None req-b7225628-7ac9-4423-ac9d-f9ac040204b4 tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] 10.222.0.49 "GET /compute/v2.1/servers/c8de7730-62f2-4a77-b1e9-cf6a74fa366d" status: 200 len: 1753 microversion: 2.20 time: 0.169314 Dec 14 13:01:13.106741 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: [pid: 116063|app: 0|req: 293/561] 10.222.0.49 () {60 vars in 1276 bytes} [Tue Dec 14 13:01:12 2021] GET /compute/v2.1/servers/c8de7730-62f2-4a77-b1e9-cf6a74fa366d => generated 1753 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 14 13:01:13.539952 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.api.openstack.wsgi [None req-6d12be94-8881-495c-b75b-f289502c9622 tempest-ServerRescueNegativeTestJSON-1573931620 tempest-ServerRescueNegativeTestJSON-1573931620-project] Calling method '>' {{(pid=116064) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 13:01:13.540554 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.compute.api [None req-6d12be94-8881-495c-b75b-f289502c9622 tempest-ServerRescueNegativeTestJSON-1573931620 tempest-ServerRescueNegativeTestJSON-1573931620-project] [instance: eb6e04a4-8901-47df-9b51-7c1664bd3f6c] Fetching instance by UUID {{(pid=116064) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 13:01:13.547725 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-6d12be94-8881-495c-b75b-f289502c9622 tempest-ServerRescueNegativeTestJSON-1573931620 tempest-ServerRescueNegativeTestJSON-1573931620-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 13:01:13.548172 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-6d12be94-8881-495c-b75b-f289502c9622 tempest-ServerRescueNegativeTestJSON-1573931620 tempest-ServerRescueNegativeTestJSON-1573931620-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 13:01:13.548996 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-6d12be94-8881-495c-b75b-f289502c9622 tempest-ServerRescueNegativeTestJSON-1573931620 tempest-ServerRescueNegativeTestJSON-1573931620-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 13:01:13.549429 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-6d12be94-8881-495c-b75b-f289502c9622 tempest-ServerRescueNegativeTestJSON-1573931620 tempest-ServerRescueNegativeTestJSON-1573931620-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 13:01:13.627387 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.api.openstack.wsgi [None req-b35f132c-d5e8-4421-8289-b208188da67d tempest-VolumesSnapshotTestJSON-1649574085 tempest-VolumesSnapshotTestJSON-1649574085-project] Calling method '>' {{(pid=116063) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 13:01:13.629427 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.compute.api [None req-b35f132c-d5e8-4421-8289-b208188da67d tempest-VolumesSnapshotTestJSON-1649574085 tempest-VolumesSnapshotTestJSON-1649574085-project] [instance: 02c92efa-769b-4b6a-94a9-5d059de29e2c] Fetching instance by UUID {{(pid=116063) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 13:01:13.636064 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-b35f132c-d5e8-4421-8289-b208188da67d tempest-VolumesSnapshotTestJSON-1649574085 tempest-VolumesSnapshotTestJSON-1649574085-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 13:01:13.636704 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-b35f132c-d5e8-4421-8289-b208188da67d tempest-VolumesSnapshotTestJSON-1649574085 tempest-VolumesSnapshotTestJSON-1649574085-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 13:01:13.637655 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-b35f132c-d5e8-4421-8289-b208188da67d tempest-VolumesSnapshotTestJSON-1649574085 tempest-VolumesSnapshotTestJSON-1649574085-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 13:01:13.638819 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-b35f132c-d5e8-4421-8289-b208188da67d tempest-VolumesSnapshotTestJSON-1649574085 tempest-VolumesSnapshotTestJSON-1649574085-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 13:01:13.736881 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.policy [None req-6d12be94-8881-495c-b75b-f289502c9622 tempest-ServerRescueNegativeTestJSON-1573931620 tempest-ServerRescueNegativeTestJSON-1573931620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '731cbbfe17214ded8ac66299d66dfc45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '010919ea84eb4eb8b936c63153600eba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116064) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 13:01:13.756253 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: INFO nova.api.openstack.requestlog [None req-6d12be94-8881-495c-b75b-f289502c9622 tempest-ServerRescueNegativeTestJSON-1573931620 tempest-ServerRescueNegativeTestJSON-1573931620-project] 10.222.0.49 "GET /compute/v2.1/servers/eb6e04a4-8901-47df-9b51-7c1664bd3f6c" status: 200 len: 1569 microversion: 2.1 time: 0.219955 Dec 14 13:01:13.756897 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: [pid: 116064|app: 0|req: 269/562] 10.222.0.49 () {58 vars in 1235 bytes} [Tue Dec 14 13:01:13 2021] GET /compute/v2.1/servers/eb6e04a4-8901-47df-9b51-7c1664bd3f6c => generated 1569 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 14 13:01:13.823812 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.policy [None req-b35f132c-d5e8-4421-8289-b208188da67d tempest-VolumesSnapshotTestJSON-1649574085 tempest-VolumesSnapshotTestJSON-1649574085-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e18311fd2704616a778d36332f199ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1bf776f341b4721b28eb9a5c84ba866', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116063) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 13:01:13.831967 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: INFO nova.api.openstack.requestlog [None req-b35f132c-d5e8-4421-8289-b208188da67d tempest-VolumesSnapshotTestJSON-1649574085 tempest-VolumesSnapshotTestJSON-1649574085-project] 10.222.0.49 "GET /compute/v2.1/servers/02c92efa-769b-4b6a-94a9-5d059de29e2c" status: 200 len: 1319 microversion: 2.1 time: 0.208413 Dec 14 13:01:13.832874 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: [pid: 116063|app: 0|req: 294/563] 10.222.0.49 () {58 vars in 1235 bytes} [Tue Dec 14 13:01:13 2021] GET /compute/v2.1/servers/02c92efa-769b-4b6a-94a9-5d059de29e2c => generated 1319 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 14 13:01:13.935456 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.api.openstack.wsgi [req-3242c0d6-b451-4443-9d19-923ea6a18ac0 req-d050909f-4132-40dd-af51-c81a06a6f47a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "02c92efa-769b-4b6a-94a9-5d059de29e2c", "tag": "9de9803b-e8e8-4441-a8ab-11f10fdbe375"}]} {{(pid=116064) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 14 13:01:13.937070 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 14 13:01:13.937070 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: warnings.warn(msg) Dec 14 13:01:13.944225 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [req-3242c0d6-b451-4443-9d19-923ea6a18ac0 req-d050909f-4132-40dd-af51-c81a06a6f47a service nova] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 13:01:13.944667 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [req-3242c0d6-b451-4443-9d19-923ea6a18ac0 req-d050909f-4132-40dd-af51-c81a06a6f47a service nova] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 13:01:13.956234 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: INFO nova.api.openstack.compute.server_external_events [req-3242c0d6-b451-4443-9d19-923ea6a18ac0 req-d050909f-4132-40dd-af51-c81a06a6f47a service nova] Creating event network-changed:9de9803b-e8e8-4441-a8ab-11f10fdbe375 for instance 02c92efa-769b-4b6a-94a9-5d059de29e2c on hv-cinder-78447 Dec 14 13:01:13.962044 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: INFO nova.api.openstack.requestlog [req-3242c0d6-b451-4443-9d19-923ea6a18ac0 req-d050909f-4132-40dd-af51-c81a06a6f47a service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030401 Dec 14 13:01:13.962705 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: [pid: 116064|app: 0|req: 270/564] 10.222.0.49 () {64 vars in 1317 bytes} [Tue Dec 14 13:01:13 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 14 13:01:14.127289 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.api.openstack.wsgi [None req-89374c65-6af4-45d0-8a7c-c1d66afca6e0 tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] Calling method '>' {{(pid=116063) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 13:01:14.129402 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.compute.api [None req-89374c65-6af4-45d0-8a7c-c1d66afca6e0 tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] [instance: c8de7730-62f2-4a77-b1e9-cf6a74fa366d] Fetching instance by UUID {{(pid=116063) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 13:01:14.144211 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-89374c65-6af4-45d0-8a7c-c1d66afca6e0 tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 13:01:14.155055 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-89374c65-6af4-45d0-8a7c-c1d66afca6e0 tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 13:01:14.155055 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-89374c65-6af4-45d0-8a7c-c1d66afca6e0 tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 13:01:14.155055 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-89374c65-6af4-45d0-8a7c-c1d66afca6e0 tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 13:01:14.313050 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.policy [None req-89374c65-6af4-45d0-8a7c-c1d66afca6e0 tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79d74a2ea1e541d28d085c15cec34032', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68a8770b8dbe489a8119016fbee64eb5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116063) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 13:01:14.321847 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.policy [None req-89374c65-6af4-45d0-8a7c-c1d66afca6e0 tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '79d74a2ea1e541d28d085c15cec34032', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68a8770b8dbe489a8119016fbee64eb5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116063) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 13:01:14.323336 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.policy [None req-89374c65-6af4-45d0-8a7c-c1d66afca6e0 tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '79d74a2ea1e541d28d085c15cec34032', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68a8770b8dbe489a8119016fbee64eb5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116063) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 13:01:14.324512 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: INFO nova.api.openstack.requestlog [None req-89374c65-6af4-45d0-8a7c-c1d66afca6e0 tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] 10.222.0.49 "GET /compute/v2.1/servers/c8de7730-62f2-4a77-b1e9-cf6a74fa366d" status: 200 len: 1753 microversion: 2.20 time: 0.206743 Dec 14 13:01:14.332905 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: [pid: 116063|app: 0|req: 295/565] 10.222.0.49 () {60 vars in 1276 bytes} [Tue Dec 14 13:01:14 2021] GET /compute/v2.1/servers/c8de7730-62f2-4a77-b1e9-cf6a74fa366d => generated 1753 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 14 13:01:14.775047 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.api.openstack.wsgi [None req-6b9be20a-c31b-423f-9bf2-c296d7b74336 tempest-ServerRescueNegativeTestJSON-1573931620 tempest-ServerRescueNegativeTestJSON-1573931620-project] Calling method '>' {{(pid=116064) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 13:01:14.776535 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.compute.api [None req-6b9be20a-c31b-423f-9bf2-c296d7b74336 tempest-ServerRescueNegativeTestJSON-1573931620 tempest-ServerRescueNegativeTestJSON-1573931620-project] [instance: eb6e04a4-8901-47df-9b51-7c1664bd3f6c] Fetching instance by UUID {{(pid=116064) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 13:01:14.783275 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-6b9be20a-c31b-423f-9bf2-c296d7b74336 tempest-ServerRescueNegativeTestJSON-1573931620 tempest-ServerRescueNegativeTestJSON-1573931620-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 13:01:14.784117 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-6b9be20a-c31b-423f-9bf2-c296d7b74336 tempest-ServerRescueNegativeTestJSON-1573931620 tempest-ServerRescueNegativeTestJSON-1573931620-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 13:01:14.785283 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-6b9be20a-c31b-423f-9bf2-c296d7b74336 tempest-ServerRescueNegativeTestJSON-1573931620 tempest-ServerRescueNegativeTestJSON-1573931620-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 13:01:14.785922 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-6b9be20a-c31b-423f-9bf2-c296d7b74336 tempest-ServerRescueNegativeTestJSON-1573931620 tempest-ServerRescueNegativeTestJSON-1573931620-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 13:01:14.851055 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.api.openstack.wsgi [None req-6b4bea4d-bd47-474c-be45-fb1dd6346392 tempest-VolumesSnapshotTestJSON-1649574085 tempest-VolumesSnapshotTestJSON-1649574085-project] Calling method '>' {{(pid=116063) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 13:01:14.851832 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.compute.api [None req-6b4bea4d-bd47-474c-be45-fb1dd6346392 tempest-VolumesSnapshotTestJSON-1649574085 tempest-VolumesSnapshotTestJSON-1649574085-project] [instance: 02c92efa-769b-4b6a-94a9-5d059de29e2c] Fetching instance by UUID {{(pid=116063) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 13:01:14.874408 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-6b4bea4d-bd47-474c-be45-fb1dd6346392 tempest-VolumesSnapshotTestJSON-1649574085 tempest-VolumesSnapshotTestJSON-1649574085-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 13:01:14.874972 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-6b4bea4d-bd47-474c-be45-fb1dd6346392 tempest-VolumesSnapshotTestJSON-1649574085 tempest-VolumesSnapshotTestJSON-1649574085-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 13:01:14.875863 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-6b4bea4d-bd47-474c-be45-fb1dd6346392 tempest-VolumesSnapshotTestJSON-1649574085 tempest-VolumesSnapshotTestJSON-1649574085-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 13:01:14.876362 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-6b4bea4d-bd47-474c-be45-fb1dd6346392 tempest-VolumesSnapshotTestJSON-1649574085 tempest-VolumesSnapshotTestJSON-1649574085-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 13:01:14.973920 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.policy [None req-6b9be20a-c31b-423f-9bf2-c296d7b74336 tempest-ServerRescueNegativeTestJSON-1573931620 tempest-ServerRescueNegativeTestJSON-1573931620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '731cbbfe17214ded8ac66299d66dfc45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '010919ea84eb4eb8b936c63153600eba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116064) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 13:01:14.982214 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: INFO nova.api.openstack.requestlog [None req-6b9be20a-c31b-423f-9bf2-c296d7b74336 tempest-ServerRescueNegativeTestJSON-1573931620 tempest-ServerRescueNegativeTestJSON-1573931620-project] 10.222.0.49 "GET /compute/v2.1/servers/eb6e04a4-8901-47df-9b51-7c1664bd3f6c" status: 200 len: 1569 microversion: 2.1 time: 0.211793 Dec 14 13:01:14.982845 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: [pid: 116064|app: 0|req: 271/566] 10.222.0.49 () {58 vars in 1235 bytes} [Tue Dec 14 13:01:14 2021] GET /compute/v2.1/servers/eb6e04a4-8901-47df-9b51-7c1664bd3f6c => generated 1569 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 14 13:01:14.987400 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.api.openstack.wsgi [None req-34fc2a64-b0d4-41be-9aed-09df83d8422c tempest-AttachVolumeNegativeTest-1000400951 tempest-AttachVolumeNegativeTest-1000400951-project] Calling method '>' {{(pid=116064) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 13:01:14.987928 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.compute.api [None req-34fc2a64-b0d4-41be-9aed-09df83d8422c tempest-AttachVolumeNegativeTest-1000400951 tempest-AttachVolumeNegativeTest-1000400951-project] [instance: 824eca5b-954f-402d-aa22-14f24ddd77ba] Fetching instance by UUID {{(pid=116064) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 13:01:14.994387 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-34fc2a64-b0d4-41be-9aed-09df83d8422c tempest-AttachVolumeNegativeTest-1000400951 tempest-AttachVolumeNegativeTest-1000400951-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 13:01:14.994825 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-34fc2a64-b0d4-41be-9aed-09df83d8422c tempest-AttachVolumeNegativeTest-1000400951 tempest-AttachVolumeNegativeTest-1000400951-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 13:01:14.995601 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-34fc2a64-b0d4-41be-9aed-09df83d8422c tempest-AttachVolumeNegativeTest-1000400951 tempest-AttachVolumeNegativeTest-1000400951-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 13:01:14.996078 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-34fc2a64-b0d4-41be-9aed-09df83d8422c tempest-AttachVolumeNegativeTest-1000400951 tempest-AttachVolumeNegativeTest-1000400951-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 13:01:15.021760 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.compute.api [None req-34fc2a64-b0d4-41be-9aed-09df83d8422c tempest-AttachVolumeNegativeTest-1000400951 tempest-AttachVolumeNegativeTest-1000400951-project] [instance: 824eca5b-954f-402d-aa22-14f24ddd77ba] Going to try to terminate instance {{(pid=116064) delete /opt/stack/nova/nova/compute/api.py:2614}} Dec 14 13:01:15.048574 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.policy [None req-6b4bea4d-bd47-474c-be45-fb1dd6346392 tempest-VolumesSnapshotTestJSON-1649574085 tempest-VolumesSnapshotTestJSON-1649574085-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e18311fd2704616a778d36332f199ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1bf776f341b4721b28eb9a5c84ba866', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116063) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 13:01:15.057087 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: INFO nova.api.openstack.requestlog [None req-6b4bea4d-bd47-474c-be45-fb1dd6346392 tempest-VolumesSnapshotTestJSON-1649574085 tempest-VolumesSnapshotTestJSON-1649574085-project] 10.222.0.49 "GET /compute/v2.1/servers/02c92efa-769b-4b6a-94a9-5d059de29e2c" status: 200 len: 1319 microversion: 2.1 time: 0.210939 Dec 14 13:01:15.057681 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: [pid: 116063|app: 0|req: 296/567] 10.222.0.49 () {58 vars in 1235 bytes} [Tue Dec 14 13:01:14 2021] GET /compute/v2.1/servers/02c92efa-769b-4b6a-94a9-5d059de29e2c => generated 1319 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 14 13:01:15.099226 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: INFO nova.api.openstack.requestlog [None req-34fc2a64-b0d4-41be-9aed-09df83d8422c tempest-AttachVolumeNegativeTest-1000400951 tempest-AttachVolumeNegativeTest-1000400951-project] 10.222.0.49 "DELETE /compute/v2.1/servers/824eca5b-954f-402d-aa22-14f24ddd77ba" status: 204 len: 0 microversion: 2.1 time: 0.115081 Dec 14 13:01:15.099774 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: [pid: 116064|app: 0|req: 272/568] 10.222.0.49 () {58 vars in 1238 bytes} [Tue Dec 14 13:01:14 2021] DELETE /compute/v2.1/servers/824eca5b-954f-402d-aa22-14f24ddd77ba => generated 0 bytes in 116 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Dec 14 13:01:15.108265 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.api.openstack.wsgi [None req-19808ed1-ed20-49db-a423-b0cbe6860c6f tempest-AttachVolumeNegativeTest-1000400951 tempest-AttachVolumeNegativeTest-1000400951-project] Calling method '>' {{(pid=116063) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 13:01:15.108929 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.compute.api [None req-19808ed1-ed20-49db-a423-b0cbe6860c6f tempest-AttachVolumeNegativeTest-1000400951 tempest-AttachVolumeNegativeTest-1000400951-project] [instance: 824eca5b-954f-402d-aa22-14f24ddd77ba] Fetching instance by UUID {{(pid=116063) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 13:01:15.114817 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-19808ed1-ed20-49db-a423-b0cbe6860c6f tempest-AttachVolumeNegativeTest-1000400951 tempest-AttachVolumeNegativeTest-1000400951-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 13:01:15.115268 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-19808ed1-ed20-49db-a423-b0cbe6860c6f tempest-AttachVolumeNegativeTest-1000400951 tempest-AttachVolumeNegativeTest-1000400951-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 13:01:15.116129 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-19808ed1-ed20-49db-a423-b0cbe6860c6f tempest-AttachVolumeNegativeTest-1000400951 tempest-AttachVolumeNegativeTest-1000400951-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 13:01:15.116535 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-19808ed1-ed20-49db-a423-b0cbe6860c6f tempest-AttachVolumeNegativeTest-1000400951 tempest-AttachVolumeNegativeTest-1000400951-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 13:01:15.257834 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.policy [None req-19808ed1-ed20-49db-a423-b0cbe6860c6f tempest-AttachVolumeNegativeTest-1000400951 tempest-AttachVolumeNegativeTest-1000400951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57d0ec01f0784c8ea87d339980bed3cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad27b8951cae4eeeafa257f45217653a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116063) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 13:01:15.265738 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: INFO nova.api.openstack.requestlog [None req-19808ed1-ed20-49db-a423-b0cbe6860c6f tempest-AttachVolumeNegativeTest-1000400951 tempest-AttachVolumeNegativeTest-1000400951-project] 10.222.0.49 "GET /compute/v2.1/servers/824eca5b-954f-402d-aa22-14f24ddd77ba" status: 200 len: 1514 microversion: 2.1 time: 0.161339 Dec 14 13:01:15.266390 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: [pid: 116063|app: 0|req: 297/569] 10.222.0.49 () {58 vars in 1235 bytes} [Tue Dec 14 13:01:15 2021] GET /compute/v2.1/servers/824eca5b-954f-402d-aa22-14f24ddd77ba => generated 1514 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 14 13:01:15.344017 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.api.openstack.wsgi [None req-b12a9394-6ce5-40d4-9da9-42fee288efb8 tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] Calling method '>' {{(pid=116064) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 13:01:15.344813 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.compute.api [None req-b12a9394-6ce5-40d4-9da9-42fee288efb8 tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] [instance: c8de7730-62f2-4a77-b1e9-cf6a74fa366d] Fetching instance by UUID {{(pid=116064) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 13:01:15.350666 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-b12a9394-6ce5-40d4-9da9-42fee288efb8 tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 13:01:15.351120 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-b12a9394-6ce5-40d4-9da9-42fee288efb8 tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 13:01:15.351893 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-b12a9394-6ce5-40d4-9da9-42fee288efb8 tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 13:01:15.352319 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-b12a9394-6ce5-40d4-9da9-42fee288efb8 tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 13:01:15.480985 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.policy [None req-b12a9394-6ce5-40d4-9da9-42fee288efb8 tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79d74a2ea1e541d28d085c15cec34032', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68a8770b8dbe489a8119016fbee64eb5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116064) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 13:01:15.489633 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.policy [None req-b12a9394-6ce5-40d4-9da9-42fee288efb8 tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '79d74a2ea1e541d28d085c15cec34032', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68a8770b8dbe489a8119016fbee64eb5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116064) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 13:01:15.491145 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.policy [None req-b12a9394-6ce5-40d4-9da9-42fee288efb8 tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '79d74a2ea1e541d28d085c15cec34032', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68a8770b8dbe489a8119016fbee64eb5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116064) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 13:01:15.492320 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: INFO nova.api.openstack.requestlog [None req-b12a9394-6ce5-40d4-9da9-42fee288efb8 tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] 10.222.0.49 "GET /compute/v2.1/servers/c8de7730-62f2-4a77-b1e9-cf6a74fa366d" status: 200 len: 1809 microversion: 2.20 time: 0.152477 Dec 14 13:01:15.493096 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: [pid: 116064|app: 0|req: 273/570] 10.222.0.49 () {60 vars in 1276 bytes} [Tue Dec 14 13:01:15 2021] GET /compute/v2.1/servers/c8de7730-62f2-4a77-b1e9-cf6a74fa366d => generated 1809 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 14 13:01:15.999549 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.api.openstack.wsgi [None req-ae35cbaa-4347-42da-9164-63196bb2ee7c tempest-ServerRescueNegativeTestJSON-1573931620 tempest-ServerRescueNegativeTestJSON-1573931620-project] Calling method '>' {{(pid=116063) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 13:01:16.000114 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.compute.api [None req-ae35cbaa-4347-42da-9164-63196bb2ee7c tempest-ServerRescueNegativeTestJSON-1573931620 tempest-ServerRescueNegativeTestJSON-1573931620-project] [instance: eb6e04a4-8901-47df-9b51-7c1664bd3f6c] Fetching instance by UUID {{(pid=116063) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 13:01:16.007053 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-ae35cbaa-4347-42da-9164-63196bb2ee7c tempest-ServerRescueNegativeTestJSON-1573931620 tempest-ServerRescueNegativeTestJSON-1573931620-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 13:01:16.007539 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-ae35cbaa-4347-42da-9164-63196bb2ee7c tempest-ServerRescueNegativeTestJSON-1573931620 tempest-ServerRescueNegativeTestJSON-1573931620-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 13:01:16.008542 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-ae35cbaa-4347-42da-9164-63196bb2ee7c tempest-ServerRescueNegativeTestJSON-1573931620 tempest-ServerRescueNegativeTestJSON-1573931620-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 13:01:16.009018 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-ae35cbaa-4347-42da-9164-63196bb2ee7c tempest-ServerRescueNegativeTestJSON-1573931620 tempest-ServerRescueNegativeTestJSON-1573931620-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 13:01:16.074275 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.api.openstack.wsgi [None req-06e66d45-9b25-46f5-9bb6-a2b0e2ce9614 tempest-VolumesSnapshotTestJSON-1649574085 tempest-VolumesSnapshotTestJSON-1649574085-project] Calling method '>' {{(pid=116064) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 13:01:16.074887 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.compute.api [None req-06e66d45-9b25-46f5-9bb6-a2b0e2ce9614 tempest-VolumesSnapshotTestJSON-1649574085 tempest-VolumesSnapshotTestJSON-1649574085-project] [instance: 02c92efa-769b-4b6a-94a9-5d059de29e2c] Fetching instance by UUID {{(pid=116064) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 13:01:16.081304 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-06e66d45-9b25-46f5-9bb6-a2b0e2ce9614 tempest-VolumesSnapshotTestJSON-1649574085 tempest-VolumesSnapshotTestJSON-1649574085-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 13:01:16.081758 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-06e66d45-9b25-46f5-9bb6-a2b0e2ce9614 tempest-VolumesSnapshotTestJSON-1649574085 tempest-VolumesSnapshotTestJSON-1649574085-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 13:01:16.082555 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-06e66d45-9b25-46f5-9bb6-a2b0e2ce9614 tempest-VolumesSnapshotTestJSON-1649574085 tempest-VolumesSnapshotTestJSON-1649574085-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 13:01:16.083025 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-06e66d45-9b25-46f5-9bb6-a2b0e2ce9614 tempest-VolumesSnapshotTestJSON-1649574085 tempest-VolumesSnapshotTestJSON-1649574085-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 13:01:16.175404 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.policy [None req-ae35cbaa-4347-42da-9164-63196bb2ee7c tempest-ServerRescueNegativeTestJSON-1573931620 tempest-ServerRescueNegativeTestJSON-1573931620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '731cbbfe17214ded8ac66299d66dfc45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '010919ea84eb4eb8b936c63153600eba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116063) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 13:01:16.188218 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: INFO nova.api.openstack.requestlog [None req-ae35cbaa-4347-42da-9164-63196bb2ee7c tempest-ServerRescueNegativeTestJSON-1573931620 tempest-ServerRescueNegativeTestJSON-1573931620-project] 10.222.0.49 "GET /compute/v2.1/servers/eb6e04a4-8901-47df-9b51-7c1664bd3f6c" status: 200 len: 1569 microversion: 2.1 time: 0.192391 Dec 14 13:01:16.188983 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: [pid: 116063|app: 0|req: 298/571] 10.222.0.49 () {58 vars in 1235 bytes} [Tue Dec 14 13:01:15 2021] GET /compute/v2.1/servers/eb6e04a4-8901-47df-9b51-7c1664bd3f6c => generated 1569 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 14 13:01:16.255748 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.policy [None req-06e66d45-9b25-46f5-9bb6-a2b0e2ce9614 tempest-VolumesSnapshotTestJSON-1649574085 tempest-VolumesSnapshotTestJSON-1649574085-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e18311fd2704616a778d36332f199ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1bf776f341b4721b28eb9a5c84ba866', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116064) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 13:01:16.272947 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: INFO nova.api.openstack.requestlog [None req-06e66d45-9b25-46f5-9bb6-a2b0e2ce9614 tempest-VolumesSnapshotTestJSON-1649574085 tempest-VolumesSnapshotTestJSON-1649574085-project] 10.222.0.49 "GET /compute/v2.1/servers/02c92efa-769b-4b6a-94a9-5d059de29e2c" status: 200 len: 1319 microversion: 2.1 time: 0.202090 Dec 14 13:01:16.273704 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: [pid: 116064|app: 0|req: 274/572] 10.222.0.49 () {58 vars in 1235 bytes} [Tue Dec 14 13:01:16 2021] GET /compute/v2.1/servers/02c92efa-769b-4b6a-94a9-5d059de29e2c => generated 1319 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 14 13:01:16.282745 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.api.openstack.wsgi [None req-748463e6-c3ca-4c4b-8b3b-12bd8647f1c9 tempest-AttachVolumeNegativeTest-1000400951 tempest-AttachVolumeNegativeTest-1000400951-project] Calling method '>' {{(pid=116063) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 13:01:16.283599 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.compute.api [None req-748463e6-c3ca-4c4b-8b3b-12bd8647f1c9 tempest-AttachVolumeNegativeTest-1000400951 tempest-AttachVolumeNegativeTest-1000400951-project] [instance: 824eca5b-954f-402d-aa22-14f24ddd77ba] Fetching instance by UUID {{(pid=116063) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 13:01:16.292119 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-748463e6-c3ca-4c4b-8b3b-12bd8647f1c9 tempest-AttachVolumeNegativeTest-1000400951 tempest-AttachVolumeNegativeTest-1000400951-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 13:01:16.293193 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-748463e6-c3ca-4c4b-8b3b-12bd8647f1c9 tempest-AttachVolumeNegativeTest-1000400951 tempest-AttachVolumeNegativeTest-1000400951-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 13:01:16.294557 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-748463e6-c3ca-4c4b-8b3b-12bd8647f1c9 tempest-AttachVolumeNegativeTest-1000400951 tempest-AttachVolumeNegativeTest-1000400951-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 13:01:16.295145 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-748463e6-c3ca-4c4b-8b3b-12bd8647f1c9 tempest-AttachVolumeNegativeTest-1000400951 tempest-AttachVolumeNegativeTest-1000400951-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 13:01:16.480712 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.policy [None req-748463e6-c3ca-4c4b-8b3b-12bd8647f1c9 tempest-AttachVolumeNegativeTest-1000400951 tempest-AttachVolumeNegativeTest-1000400951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57d0ec01f0784c8ea87d339980bed3cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad27b8951cae4eeeafa257f45217653a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116063) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 13:01:16.490432 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: INFO nova.api.openstack.requestlog [None req-748463e6-c3ca-4c4b-8b3b-12bd8647f1c9 tempest-AttachVolumeNegativeTest-1000400951 tempest-AttachVolumeNegativeTest-1000400951-project] 10.222.0.49 "GET /compute/v2.1/servers/824eca5b-954f-402d-aa22-14f24ddd77ba" status: 200 len: 1514 microversion: 2.1 time: 0.210989 Dec 14 13:01:16.491578 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: [pid: 116063|app: 0|req: 299/573] 10.222.0.49 () {58 vars in 1235 bytes} [Tue Dec 14 13:01:16 2021] GET /compute/v2.1/servers/824eca5b-954f-402d-aa22-14f24ddd77ba => generated 1514 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 14 13:01:16.511611 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.api.openstack.wsgi [None req-17f0d0e2-07a6-420d-9668-bda1e9886e2a tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] Calling method '>' {{(pid=116064) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 13:01:16.512509 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.compute.api [None req-17f0d0e2-07a6-420d-9668-bda1e9886e2a tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] [instance: c8de7730-62f2-4a77-b1e9-cf6a74fa366d] Fetching instance by UUID {{(pid=116064) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 13:01:16.520054 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-17f0d0e2-07a6-420d-9668-bda1e9886e2a tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 13:01:16.520970 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-17f0d0e2-07a6-420d-9668-bda1e9886e2a tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 13:01:16.521916 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-17f0d0e2-07a6-420d-9668-bda1e9886e2a tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 13:01:16.523058 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-17f0d0e2-07a6-420d-9668-bda1e9886e2a tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 13:01:16.688997 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.policy [None req-17f0d0e2-07a6-420d-9668-bda1e9886e2a tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79d74a2ea1e541d28d085c15cec34032', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68a8770b8dbe489a8119016fbee64eb5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116064) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 13:01:16.698056 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.policy [None req-17f0d0e2-07a6-420d-9668-bda1e9886e2a tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '79d74a2ea1e541d28d085c15cec34032', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68a8770b8dbe489a8119016fbee64eb5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116064) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 13:01:16.699817 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.policy [None req-17f0d0e2-07a6-420d-9668-bda1e9886e2a tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '79d74a2ea1e541d28d085c15cec34032', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68a8770b8dbe489a8119016fbee64eb5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116064) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 13:01:16.701177 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: INFO nova.api.openstack.requestlog [None req-17f0d0e2-07a6-420d-9668-bda1e9886e2a tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] 10.222.0.49 "GET /compute/v2.1/servers/c8de7730-62f2-4a77-b1e9-cf6a74fa366d" status: 200 len: 1809 microversion: 2.20 time: 0.194143 Dec 14 13:01:16.712332 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: [pid: 116064|app: 0|req: 275/574] 10.222.0.49 () {60 vars in 1276 bytes} [Tue Dec 14 13:01:16 2021] GET /compute/v2.1/servers/c8de7730-62f2-4a77-b1e9-cf6a74fa366d => generated 1809 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 14 13:01:17.205346 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.api.openstack.wsgi [None req-63f3ef51-2977-4ba0-aaca-45046a456341 tempest-ServerRescueNegativeTestJSON-1573931620 tempest-ServerRescueNegativeTestJSON-1573931620-project] Calling method '>' {{(pid=116063) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 13:01:17.205906 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.compute.api [None req-63f3ef51-2977-4ba0-aaca-45046a456341 tempest-ServerRescueNegativeTestJSON-1573931620 tempest-ServerRescueNegativeTestJSON-1573931620-project] [instance: eb6e04a4-8901-47df-9b51-7c1664bd3f6c] Fetching instance by UUID {{(pid=116063) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 13:01:17.212384 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-63f3ef51-2977-4ba0-aaca-45046a456341 tempest-ServerRescueNegativeTestJSON-1573931620 tempest-ServerRescueNegativeTestJSON-1573931620-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 13:01:17.212830 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-63f3ef51-2977-4ba0-aaca-45046a456341 tempest-ServerRescueNegativeTestJSON-1573931620 tempest-ServerRescueNegativeTestJSON-1573931620-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 13:01:17.213626 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-63f3ef51-2977-4ba0-aaca-45046a456341 tempest-ServerRescueNegativeTestJSON-1573931620 tempest-ServerRescueNegativeTestJSON-1573931620-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 13:01:17.214052 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-63f3ef51-2977-4ba0-aaca-45046a456341 tempest-ServerRescueNegativeTestJSON-1573931620 tempest-ServerRescueNegativeTestJSON-1573931620-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 13:01:17.290240 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.api.openstack.wsgi [None req-43c88522-0ebb-4d2a-b87b-78aa01b5f4d4 tempest-VolumesSnapshotTestJSON-1649574085 tempest-VolumesSnapshotTestJSON-1649574085-project] Calling method '>' {{(pid=116064) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 13:01:17.290833 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.compute.api [None req-43c88522-0ebb-4d2a-b87b-78aa01b5f4d4 tempest-VolumesSnapshotTestJSON-1649574085 tempest-VolumesSnapshotTestJSON-1649574085-project] [instance: 02c92efa-769b-4b6a-94a9-5d059de29e2c] Fetching instance by UUID {{(pid=116064) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 13:01:17.297378 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-43c88522-0ebb-4d2a-b87b-78aa01b5f4d4 tempest-VolumesSnapshotTestJSON-1649574085 tempest-VolumesSnapshotTestJSON-1649574085-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 13:01:17.298823 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-43c88522-0ebb-4d2a-b87b-78aa01b5f4d4 tempest-VolumesSnapshotTestJSON-1649574085 tempest-VolumesSnapshotTestJSON-1649574085-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 13:01:17.299616 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-43c88522-0ebb-4d2a-b87b-78aa01b5f4d4 tempest-VolumesSnapshotTestJSON-1649574085 tempest-VolumesSnapshotTestJSON-1649574085-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 13:01:17.300042 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-43c88522-0ebb-4d2a-b87b-78aa01b5f4d4 tempest-VolumesSnapshotTestJSON-1649574085 tempest-VolumesSnapshotTestJSON-1649574085-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 13:01:17.383853 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.policy [None req-63f3ef51-2977-4ba0-aaca-45046a456341 tempest-ServerRescueNegativeTestJSON-1573931620 tempest-ServerRescueNegativeTestJSON-1573931620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '731cbbfe17214ded8ac66299d66dfc45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '010919ea84eb4eb8b936c63153600eba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116063) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 13:01:17.392568 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: INFO nova.api.openstack.requestlog [None req-63f3ef51-2977-4ba0-aaca-45046a456341 tempest-ServerRescueNegativeTestJSON-1573931620 tempest-ServerRescueNegativeTestJSON-1573931620-project] 10.222.0.49 "GET /compute/v2.1/servers/eb6e04a4-8901-47df-9b51-7c1664bd3f6c" status: 200 len: 1569 microversion: 2.1 time: 0.190949 Dec 14 13:01:17.393263 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: [pid: 116063|app: 0|req: 300/575] 10.222.0.49 () {58 vars in 1235 bytes} [Tue Dec 14 13:01:17 2021] GET /compute/v2.1/servers/eb6e04a4-8901-47df-9b51-7c1664bd3f6c => generated 1569 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 14 13:01:17.449518 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.policy [None req-43c88522-0ebb-4d2a-b87b-78aa01b5f4d4 tempest-VolumesSnapshotTestJSON-1649574085 tempest-VolumesSnapshotTestJSON-1649574085-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e18311fd2704616a778d36332f199ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1bf776f341b4721b28eb9a5c84ba866', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116064) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 13:01:17.457320 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: INFO nova.api.openstack.requestlog [None req-43c88522-0ebb-4d2a-b87b-78aa01b5f4d4 tempest-VolumesSnapshotTestJSON-1649574085 tempest-VolumesSnapshotTestJSON-1649574085-project] 10.222.0.49 "GET /compute/v2.1/servers/02c92efa-769b-4b6a-94a9-5d059de29e2c" status: 200 len: 1319 microversion: 2.1 time: 0.170582 Dec 14 13:01:17.457802 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: [pid: 116064|app: 0|req: 276/576] 10.222.0.49 () {58 vars in 1235 bytes} [Tue Dec 14 13:01:17 2021] GET /compute/v2.1/servers/02c92efa-769b-4b6a-94a9-5d059de29e2c => generated 1319 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 14 13:01:17.511183 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.api.openstack.wsgi [None req-c063d78e-24ec-4abd-a59b-a9efa5e6e5a2 tempest-AttachVolumeNegativeTest-1000400951 tempest-AttachVolumeNegativeTest-1000400951-project] Calling method '>' {{(pid=116063) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 13:01:17.512163 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.compute.api [None req-c063d78e-24ec-4abd-a59b-a9efa5e6e5a2 tempest-AttachVolumeNegativeTest-1000400951 tempest-AttachVolumeNegativeTest-1000400951-project] [instance: 824eca5b-954f-402d-aa22-14f24ddd77ba] Fetching instance by UUID {{(pid=116063) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 13:01:17.522439 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-c063d78e-24ec-4abd-a59b-a9efa5e6e5a2 tempest-AttachVolumeNegativeTest-1000400951 tempest-AttachVolumeNegativeTest-1000400951-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 13:01:17.523183 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-c063d78e-24ec-4abd-a59b-a9efa5e6e5a2 tempest-AttachVolumeNegativeTest-1000400951 tempest-AttachVolumeNegativeTest-1000400951-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 13:01:17.524473 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-c063d78e-24ec-4abd-a59b-a9efa5e6e5a2 tempest-AttachVolumeNegativeTest-1000400951 tempest-AttachVolumeNegativeTest-1000400951-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 13:01:17.525261 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-c063d78e-24ec-4abd-a59b-a9efa5e6e5a2 tempest-AttachVolumeNegativeTest-1000400951 tempest-AttachVolumeNegativeTest-1000400951-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 13:01:17.685218 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.policy [None req-c063d78e-24ec-4abd-a59b-a9efa5e6e5a2 tempest-AttachVolumeNegativeTest-1000400951 tempest-AttachVolumeNegativeTest-1000400951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57d0ec01f0784c8ea87d339980bed3cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad27b8951cae4eeeafa257f45217653a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116063) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 13:01:17.692973 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: INFO nova.api.openstack.requestlog [None req-c063d78e-24ec-4abd-a59b-a9efa5e6e5a2 tempest-AttachVolumeNegativeTest-1000400951 tempest-AttachVolumeNegativeTest-1000400951-project] 10.222.0.49 "GET /compute/v2.1/servers/824eca5b-954f-402d-aa22-14f24ddd77ba" status: 200 len: 1514 microversion: 2.1 time: 0.187741 Dec 14 13:01:17.693714 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: [pid: 116063|app: 0|req: 301/577] 10.222.0.49 () {58 vars in 1235 bytes} [Tue Dec 14 13:01:17 2021] GET /compute/v2.1/servers/824eca5b-954f-402d-aa22-14f24ddd77ba => generated 1514 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 14 13:01:17.719694 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.api.openstack.wsgi [None req-d43a03ca-3faa-4876-8e83-ae7580be29f2 tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] Calling method '>' {{(pid=116064) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 13:01:17.720220 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.compute.api [None req-d43a03ca-3faa-4876-8e83-ae7580be29f2 tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] [instance: c8de7730-62f2-4a77-b1e9-cf6a74fa366d] Fetching instance by UUID {{(pid=116064) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 13:01:17.727052 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-d43a03ca-3faa-4876-8e83-ae7580be29f2 tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 13:01:17.727503 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-d43a03ca-3faa-4876-8e83-ae7580be29f2 tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 13:01:17.728297 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-d43a03ca-3faa-4876-8e83-ae7580be29f2 tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 13:01:17.728732 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-d43a03ca-3faa-4876-8e83-ae7580be29f2 tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 13:01:17.883961 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.policy [None req-d43a03ca-3faa-4876-8e83-ae7580be29f2 tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79d74a2ea1e541d28d085c15cec34032', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68a8770b8dbe489a8119016fbee64eb5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116064) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 13:01:17.892893 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.policy [None req-d43a03ca-3faa-4876-8e83-ae7580be29f2 tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '79d74a2ea1e541d28d085c15cec34032', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68a8770b8dbe489a8119016fbee64eb5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116064) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 13:01:17.894426 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.policy [None req-d43a03ca-3faa-4876-8e83-ae7580be29f2 tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '79d74a2ea1e541d28d085c15cec34032', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68a8770b8dbe489a8119016fbee64eb5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116064) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 13:01:17.895570 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: INFO nova.api.openstack.requestlog [None req-d43a03ca-3faa-4876-8e83-ae7580be29f2 tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] 10.222.0.49 "GET /compute/v2.1/servers/c8de7730-62f2-4a77-b1e9-cf6a74fa366d" status: 200 len: 1809 microversion: 2.20 time: 0.179876 Dec 14 13:01:17.896168 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: [pid: 116064|app: 0|req: 277/578] 10.222.0.49 () {60 vars in 1276 bytes} [Tue Dec 14 13:01:17 2021] GET /compute/v2.1/servers/c8de7730-62f2-4a77-b1e9-cf6a74fa366d => generated 1809 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 14 13:01:18.409212 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.api.openstack.wsgi [None req-5ebbbe41-5578-4df5-bc71-d0c0be8974c6 tempest-ServerRescueNegativeTestJSON-1573931620 tempest-ServerRescueNegativeTestJSON-1573931620-project] Calling method '>' {{(pid=116063) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 13:01:18.409850 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.compute.api [None req-5ebbbe41-5578-4df5-bc71-d0c0be8974c6 tempest-ServerRescueNegativeTestJSON-1573931620 tempest-ServerRescueNegativeTestJSON-1573931620-project] [instance: eb6e04a4-8901-47df-9b51-7c1664bd3f6c] Fetching instance by UUID {{(pid=116063) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 13:01:18.416479 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-5ebbbe41-5578-4df5-bc71-d0c0be8974c6 tempest-ServerRescueNegativeTestJSON-1573931620 tempest-ServerRescueNegativeTestJSON-1573931620-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 13:01:18.416988 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-5ebbbe41-5578-4df5-bc71-d0c0be8974c6 tempest-ServerRescueNegativeTestJSON-1573931620 tempest-ServerRescueNegativeTestJSON-1573931620-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 13:01:18.417739 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-5ebbbe41-5578-4df5-bc71-d0c0be8974c6 tempest-ServerRescueNegativeTestJSON-1573931620 tempest-ServerRescueNegativeTestJSON-1573931620-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 13:01:18.418381 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-5ebbbe41-5578-4df5-bc71-d0c0be8974c6 tempest-ServerRescueNegativeTestJSON-1573931620 tempest-ServerRescueNegativeTestJSON-1573931620-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 13:01:18.476396 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.api.openstack.wsgi [None req-a5897caa-22c3-444f-8767-091c2a1e46e0 tempest-VolumesSnapshotTestJSON-1649574085 tempest-VolumesSnapshotTestJSON-1649574085-project] Calling method '>' {{(pid=116064) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 13:01:18.478185 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.compute.api [None req-a5897caa-22c3-444f-8767-091c2a1e46e0 tempest-VolumesSnapshotTestJSON-1649574085 tempest-VolumesSnapshotTestJSON-1649574085-project] [instance: 02c92efa-769b-4b6a-94a9-5d059de29e2c] Fetching instance by UUID {{(pid=116064) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 13:01:18.485214 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-a5897caa-22c3-444f-8767-091c2a1e46e0 tempest-VolumesSnapshotTestJSON-1649574085 tempest-VolumesSnapshotTestJSON-1649574085-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 13:01:18.485911 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-a5897caa-22c3-444f-8767-091c2a1e46e0 tempest-VolumesSnapshotTestJSON-1649574085 tempest-VolumesSnapshotTestJSON-1649574085-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 13:01:18.486722 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-a5897caa-22c3-444f-8767-091c2a1e46e0 tempest-VolumesSnapshotTestJSON-1649574085 tempest-VolumesSnapshotTestJSON-1649574085-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 13:01:18.487149 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-a5897caa-22c3-444f-8767-091c2a1e46e0 tempest-VolumesSnapshotTestJSON-1649574085 tempest-VolumesSnapshotTestJSON-1649574085-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 13:01:18.608742 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.policy [None req-5ebbbe41-5578-4df5-bc71-d0c0be8974c6 tempest-ServerRescueNegativeTestJSON-1573931620 tempest-ServerRescueNegativeTestJSON-1573931620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '731cbbfe17214ded8ac66299d66dfc45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '010919ea84eb4eb8b936c63153600eba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116063) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 13:01:18.618555 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: INFO nova.api.openstack.requestlog [None req-5ebbbe41-5578-4df5-bc71-d0c0be8974c6 tempest-ServerRescueNegativeTestJSON-1573931620 tempest-ServerRescueNegativeTestJSON-1573931620-project] 10.222.0.49 "GET /compute/v2.1/servers/eb6e04a4-8901-47df-9b51-7c1664bd3f6c" status: 200 len: 1569 microversion: 2.1 time: 0.212864 Dec 14 13:01:18.619699 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: [pid: 116063|app: 0|req: 302/579] 10.222.0.49 () {58 vars in 1235 bytes} [Tue Dec 14 13:01:18 2021] GET /compute/v2.1/servers/eb6e04a4-8901-47df-9b51-7c1664bd3f6c => generated 1569 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 14 13:01:18.656211 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.policy [None req-a5897caa-22c3-444f-8767-091c2a1e46e0 tempest-VolumesSnapshotTestJSON-1649574085 tempest-VolumesSnapshotTestJSON-1649574085-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e18311fd2704616a778d36332f199ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1bf776f341b4721b28eb9a5c84ba866', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116064) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 13:01:18.664730 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: INFO nova.api.openstack.requestlog [None req-a5897caa-22c3-444f-8767-091c2a1e46e0 tempest-VolumesSnapshotTestJSON-1649574085 tempest-VolumesSnapshotTestJSON-1649574085-project] 10.222.0.49 "GET /compute/v2.1/servers/02c92efa-769b-4b6a-94a9-5d059de29e2c" status: 200 len: 1319 microversion: 2.1 time: 0.193865 Dec 14 13:01:18.669846 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: [pid: 116064|app: 0|req: 278/580] 10.222.0.49 () {58 vars in 1235 bytes} [Tue Dec 14 13:01:18 2021] GET /compute/v2.1/servers/02c92efa-769b-4b6a-94a9-5d059de29e2c => generated 1319 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 14 13:01:18.709898 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.api.openstack.wsgi [None req-48967fe8-d60e-41bf-9e69-8ec3a76e2137 tempest-AttachVolumeNegativeTest-1000400951 tempest-AttachVolumeNegativeTest-1000400951-project] Calling method '>' {{(pid=116063) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 13:01:18.710506 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.compute.api [None req-48967fe8-d60e-41bf-9e69-8ec3a76e2137 tempest-AttachVolumeNegativeTest-1000400951 tempest-AttachVolumeNegativeTest-1000400951-project] [instance: 824eca5b-954f-402d-aa22-14f24ddd77ba] Fetching instance by UUID {{(pid=116063) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 13:01:18.716634 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-48967fe8-d60e-41bf-9e69-8ec3a76e2137 tempest-AttachVolumeNegativeTest-1000400951 tempest-AttachVolumeNegativeTest-1000400951-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 13:01:18.717105 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-48967fe8-d60e-41bf-9e69-8ec3a76e2137 tempest-AttachVolumeNegativeTest-1000400951 tempest-AttachVolumeNegativeTest-1000400951-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 13:01:18.717932 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-48967fe8-d60e-41bf-9e69-8ec3a76e2137 tempest-AttachVolumeNegativeTest-1000400951 tempest-AttachVolumeNegativeTest-1000400951-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 13:01:18.718346 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-48967fe8-d60e-41bf-9e69-8ec3a76e2137 tempest-AttachVolumeNegativeTest-1000400951 tempest-AttachVolumeNegativeTest-1000400951-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 13:01:18.854879 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.policy [None req-48967fe8-d60e-41bf-9e69-8ec3a76e2137 tempest-AttachVolumeNegativeTest-1000400951 tempest-AttachVolumeNegativeTest-1000400951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57d0ec01f0784c8ea87d339980bed3cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad27b8951cae4eeeafa257f45217653a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116063) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 13:01:18.863473 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: INFO nova.api.openstack.requestlog [None req-48967fe8-d60e-41bf-9e69-8ec3a76e2137 tempest-AttachVolumeNegativeTest-1000400951 tempest-AttachVolumeNegativeTest-1000400951-project] 10.222.0.49 "GET /compute/v2.1/servers/824eca5b-954f-402d-aa22-14f24ddd77ba" status: 200 len: 1514 microversion: 2.1 time: 0.157129 Dec 14 13:01:18.864338 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: [pid: 116063|app: 0|req: 303/581] 10.222.0.49 () {58 vars in 1235 bytes} [Tue Dec 14 13:01:18 2021] GET /compute/v2.1/servers/824eca5b-954f-402d-aa22-14f24ddd77ba => generated 1514 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 14 13:01:18.914149 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.api.openstack.wsgi [None req-aed95720-c5f1-45c5-b9fe-5102cf2f5eb3 tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] Calling method '>' {{(pid=116064) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 13:01:18.914652 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.compute.api [None req-aed95720-c5f1-45c5-b9fe-5102cf2f5eb3 tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] [instance: c8de7730-62f2-4a77-b1e9-cf6a74fa366d] Fetching instance by UUID {{(pid=116064) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 13:01:18.921468 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-aed95720-c5f1-45c5-b9fe-5102cf2f5eb3 tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 13:01:18.921910 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-aed95720-c5f1-45c5-b9fe-5102cf2f5eb3 tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 13:01:18.922678 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-aed95720-c5f1-45c5-b9fe-5102cf2f5eb3 tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 13:01:18.923105 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-aed95720-c5f1-45c5-b9fe-5102cf2f5eb3 tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 13:01:19.062639 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.policy [None req-aed95720-c5f1-45c5-b9fe-5102cf2f5eb3 tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79d74a2ea1e541d28d085c15cec34032', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68a8770b8dbe489a8119016fbee64eb5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116064) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 13:01:19.071327 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.policy [None req-aed95720-c5f1-45c5-b9fe-5102cf2f5eb3 tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '79d74a2ea1e541d28d085c15cec34032', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68a8770b8dbe489a8119016fbee64eb5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116064) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 13:01:19.072806 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.policy [None req-aed95720-c5f1-45c5-b9fe-5102cf2f5eb3 tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '79d74a2ea1e541d28d085c15cec34032', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68a8770b8dbe489a8119016fbee64eb5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116064) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 13:01:19.073992 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: INFO nova.api.openstack.requestlog [None req-aed95720-c5f1-45c5-b9fe-5102cf2f5eb3 tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] 10.222.0.49 "GET /compute/v2.1/servers/c8de7730-62f2-4a77-b1e9-cf6a74fa366d" status: 200 len: 1809 microversion: 2.20 time: 0.163880 Dec 14 13:01:19.074668 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: [pid: 116064|app: 0|req: 279/582] 10.222.0.49 () {60 vars in 1276 bytes} [Tue Dec 14 13:01:18 2021] GET /compute/v2.1/servers/c8de7730-62f2-4a77-b1e9-cf6a74fa366d => generated 1809 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 14 13:01:19.636272 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.api.openstack.wsgi [None req-84f69306-2039-409b-a51d-8b46321d7200 tempest-ServerRescueNegativeTestJSON-1573931620 tempest-ServerRescueNegativeTestJSON-1573931620-project] Calling method '>' {{(pid=116063) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 13:01:19.636926 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.compute.api [None req-84f69306-2039-409b-a51d-8b46321d7200 tempest-ServerRescueNegativeTestJSON-1573931620 tempest-ServerRescueNegativeTestJSON-1573931620-project] [instance: eb6e04a4-8901-47df-9b51-7c1664bd3f6c] Fetching instance by UUID {{(pid=116063) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 13:01:19.643867 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-84f69306-2039-409b-a51d-8b46321d7200 tempest-ServerRescueNegativeTestJSON-1573931620 tempest-ServerRescueNegativeTestJSON-1573931620-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 13:01:19.644331 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-84f69306-2039-409b-a51d-8b46321d7200 tempest-ServerRescueNegativeTestJSON-1573931620 tempest-ServerRescueNegativeTestJSON-1573931620-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 13:01:19.645521 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-84f69306-2039-409b-a51d-8b46321d7200 tempest-ServerRescueNegativeTestJSON-1573931620 tempest-ServerRescueNegativeTestJSON-1573931620-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 13:01:19.645985 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-84f69306-2039-409b-a51d-8b46321d7200 tempest-ServerRescueNegativeTestJSON-1573931620 tempest-ServerRescueNegativeTestJSON-1573931620-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 13:01:19.682578 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.api.openstack.wsgi [None req-3bd2e86e-7e0b-4d14-9c54-f9d30cac3093 tempest-VolumesSnapshotTestJSON-1649574085 tempest-VolumesSnapshotTestJSON-1649574085-project] Calling method '>' {{(pid=116064) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 13:01:19.683942 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.compute.api [None req-3bd2e86e-7e0b-4d14-9c54-f9d30cac3093 tempest-VolumesSnapshotTestJSON-1649574085 tempest-VolumesSnapshotTestJSON-1649574085-project] [instance: 02c92efa-769b-4b6a-94a9-5d059de29e2c] Fetching instance by UUID {{(pid=116064) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 13:01:19.690908 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-3bd2e86e-7e0b-4d14-9c54-f9d30cac3093 tempest-VolumesSnapshotTestJSON-1649574085 tempest-VolumesSnapshotTestJSON-1649574085-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 13:01:19.691857 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-3bd2e86e-7e0b-4d14-9c54-f9d30cac3093 tempest-VolumesSnapshotTestJSON-1649574085 tempest-VolumesSnapshotTestJSON-1649574085-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 13:01:19.693046 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-3bd2e86e-7e0b-4d14-9c54-f9d30cac3093 tempest-VolumesSnapshotTestJSON-1649574085 tempest-VolumesSnapshotTestJSON-1649574085-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 13:01:19.693758 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-3bd2e86e-7e0b-4d14-9c54-f9d30cac3093 tempest-VolumesSnapshotTestJSON-1649574085 tempest-VolumesSnapshotTestJSON-1649574085-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 13:01:19.848529 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.policy [None req-84f69306-2039-409b-a51d-8b46321d7200 tempest-ServerRescueNegativeTestJSON-1573931620 tempest-ServerRescueNegativeTestJSON-1573931620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '731cbbfe17214ded8ac66299d66dfc45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '010919ea84eb4eb8b936c63153600eba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116063) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 13:01:19.858036 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: INFO nova.api.openstack.requestlog [None req-84f69306-2039-409b-a51d-8b46321d7200 tempest-ServerRescueNegativeTestJSON-1573931620 tempest-ServerRescueNegativeTestJSON-1573931620-project] 10.222.0.49 "GET /compute/v2.1/servers/eb6e04a4-8901-47df-9b51-7c1664bd3f6c" status: 200 len: 1569 microversion: 2.1 time: 0.225458 Dec 14 13:01:19.859195 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: [pid: 116063|app: 0|req: 304/583] 10.222.0.49 () {58 vars in 1235 bytes} [Tue Dec 14 13:01:19 2021] GET /compute/v2.1/servers/eb6e04a4-8901-47df-9b51-7c1664bd3f6c => generated 1569 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 14 13:01:19.881926 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.api.openstack.wsgi [None req-cb4c0969-8c6e-4bf7-a869-32b674762c11 tempest-AttachVolumeNegativeTest-1000400951 tempest-AttachVolumeNegativeTest-1000400951-project] Calling method '>' {{(pid=116063) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 13:01:19.883183 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.compute.api [None req-cb4c0969-8c6e-4bf7-a869-32b674762c11 tempest-AttachVolumeNegativeTest-1000400951 tempest-AttachVolumeNegativeTest-1000400951-project] [instance: 824eca5b-954f-402d-aa22-14f24ddd77ba] Fetching instance by UUID {{(pid=116063) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 13:01:19.889768 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.policy [None req-3bd2e86e-7e0b-4d14-9c54-f9d30cac3093 tempest-VolumesSnapshotTestJSON-1649574085 tempest-VolumesSnapshotTestJSON-1649574085-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e18311fd2704616a778d36332f199ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1bf776f341b4721b28eb9a5c84ba866', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116064) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 13:01:19.894849 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-cb4c0969-8c6e-4bf7-a869-32b674762c11 tempest-AttachVolumeNegativeTest-1000400951 tempest-AttachVolumeNegativeTest-1000400951-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 13:01:19.895309 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-cb4c0969-8c6e-4bf7-a869-32b674762c11 tempest-AttachVolumeNegativeTest-1000400951 tempest-AttachVolumeNegativeTest-1000400951-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 13:01:19.896116 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-cb4c0969-8c6e-4bf7-a869-32b674762c11 tempest-AttachVolumeNegativeTest-1000400951 tempest-AttachVolumeNegativeTest-1000400951-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 13:01:19.896549 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-cb4c0969-8c6e-4bf7-a869-32b674762c11 tempest-AttachVolumeNegativeTest-1000400951 tempest-AttachVolumeNegativeTest-1000400951-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 13:01:19.897906 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: INFO nova.api.openstack.requestlog [None req-3bd2e86e-7e0b-4d14-9c54-f9d30cac3093 tempest-VolumesSnapshotTestJSON-1649574085 tempest-VolumesSnapshotTestJSON-1649574085-project] 10.222.0.49 "GET /compute/v2.1/servers/02c92efa-769b-4b6a-94a9-5d059de29e2c" status: 200 len: 1319 microversion: 2.1 time: 0.219144 Dec 14 13:01:19.898500 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: [pid: 116064|app: 0|req: 280/584] 10.222.0.49 () {58 vars in 1235 bytes} [Tue Dec 14 13:01:19 2021] GET /compute/v2.1/servers/02c92efa-769b-4b6a-94a9-5d059de29e2c => generated 1319 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 14 13:01:20.031894 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.policy [None req-cb4c0969-8c6e-4bf7-a869-32b674762c11 tempest-AttachVolumeNegativeTest-1000400951 tempest-AttachVolumeNegativeTest-1000400951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57d0ec01f0784c8ea87d339980bed3cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad27b8951cae4eeeafa257f45217653a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116063) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 13:01:20.042182 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: INFO nova.api.openstack.requestlog [None req-cb4c0969-8c6e-4bf7-a869-32b674762c11 tempest-AttachVolumeNegativeTest-1000400951 tempest-AttachVolumeNegativeTest-1000400951-project] 10.222.0.49 "GET /compute/v2.1/servers/824eca5b-954f-402d-aa22-14f24ddd77ba" status: 200 len: 1514 microversion: 2.1 time: 0.164833 Dec 14 13:01:20.043320 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: [pid: 116063|app: 0|req: 305/585] 10.222.0.49 () {58 vars in 1235 bytes} [Tue Dec 14 13:01:19 2021] GET /compute/v2.1/servers/824eca5b-954f-402d-aa22-14f24ddd77ba => generated 1514 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 14 13:01:20.091946 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.api.openstack.wsgi [None req-b0666abb-adae-44c3-8c30-247418a63228 tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] Calling method '>' {{(pid=116064) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 13:01:20.092777 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.compute.api [None req-b0666abb-adae-44c3-8c30-247418a63228 tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] [instance: c8de7730-62f2-4a77-b1e9-cf6a74fa366d] Fetching instance by UUID {{(pid=116064) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 13:01:20.099297 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-b0666abb-adae-44c3-8c30-247418a63228 tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 13:01:20.099749 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-b0666abb-adae-44c3-8c30-247418a63228 tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 13:01:20.100533 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-b0666abb-adae-44c3-8c30-247418a63228 tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 13:01:20.101003 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-b0666abb-adae-44c3-8c30-247418a63228 tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 13:01:20.237974 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.policy [None req-b0666abb-adae-44c3-8c30-247418a63228 tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79d74a2ea1e541d28d085c15cec34032', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68a8770b8dbe489a8119016fbee64eb5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116064) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 13:01:20.246621 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.policy [None req-b0666abb-adae-44c3-8c30-247418a63228 tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '79d74a2ea1e541d28d085c15cec34032', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68a8770b8dbe489a8119016fbee64eb5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116064) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 13:01:20.248120 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.policy [None req-b0666abb-adae-44c3-8c30-247418a63228 tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '79d74a2ea1e541d28d085c15cec34032', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68a8770b8dbe489a8119016fbee64eb5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116064) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 13:01:20.249359 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: INFO nova.api.openstack.requestlog [None req-b0666abb-adae-44c3-8c30-247418a63228 tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] 10.222.0.49 "GET /compute/v2.1/servers/c8de7730-62f2-4a77-b1e9-cf6a74fa366d" status: 200 len: 1809 microversion: 2.20 time: 0.161195 Dec 14 13:01:20.249921 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: [pid: 116064|app: 0|req: 281/586] 10.222.0.49 () {60 vars in 1276 bytes} [Tue Dec 14 13:01:20 2021] GET /compute/v2.1/servers/c8de7730-62f2-4a77-b1e9-cf6a74fa366d => generated 1809 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 14 13:01:20.885271 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.api.openstack.wsgi [None req-09ad543f-dc65-4583-85f0-afbe9515cbf5 tempest-ServerRescueNegativeTestJSON-1573931620 tempest-ServerRescueNegativeTestJSON-1573931620-project] Calling method '>' {{(pid=116063) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 13:01:20.885271 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.compute.api [None req-09ad543f-dc65-4583-85f0-afbe9515cbf5 tempest-ServerRescueNegativeTestJSON-1573931620 tempest-ServerRescueNegativeTestJSON-1573931620-project] [instance: eb6e04a4-8901-47df-9b51-7c1664bd3f6c] Fetching instance by UUID {{(pid=116063) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 13:01:20.893042 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-09ad543f-dc65-4583-85f0-afbe9515cbf5 tempest-ServerRescueNegativeTestJSON-1573931620 tempest-ServerRescueNegativeTestJSON-1573931620-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 13:01:20.893846 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-09ad543f-dc65-4583-85f0-afbe9515cbf5 tempest-ServerRescueNegativeTestJSON-1573931620 tempest-ServerRescueNegativeTestJSON-1573931620-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 13:01:20.894881 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-09ad543f-dc65-4583-85f0-afbe9515cbf5 tempest-ServerRescueNegativeTestJSON-1573931620 tempest-ServerRescueNegativeTestJSON-1573931620-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 13:01:20.895514 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-09ad543f-dc65-4583-85f0-afbe9515cbf5 tempest-ServerRescueNegativeTestJSON-1573931620 tempest-ServerRescueNegativeTestJSON-1573931620-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 13:01:20.926248 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.api.openstack.wsgi [None req-db5aad19-77ce-4c50-b3d0-19eea3c258c4 tempest-VolumesSnapshotTestJSON-1649574085 tempest-VolumesSnapshotTestJSON-1649574085-project] Calling method '>' {{(pid=116064) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 13:01:20.926899 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.compute.api [None req-db5aad19-77ce-4c50-b3d0-19eea3c258c4 tempest-VolumesSnapshotTestJSON-1649574085 tempest-VolumesSnapshotTestJSON-1649574085-project] [instance: 02c92efa-769b-4b6a-94a9-5d059de29e2c] Fetching instance by UUID {{(pid=116064) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 13:01:20.945855 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-db5aad19-77ce-4c50-b3d0-19eea3c258c4 tempest-VolumesSnapshotTestJSON-1649574085 tempest-VolumesSnapshotTestJSON-1649574085-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 13:01:20.951213 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-db5aad19-77ce-4c50-b3d0-19eea3c258c4 tempest-VolumesSnapshotTestJSON-1649574085 tempest-VolumesSnapshotTestJSON-1649574085-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 13:01:20.952633 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-db5aad19-77ce-4c50-b3d0-19eea3c258c4 tempest-VolumesSnapshotTestJSON-1649574085 tempest-VolumesSnapshotTestJSON-1649574085-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 13:01:20.953263 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-db5aad19-77ce-4c50-b3d0-19eea3c258c4 tempest-VolumesSnapshotTestJSON-1649574085 tempest-VolumesSnapshotTestJSON-1649574085-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 13:01:21.151828 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.policy [None req-09ad543f-dc65-4583-85f0-afbe9515cbf5 tempest-ServerRescueNegativeTestJSON-1573931620 tempest-ServerRescueNegativeTestJSON-1573931620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '731cbbfe17214ded8ac66299d66dfc45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '010919ea84eb4eb8b936c63153600eba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116063) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 13:01:21.165650 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: INFO nova.api.openstack.requestlog [None req-09ad543f-dc65-4583-85f0-afbe9515cbf5 tempest-ServerRescueNegativeTestJSON-1573931620 tempest-ServerRescueNegativeTestJSON-1573931620-project] 10.222.0.49 "GET /compute/v2.1/servers/eb6e04a4-8901-47df-9b51-7c1664bd3f6c" status: 200 len: 1569 microversion: 2.1 time: 0.287131 Dec 14 13:01:21.166325 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: [pid: 116063|app: 0|req: 306/587] 10.222.0.49 () {58 vars in 1235 bytes} [Tue Dec 14 13:01:20 2021] GET /compute/v2.1/servers/eb6e04a4-8901-47df-9b51-7c1664bd3f6c => generated 1569 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 14 13:01:21.176904 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.api.openstack.wsgi [None req-9f6549e5-3978-406c-b475-466cc293d387 tempest-AttachVolumeNegativeTest-1000400951 tempest-AttachVolumeNegativeTest-1000400951-project] Calling method '>' {{(pid=116063) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 13:01:21.177523 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.compute.api [None req-9f6549e5-3978-406c-b475-466cc293d387 tempest-AttachVolumeNegativeTest-1000400951 tempest-AttachVolumeNegativeTest-1000400951-project] [instance: 824eca5b-954f-402d-aa22-14f24ddd77ba] Fetching instance by UUID {{(pid=116063) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 13:01:21.177727 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.policy [None req-db5aad19-77ce-4c50-b3d0-19eea3c258c4 tempest-VolumesSnapshotTestJSON-1649574085 tempest-VolumesSnapshotTestJSON-1649574085-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e18311fd2704616a778d36332f199ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1bf776f341b4721b28eb9a5c84ba866', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116064) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 13:01:21.184904 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-9f6549e5-3978-406c-b475-466cc293d387 tempest-AttachVolumeNegativeTest-1000400951 tempest-AttachVolumeNegativeTest-1000400951-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 13:01:21.184904 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-9f6549e5-3978-406c-b475-466cc293d387 tempest-AttachVolumeNegativeTest-1000400951 tempest-AttachVolumeNegativeTest-1000400951-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 13:01:21.185351 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-9f6549e5-3978-406c-b475-466cc293d387 tempest-AttachVolumeNegativeTest-1000400951 tempest-AttachVolumeNegativeTest-1000400951-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 13:01:21.185791 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-9f6549e5-3978-406c-b475-466cc293d387 tempest-AttachVolumeNegativeTest-1000400951 tempest-AttachVolumeNegativeTest-1000400951-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 13:01:21.188689 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: INFO nova.api.openstack.requestlog [None req-db5aad19-77ce-4c50-b3d0-19eea3c258c4 tempest-VolumesSnapshotTestJSON-1649574085 tempest-VolumesSnapshotTestJSON-1649574085-project] 10.222.0.49 "GET /compute/v2.1/servers/02c92efa-769b-4b6a-94a9-5d059de29e2c" status: 200 len: 1319 microversion: 2.1 time: 0.276010 Dec 14 13:01:21.198524 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: [pid: 116064|app: 0|req: 282/588] 10.222.0.49 () {58 vars in 1235 bytes} [Tue Dec 14 13:01:20 2021] GET /compute/v2.1/servers/02c92efa-769b-4b6a-94a9-5d059de29e2c => generated 1319 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 14 13:01:21.269522 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.api.openstack.wsgi [None req-ede868c9-379e-4ac6-8d09-97e5c9ce206d tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] Calling method '>' {{(pid=116064) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 13:01:21.270674 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.compute.api [None req-ede868c9-379e-4ac6-8d09-97e5c9ce206d tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] [instance: c8de7730-62f2-4a77-b1e9-cf6a74fa366d] Fetching instance by UUID {{(pid=116064) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 13:01:21.277763 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-ede868c9-379e-4ac6-8d09-97e5c9ce206d tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 13:01:21.278279 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-ede868c9-379e-4ac6-8d09-97e5c9ce206d tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 13:01:21.279316 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-ede868c9-379e-4ac6-8d09-97e5c9ce206d tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 13:01:21.279801 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-ede868c9-379e-4ac6-8d09-97e5c9ce206d tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 13:01:21.408426 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.policy [None req-9f6549e5-3978-406c-b475-466cc293d387 tempest-AttachVolumeNegativeTest-1000400951 tempest-AttachVolumeNegativeTest-1000400951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57d0ec01f0784c8ea87d339980bed3cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad27b8951cae4eeeafa257f45217653a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116063) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 13:01:21.415997 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: INFO nova.api.openstack.requestlog [None req-9f6549e5-3978-406c-b475-466cc293d387 tempest-AttachVolumeNegativeTest-1000400951 tempest-AttachVolumeNegativeTest-1000400951-project] 10.222.0.49 "GET /compute/v2.1/servers/824eca5b-954f-402d-aa22-14f24ddd77ba" status: 200 len: 1514 microversion: 2.1 time: 0.248634 Dec 14 13:01:21.429209 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: [pid: 116063|app: 0|req: 307/589] 10.222.0.49 () {58 vars in 1235 bytes} [Tue Dec 14 13:01:21 2021] GET /compute/v2.1/servers/824eca5b-954f-402d-aa22-14f24ddd77ba => generated 1514 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 14 13:01:21.478021 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.policy [None req-ede868c9-379e-4ac6-8d09-97e5c9ce206d tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79d74a2ea1e541d28d085c15cec34032', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68a8770b8dbe489a8119016fbee64eb5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116064) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 13:01:21.486374 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.policy [None req-ede868c9-379e-4ac6-8d09-97e5c9ce206d tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '79d74a2ea1e541d28d085c15cec34032', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68a8770b8dbe489a8119016fbee64eb5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116064) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 13:01:21.487876 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.policy [None req-ede868c9-379e-4ac6-8d09-97e5c9ce206d tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '79d74a2ea1e541d28d085c15cec34032', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68a8770b8dbe489a8119016fbee64eb5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116064) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 13:01:21.489108 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: INFO nova.api.openstack.requestlog [None req-ede868c9-379e-4ac6-8d09-97e5c9ce206d tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] 10.222.0.49 "GET /compute/v2.1/servers/c8de7730-62f2-4a77-b1e9-cf6a74fa366d" status: 200 len: 1809 microversion: 2.20 time: 0.225437 Dec 14 13:01:21.489861 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: [pid: 116064|app: 0|req: 283/590] 10.222.0.49 () {60 vars in 1276 bytes} [Tue Dec 14 13:01:21 2021] GET /compute/v2.1/servers/c8de7730-62f2-4a77-b1e9-cf6a74fa366d => generated 1809 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 14 13:01:22.000398 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.api.openstack.wsgi [req-59bdbeb8-6d52-47a9-a58f-69d1d018521e req-0748e9c0-f61a-4428-870b-9fe3f44c7edd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "02c92efa-769b-4b6a-94a9-5d059de29e2c", "name": "network-vif-plugged", "status": "completed", "tag": "9de9803b-e8e8-4441-a8ab-11f10fdbe375"}]} {{(pid=116063) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 14 13:01:22.002797 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 14 13:01:22.002797 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: warnings.warn(msg) Dec 14 13:01:22.010843 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [req-59bdbeb8-6d52-47a9-a58f-69d1d018521e req-0748e9c0-f61a-4428-870b-9fe3f44c7edd service nova] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 13:01:22.011638 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [req-59bdbeb8-6d52-47a9-a58f-69d1d018521e req-0748e9c0-f61a-4428-870b-9fe3f44c7edd service nova] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 13:01:22.023562 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: INFO nova.api.openstack.compute.server_external_events [req-59bdbeb8-6d52-47a9-a58f-69d1d018521e req-0748e9c0-f61a-4428-870b-9fe3f44c7edd service nova] Creating event network-vif-plugged:9de9803b-e8e8-4441-a8ab-11f10fdbe375 for instance 02c92efa-769b-4b6a-94a9-5d059de29e2c on hv-cinder-78447 Dec 14 13:01:22.029106 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: INFO nova.api.openstack.requestlog [req-59bdbeb8-6d52-47a9-a58f-69d1d018521e req-0748e9c0-f61a-4428-870b-9fe3f44c7edd service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032321 Dec 14 13:01:22.030367 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: [pid: 116063|app: 0|req: 308/591] 10.222.0.49 () {64 vars in 1317 bytes} [Tue Dec 14 13:01:21 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 14 13:01:22.183665 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.api.openstack.wsgi [None req-8984f8c4-9a91-41c8-bea9-5dc7cb7c8b40 tempest-ServerRescueNegativeTestJSON-1573931620 tempest-ServerRescueNegativeTestJSON-1573931620-project] Calling method '>' {{(pid=116064) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 13:01:22.184277 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.compute.api [None req-8984f8c4-9a91-41c8-bea9-5dc7cb7c8b40 tempest-ServerRescueNegativeTestJSON-1573931620 tempest-ServerRescueNegativeTestJSON-1573931620-project] [instance: eb6e04a4-8901-47df-9b51-7c1664bd3f6c] Fetching instance by UUID {{(pid=116064) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 13:01:22.190726 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-8984f8c4-9a91-41c8-bea9-5dc7cb7c8b40 tempest-ServerRescueNegativeTestJSON-1573931620 tempest-ServerRescueNegativeTestJSON-1573931620-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 13:01:22.191174 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-8984f8c4-9a91-41c8-bea9-5dc7cb7c8b40 tempest-ServerRescueNegativeTestJSON-1573931620 tempest-ServerRescueNegativeTestJSON-1573931620-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 13:01:22.191952 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-8984f8c4-9a91-41c8-bea9-5dc7cb7c8b40 tempest-ServerRescueNegativeTestJSON-1573931620 tempest-ServerRescueNegativeTestJSON-1573931620-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 13:01:22.192385 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-8984f8c4-9a91-41c8-bea9-5dc7cb7c8b40 tempest-ServerRescueNegativeTestJSON-1573931620 tempest-ServerRescueNegativeTestJSON-1573931620-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 13:01:22.207787 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.api.openstack.wsgi [None req-a606c67e-9aa5-4be9-a3d1-e4d0ea00d208 tempest-VolumesSnapshotTestJSON-1649574085 tempest-VolumesSnapshotTestJSON-1649574085-project] Calling method '>' {{(pid=116063) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 13:01:22.208594 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.compute.api [None req-a606c67e-9aa5-4be9-a3d1-e4d0ea00d208 tempest-VolumesSnapshotTestJSON-1649574085 tempest-VolumesSnapshotTestJSON-1649574085-project] [instance: 02c92efa-769b-4b6a-94a9-5d059de29e2c] Fetching instance by UUID {{(pid=116063) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 13:01:22.215149 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-a606c67e-9aa5-4be9-a3d1-e4d0ea00d208 tempest-VolumesSnapshotTestJSON-1649574085 tempest-VolumesSnapshotTestJSON-1649574085-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 13:01:22.215962 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-a606c67e-9aa5-4be9-a3d1-e4d0ea00d208 tempest-VolumesSnapshotTestJSON-1649574085 tempest-VolumesSnapshotTestJSON-1649574085-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 13:01:22.216967 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-a606c67e-9aa5-4be9-a3d1-e4d0ea00d208 tempest-VolumesSnapshotTestJSON-1649574085 tempest-VolumesSnapshotTestJSON-1649574085-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 13:01:22.217773 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-a606c67e-9aa5-4be9-a3d1-e4d0ea00d208 tempest-VolumesSnapshotTestJSON-1649574085 tempest-VolumesSnapshotTestJSON-1649574085-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 13:01:22.377275 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.policy [None req-8984f8c4-9a91-41c8-bea9-5dc7cb7c8b40 tempest-ServerRescueNegativeTestJSON-1573931620 tempest-ServerRescueNegativeTestJSON-1573931620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '731cbbfe17214ded8ac66299d66dfc45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '010919ea84eb4eb8b936c63153600eba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116064) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 13:01:22.386111 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: INFO nova.api.openstack.requestlog [None req-8984f8c4-9a91-41c8-bea9-5dc7cb7c8b40 tempest-ServerRescueNegativeTestJSON-1573931620 tempest-ServerRescueNegativeTestJSON-1573931620-project] 10.222.0.49 "GET /compute/v2.1/servers/eb6e04a4-8901-47df-9b51-7c1664bd3f6c" status: 200 len: 1569 microversion: 2.1 time: 0.206050 Dec 14 13:01:22.386890 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: [pid: 116064|app: 0|req: 284/592] 10.222.0.49 () {58 vars in 1235 bytes} [Tue Dec 14 13:01:22 2021] GET /compute/v2.1/servers/eb6e04a4-8901-47df-9b51-7c1664bd3f6c => generated 1569 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 14 13:01:22.423266 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.policy [None req-a606c67e-9aa5-4be9-a3d1-e4d0ea00d208 tempest-VolumesSnapshotTestJSON-1649574085 tempest-VolumesSnapshotTestJSON-1649574085-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e18311fd2704616a778d36332f199ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1bf776f341b4721b28eb9a5c84ba866', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116063) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 13:01:22.440027 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.api.openstack.wsgi [None req-215f4355-8bdd-4613-858e-bf56594a22c1 tempest-AttachVolumeNegativeTest-1000400951 tempest-AttachVolumeNegativeTest-1000400951-project] Calling method '>' {{(pid=116064) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 13:01:22.440779 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: INFO nova.api.openstack.requestlog [None req-a606c67e-9aa5-4be9-a3d1-e4d0ea00d208 tempest-VolumesSnapshotTestJSON-1649574085 tempest-VolumesSnapshotTestJSON-1649574085-project] 10.222.0.49 "GET /compute/v2.1/servers/02c92efa-769b-4b6a-94a9-5d059de29e2c" status: 200 len: 1319 microversion: 2.1 time: 0.237076 Dec 14 13:01:22.441030 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.compute.api [None req-215f4355-8bdd-4613-858e-bf56594a22c1 tempest-AttachVolumeNegativeTest-1000400951 tempest-AttachVolumeNegativeTest-1000400951-project] [instance: 824eca5b-954f-402d-aa22-14f24ddd77ba] Fetching instance by UUID {{(pid=116064) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 13:01:22.442091 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: [pid: 116063|app: 0|req: 309/593] 10.222.0.49 () {58 vars in 1235 bytes} [Tue Dec 14 13:01:22 2021] GET /compute/v2.1/servers/02c92efa-769b-4b6a-94a9-5d059de29e2c => generated 1319 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 14 13:01:22.449971 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-215f4355-8bdd-4613-858e-bf56594a22c1 tempest-AttachVolumeNegativeTest-1000400951 tempest-AttachVolumeNegativeTest-1000400951-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 13:01:22.450877 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-215f4355-8bdd-4613-858e-bf56594a22c1 tempest-AttachVolumeNegativeTest-1000400951 tempest-AttachVolumeNegativeTest-1000400951-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 13:01:22.453947 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-215f4355-8bdd-4613-858e-bf56594a22c1 tempest-AttachVolumeNegativeTest-1000400951 tempest-AttachVolumeNegativeTest-1000400951-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 13:01:22.454759 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-215f4355-8bdd-4613-858e-bf56594a22c1 tempest-AttachVolumeNegativeTest-1000400951 tempest-AttachVolumeNegativeTest-1000400951-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 13:01:22.507439 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.api.openstack.wsgi [None req-3e8ef732-8558-4307-b5cb-dcd44d35d489 tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] Calling method '>' {{(pid=116063) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 13:01:22.508044 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.compute.api [None req-3e8ef732-8558-4307-b5cb-dcd44d35d489 tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] [instance: c8de7730-62f2-4a77-b1e9-cf6a74fa366d] Fetching instance by UUID {{(pid=116063) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 13:01:22.514236 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-3e8ef732-8558-4307-b5cb-dcd44d35d489 tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 13:01:22.514686 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-3e8ef732-8558-4307-b5cb-dcd44d35d489 tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 13:01:22.515471 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-3e8ef732-8558-4307-b5cb-dcd44d35d489 tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 13:01:22.515904 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-3e8ef732-8558-4307-b5cb-dcd44d35d489 tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 13:01:22.626254 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.policy [None req-215f4355-8bdd-4613-858e-bf56594a22c1 tempest-AttachVolumeNegativeTest-1000400951 tempest-AttachVolumeNegativeTest-1000400951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57d0ec01f0784c8ea87d339980bed3cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad27b8951cae4eeeafa257f45217653a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116064) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 13:01:22.633907 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: INFO nova.api.openstack.requestlog [None req-215f4355-8bdd-4613-858e-bf56594a22c1 tempest-AttachVolumeNegativeTest-1000400951 tempest-AttachVolumeNegativeTest-1000400951-project] 10.222.0.49 "GET /compute/v2.1/servers/824eca5b-954f-402d-aa22-14f24ddd77ba" status: 200 len: 1514 microversion: 2.1 time: 0.204333 Dec 14 13:01:22.634449 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: [pid: 116064|app: 0|req: 285/594] 10.222.0.49 () {58 vars in 1235 bytes} [Tue Dec 14 13:01:22 2021] GET /compute/v2.1/servers/824eca5b-954f-402d-aa22-14f24ddd77ba => generated 1514 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 14 13:01:22.711427 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.policy [None req-3e8ef732-8558-4307-b5cb-dcd44d35d489 tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79d74a2ea1e541d28d085c15cec34032', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68a8770b8dbe489a8119016fbee64eb5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116063) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 13:01:22.719971 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.policy [None req-3e8ef732-8558-4307-b5cb-dcd44d35d489 tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '79d74a2ea1e541d28d085c15cec34032', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68a8770b8dbe489a8119016fbee64eb5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116063) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 13:01:22.721553 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.policy [None req-3e8ef732-8558-4307-b5cb-dcd44d35d489 tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '79d74a2ea1e541d28d085c15cec34032', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68a8770b8dbe489a8119016fbee64eb5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116063) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 13:01:22.722718 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: INFO nova.api.openstack.requestlog [None req-3e8ef732-8558-4307-b5cb-dcd44d35d489 tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] 10.222.0.49 "GET /compute/v2.1/servers/c8de7730-62f2-4a77-b1e9-cf6a74fa366d" status: 200 len: 1809 microversion: 2.20 time: 0.219063 Dec 14 13:01:22.723310 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: [pid: 116063|app: 0|req: 310/595] 10.222.0.49 () {60 vars in 1276 bytes} [Tue Dec 14 13:01:22 2021] GET /compute/v2.1/servers/c8de7730-62f2-4a77-b1e9-cf6a74fa366d => generated 1809 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Dec 14 13:01:23.403841 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.api.openstack.wsgi [None req-38b71748-ae2f-4e63-97bd-9969dbccd90e tempest-ServerRescueNegativeTestJSON-1573931620 tempest-ServerRescueNegativeTestJSON-1573931620-project] Calling method '>' {{(pid=116064) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 13:01:23.404505 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.compute.api [None req-38b71748-ae2f-4e63-97bd-9969dbccd90e tempest-ServerRescueNegativeTestJSON-1573931620 tempest-ServerRescueNegativeTestJSON-1573931620-project] [instance: eb6e04a4-8901-47df-9b51-7c1664bd3f6c] Fetching instance by UUID {{(pid=116064) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 13:01:23.411309 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-38b71748-ae2f-4e63-97bd-9969dbccd90e tempest-ServerRescueNegativeTestJSON-1573931620 tempest-ServerRescueNegativeTestJSON-1573931620-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 13:01:23.411754 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-38b71748-ae2f-4e63-97bd-9969dbccd90e tempest-ServerRescueNegativeTestJSON-1573931620 tempest-ServerRescueNegativeTestJSON-1573931620-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 13:01:23.412545 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-38b71748-ae2f-4e63-97bd-9969dbccd90e tempest-ServerRescueNegativeTestJSON-1573931620 tempest-ServerRescueNegativeTestJSON-1573931620-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 13:01:23.413011 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-38b71748-ae2f-4e63-97bd-9969dbccd90e tempest-ServerRescueNegativeTestJSON-1573931620 tempest-ServerRescueNegativeTestJSON-1573931620-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 13:01:23.461588 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.api.openstack.wsgi [None req-32223bdc-d185-4c8f-8dbb-1f7003815362 tempest-VolumesSnapshotTestJSON-1649574085 tempest-VolumesSnapshotTestJSON-1649574085-project] Calling method '>' {{(pid=116063) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 13:01:23.462265 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.compute.api [None req-32223bdc-d185-4c8f-8dbb-1f7003815362 tempest-VolumesSnapshotTestJSON-1649574085 tempest-VolumesSnapshotTestJSON-1649574085-project] [instance: 02c92efa-769b-4b6a-94a9-5d059de29e2c] Fetching instance by UUID {{(pid=116063) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 13:01:23.469203 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-32223bdc-d185-4c8f-8dbb-1f7003815362 tempest-VolumesSnapshotTestJSON-1649574085 tempest-VolumesSnapshotTestJSON-1649574085-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 13:01:23.469933 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-32223bdc-d185-4c8f-8dbb-1f7003815362 tempest-VolumesSnapshotTestJSON-1649574085 tempest-VolumesSnapshotTestJSON-1649574085-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 13:01:23.471205 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-32223bdc-d185-4c8f-8dbb-1f7003815362 tempest-VolumesSnapshotTestJSON-1649574085 tempest-VolumesSnapshotTestJSON-1649574085-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 13:01:23.471791 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-32223bdc-d185-4c8f-8dbb-1f7003815362 tempest-VolumesSnapshotTestJSON-1649574085 tempest-VolumesSnapshotTestJSON-1649574085-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 13:01:23.622909 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.policy [None req-38b71748-ae2f-4e63-97bd-9969dbccd90e tempest-ServerRescueNegativeTestJSON-1573931620 tempest-ServerRescueNegativeTestJSON-1573931620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '731cbbfe17214ded8ac66299d66dfc45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '010919ea84eb4eb8b936c63153600eba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116064) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 13:01:23.631131 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: INFO nova.api.openstack.requestlog [None req-38b71748-ae2f-4e63-97bd-9969dbccd90e tempest-ServerRescueNegativeTestJSON-1573931620 tempest-ServerRescueNegativeTestJSON-1573931620-project] 10.222.0.49 "GET /compute/v2.1/servers/eb6e04a4-8901-47df-9b51-7c1664bd3f6c" status: 200 len: 1569 microversion: 2.1 time: 0.231035 Dec 14 13:01:23.640367 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: [pid: 116064|app: 0|req: 286/596] 10.222.0.49 () {58 vars in 1235 bytes} [Tue Dec 14 13:01:23 2021] GET /compute/v2.1/servers/eb6e04a4-8901-47df-9b51-7c1664bd3f6c => generated 1569 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 14 13:01:23.656578 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.api.openstack.wsgi [None req-309492c2-5ec1-4476-8fc3-5ecfd9d1718f tempest-AttachVolumeNegativeTest-1000400951 tempest-AttachVolumeNegativeTest-1000400951-project] Calling method '>' {{(pid=116064) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 13:01:23.657637 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.compute.api [None req-309492c2-5ec1-4476-8fc3-5ecfd9d1718f tempest-AttachVolumeNegativeTest-1000400951 tempest-AttachVolumeNegativeTest-1000400951-project] [instance: 824eca5b-954f-402d-aa22-14f24ddd77ba] Fetching instance by UUID {{(pid=116064) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 13:01:23.666203 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-309492c2-5ec1-4476-8fc3-5ecfd9d1718f tempest-AttachVolumeNegativeTest-1000400951 tempest-AttachVolumeNegativeTest-1000400951-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 13:01:23.666738 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-309492c2-5ec1-4476-8fc3-5ecfd9d1718f tempest-AttachVolumeNegativeTest-1000400951 tempest-AttachVolumeNegativeTest-1000400951-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 13:01:23.668131 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-309492c2-5ec1-4476-8fc3-5ecfd9d1718f tempest-AttachVolumeNegativeTest-1000400951 tempest-AttachVolumeNegativeTest-1000400951-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 13:01:23.668963 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-309492c2-5ec1-4476-8fc3-5ecfd9d1718f tempest-AttachVolumeNegativeTest-1000400951 tempest-AttachVolumeNegativeTest-1000400951-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 13:01:23.691137 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.policy [None req-32223bdc-d185-4c8f-8dbb-1f7003815362 tempest-VolumesSnapshotTestJSON-1649574085 tempest-VolumesSnapshotTestJSON-1649574085-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e18311fd2704616a778d36332f199ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1bf776f341b4721b28eb9a5c84ba866', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116063) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 13:01:23.702070 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: INFO nova.api.openstack.requestlog [None req-32223bdc-d185-4c8f-8dbb-1f7003815362 tempest-VolumesSnapshotTestJSON-1649574085 tempest-VolumesSnapshotTestJSON-1649574085-project] 10.222.0.49 "GET /compute/v2.1/servers/02c92efa-769b-4b6a-94a9-5d059de29e2c" status: 200 len: 1319 microversion: 2.1 time: 0.247116 Dec 14 13:01:23.714396 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: [pid: 116063|app: 0|req: 311/597] 10.222.0.49 () {58 vars in 1235 bytes} [Tue Dec 14 13:01:23 2021] GET /compute/v2.1/servers/02c92efa-769b-4b6a-94a9-5d059de29e2c => generated 1319 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 14 13:01:23.741137 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.api.openstack.wsgi [None req-27d138eb-177b-4d73-825a-b4e09d0e920e tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] Calling method '>' {{(pid=116063) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 13:01:23.741747 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.compute.api [None req-27d138eb-177b-4d73-825a-b4e09d0e920e tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] [instance: c8de7730-62f2-4a77-b1e9-cf6a74fa366d] Fetching instance by UUID {{(pid=116063) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 13:01:23.753918 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-27d138eb-177b-4d73-825a-b4e09d0e920e tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 13:01:23.754280 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-27d138eb-177b-4d73-825a-b4e09d0e920e tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 13:01:23.755070 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-27d138eb-177b-4d73-825a-b4e09d0e920e tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 13:01:23.763963 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-27d138eb-177b-4d73-825a-b4e09d0e920e tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 13:01:23.813452 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.policy [None req-309492c2-5ec1-4476-8fc3-5ecfd9d1718f tempest-AttachVolumeNegativeTest-1000400951 tempest-AttachVolumeNegativeTest-1000400951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57d0ec01f0784c8ea87d339980bed3cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad27b8951cae4eeeafa257f45217653a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116064) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 13:01:23.820938 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: INFO nova.api.openstack.requestlog [None req-309492c2-5ec1-4476-8fc3-5ecfd9d1718f tempest-AttachVolumeNegativeTest-1000400951 tempest-AttachVolumeNegativeTest-1000400951-project] 10.222.0.49 "GET /compute/v2.1/servers/824eca5b-954f-402d-aa22-14f24ddd77ba" status: 200 len: 1514 microversion: 2.1 time: 0.168208 Dec 14 13:01:23.821514 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: [pid: 116064|app: 0|req: 287/598] 10.222.0.49 () {58 vars in 1235 bytes} [Tue Dec 14 13:01:23 2021] GET /compute/v2.1/servers/824eca5b-954f-402d-aa22-14f24ddd77ba => generated 1514 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 14 13:01:24.127618 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.policy [None req-27d138eb-177b-4d73-825a-b4e09d0e920e tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79d74a2ea1e541d28d085c15cec34032', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68a8770b8dbe489a8119016fbee64eb5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116063) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 13:01:24.140201 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.policy [None req-27d138eb-177b-4d73-825a-b4e09d0e920e tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '79d74a2ea1e541d28d085c15cec34032', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68a8770b8dbe489a8119016fbee64eb5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116063) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 13:01:24.142393 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.policy [None req-27d138eb-177b-4d73-825a-b4e09d0e920e tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '79d74a2ea1e541d28d085c15cec34032', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68a8770b8dbe489a8119016fbee64eb5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116063) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 13:01:24.143578 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: INFO nova.api.openstack.requestlog [None req-27d138eb-177b-4d73-825a-b4e09d0e920e tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] 10.222.0.49 "GET /compute/v2.1/servers/c8de7730-62f2-4a77-b1e9-cf6a74fa366d" status: 200 len: 1809 microversion: 2.20 time: 0.406345 Dec 14 13:01:24.144146 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: [pid: 116063|app: 0|req: 312/599] 10.222.0.49 () {60 vars in 1276 bytes} [Tue Dec 14 13:01:23 2021] GET /compute/v2.1/servers/c8de7730-62f2-4a77-b1e9-cf6a74fa366d => generated 1809 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Dec 14 13:01:24.647732 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.api.openstack.wsgi [None req-ebaf7544-2ef4-4d32-8e13-6b11214607d6 tempest-ServerRescueNegativeTestJSON-1573931620 tempest-ServerRescueNegativeTestJSON-1573931620-project] Calling method '>' {{(pid=116064) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 13:01:24.648384 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.compute.api [None req-ebaf7544-2ef4-4d32-8e13-6b11214607d6 tempest-ServerRescueNegativeTestJSON-1573931620 tempest-ServerRescueNegativeTestJSON-1573931620-project] [instance: eb6e04a4-8901-47df-9b51-7c1664bd3f6c] Fetching instance by UUID {{(pid=116064) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 13:01:24.655816 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-ebaf7544-2ef4-4d32-8e13-6b11214607d6 tempest-ServerRescueNegativeTestJSON-1573931620 tempest-ServerRescueNegativeTestJSON-1573931620-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 13:01:24.656318 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-ebaf7544-2ef4-4d32-8e13-6b11214607d6 tempest-ServerRescueNegativeTestJSON-1573931620 tempest-ServerRescueNegativeTestJSON-1573931620-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 13:01:24.657270 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-ebaf7544-2ef4-4d32-8e13-6b11214607d6 tempest-ServerRescueNegativeTestJSON-1573931620 tempest-ServerRescueNegativeTestJSON-1573931620-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 13:01:24.657729 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-ebaf7544-2ef4-4d32-8e13-6b11214607d6 tempest-ServerRescueNegativeTestJSON-1573931620 tempest-ServerRescueNegativeTestJSON-1573931620-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 13:01:24.727552 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.api.openstack.wsgi [None req-76efe81a-961b-4b50-9ac8-85f728467eca tempest-VolumesSnapshotTestJSON-1649574085 tempest-VolumesSnapshotTestJSON-1649574085-project] Calling method '>' {{(pid=116063) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 13:01:24.729020 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.compute.api [None req-76efe81a-961b-4b50-9ac8-85f728467eca tempest-VolumesSnapshotTestJSON-1649574085 tempest-VolumesSnapshotTestJSON-1649574085-project] [instance: 02c92efa-769b-4b6a-94a9-5d059de29e2c] Fetching instance by UUID {{(pid=116063) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 13:01:24.738446 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-76efe81a-961b-4b50-9ac8-85f728467eca tempest-VolumesSnapshotTestJSON-1649574085 tempest-VolumesSnapshotTestJSON-1649574085-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 13:01:24.740993 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-76efe81a-961b-4b50-9ac8-85f728467eca tempest-VolumesSnapshotTestJSON-1649574085 tempest-VolumesSnapshotTestJSON-1649574085-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 13:01:24.741890 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-76efe81a-961b-4b50-9ac8-85f728467eca tempest-VolumesSnapshotTestJSON-1649574085 tempest-VolumesSnapshotTestJSON-1649574085-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 13:01:24.745419 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-76efe81a-961b-4b50-9ac8-85f728467eca tempest-VolumesSnapshotTestJSON-1649574085 tempest-VolumesSnapshotTestJSON-1649574085-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 13:01:24.900647 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.policy [None req-ebaf7544-2ef4-4d32-8e13-6b11214607d6 tempest-ServerRescueNegativeTestJSON-1573931620 tempest-ServerRescueNegativeTestJSON-1573931620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '731cbbfe17214ded8ac66299d66dfc45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '010919ea84eb4eb8b936c63153600eba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116064) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 13:01:24.909455 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: INFO nova.api.openstack.requestlog [None req-ebaf7544-2ef4-4d32-8e13-6b11214607d6 tempest-ServerRescueNegativeTestJSON-1573931620 tempest-ServerRescueNegativeTestJSON-1573931620-project] 10.222.0.49 "GET /compute/v2.1/servers/eb6e04a4-8901-47df-9b51-7c1664bd3f6c" status: 200 len: 1569 microversion: 2.1 time: 0.265768 Dec 14 13:01:24.910026 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: [pid: 116064|app: 0|req: 288/600] 10.222.0.49 () {58 vars in 1235 bytes} [Tue Dec 14 13:01:24 2021] GET /compute/v2.1/servers/eb6e04a4-8901-47df-9b51-7c1664bd3f6c => generated 1569 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 14 13:01:24.914269 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.api.openstack.wsgi [None req-876282de-f58a-4634-b7a7-23a6446e14f8 tempest-AttachVolumeNegativeTest-1000400951 tempest-AttachVolumeNegativeTest-1000400951-project] Calling method '>' {{(pid=116064) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 13:01:24.914865 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.compute.api [None req-876282de-f58a-4634-b7a7-23a6446e14f8 tempest-AttachVolumeNegativeTest-1000400951 tempest-AttachVolumeNegativeTest-1000400951-project] [instance: 824eca5b-954f-402d-aa22-14f24ddd77ba] Fetching instance by UUID {{(pid=116064) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 13:01:24.925331 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-876282de-f58a-4634-b7a7-23a6446e14f8 tempest-AttachVolumeNegativeTest-1000400951 tempest-AttachVolumeNegativeTest-1000400951-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 13:01:24.926081 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-876282de-f58a-4634-b7a7-23a6446e14f8 tempest-AttachVolumeNegativeTest-1000400951 tempest-AttachVolumeNegativeTest-1000400951-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 13:01:24.929276 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-876282de-f58a-4634-b7a7-23a6446e14f8 tempest-AttachVolumeNegativeTest-1000400951 tempest-AttachVolumeNegativeTest-1000400951-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 13:01:24.930045 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-876282de-f58a-4634-b7a7-23a6446e14f8 tempest-AttachVolumeNegativeTest-1000400951 tempest-AttachVolumeNegativeTest-1000400951-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 13:01:24.992510 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.policy [None req-76efe81a-961b-4b50-9ac8-85f728467eca tempest-VolumesSnapshotTestJSON-1649574085 tempest-VolumesSnapshotTestJSON-1649574085-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e18311fd2704616a778d36332f199ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1bf776f341b4721b28eb9a5c84ba866', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116063) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 13:01:25.002425 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: INFO nova.api.openstack.requestlog [None req-76efe81a-961b-4b50-9ac8-85f728467eca tempest-VolumesSnapshotTestJSON-1649574085 tempest-VolumesSnapshotTestJSON-1649574085-project] 10.222.0.49 "GET /compute/v2.1/servers/02c92efa-769b-4b6a-94a9-5d059de29e2c" status: 200 len: 1319 microversion: 2.1 time: 0.279251 Dec 14 13:01:25.003046 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: [pid: 116063|app: 0|req: 313/601] 10.222.0.49 () {58 vars in 1235 bytes} [Tue Dec 14 13:01:24 2021] GET /compute/v2.1/servers/02c92efa-769b-4b6a-94a9-5d059de29e2c => generated 1319 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 14 13:01:25.100294 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.policy [None req-876282de-f58a-4634-b7a7-23a6446e14f8 tempest-AttachVolumeNegativeTest-1000400951 tempest-AttachVolumeNegativeTest-1000400951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57d0ec01f0784c8ea87d339980bed3cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad27b8951cae4eeeafa257f45217653a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116064) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 13:01:25.107700 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: INFO nova.api.openstack.requestlog [None req-876282de-f58a-4634-b7a7-23a6446e14f8 tempest-AttachVolumeNegativeTest-1000400951 tempest-AttachVolumeNegativeTest-1000400951-project] 10.222.0.49 "GET /compute/v2.1/servers/824eca5b-954f-402d-aa22-14f24ddd77ba" status: 200 len: 1514 microversion: 2.1 time: 0.196708 Dec 14 13:01:25.108268 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: [pid: 116064|app: 0|req: 289/602] 10.222.0.49 () {58 vars in 1235 bytes} [Tue Dec 14 13:01:24 2021] GET /compute/v2.1/servers/824eca5b-954f-402d-aa22-14f24ddd77ba => generated 1514 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 14 13:01:25.162515 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.api.openstack.wsgi [None req-eaac9f99-b49d-4a03-b532-80a469a96fe0 tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] Calling method '>' {{(pid=116063) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 13:01:25.163788 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.compute.api [None req-eaac9f99-b49d-4a03-b532-80a469a96fe0 tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] [instance: c8de7730-62f2-4a77-b1e9-cf6a74fa366d] Fetching instance by UUID {{(pid=116063) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 13:01:25.171396 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-eaac9f99-b49d-4a03-b532-80a469a96fe0 tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 13:01:25.171929 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-eaac9f99-b49d-4a03-b532-80a469a96fe0 tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 13:01:25.172792 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-eaac9f99-b49d-4a03-b532-80a469a96fe0 tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 13:01:25.173265 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-eaac9f99-b49d-4a03-b532-80a469a96fe0 tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 13:01:25.313245 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.policy [None req-eaac9f99-b49d-4a03-b532-80a469a96fe0 tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79d74a2ea1e541d28d085c15cec34032', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68a8770b8dbe489a8119016fbee64eb5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116063) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 13:01:25.321558 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.policy [None req-eaac9f99-b49d-4a03-b532-80a469a96fe0 tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '79d74a2ea1e541d28d085c15cec34032', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68a8770b8dbe489a8119016fbee64eb5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116063) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 13:01:25.323065 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.policy [None req-eaac9f99-b49d-4a03-b532-80a469a96fe0 tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '79d74a2ea1e541d28d085c15cec34032', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68a8770b8dbe489a8119016fbee64eb5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116063) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 13:01:25.324226 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: INFO nova.api.openstack.requestlog [None req-eaac9f99-b49d-4a03-b532-80a469a96fe0 tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] 10.222.0.49 "GET /compute/v2.1/servers/c8de7730-62f2-4a77-b1e9-cf6a74fa366d" status: 200 len: 1809 microversion: 2.20 time: 0.165526 Dec 14 13:01:25.324795 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: [pid: 116063|app: 0|req: 314/603] 10.222.0.49 () {60 vars in 1276 bytes} [Tue Dec 14 13:01:25 2021] GET /compute/v2.1/servers/c8de7730-62f2-4a77-b1e9-cf6a74fa366d => generated 1809 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 14 13:01:25.927001 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.api.openstack.wsgi [None req-afb853c3-96dc-4c5a-acdd-72a2ca89656e tempest-ServerRescueNegativeTestJSON-1573931620 tempest-ServerRescueNegativeTestJSON-1573931620-project] Calling method '>' {{(pid=116064) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 13:01:25.927659 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.compute.api [None req-afb853c3-96dc-4c5a-acdd-72a2ca89656e tempest-ServerRescueNegativeTestJSON-1573931620 tempest-ServerRescueNegativeTestJSON-1573931620-project] [instance: eb6e04a4-8901-47df-9b51-7c1664bd3f6c] Fetching instance by UUID {{(pid=116064) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 13:01:25.933895 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-afb853c3-96dc-4c5a-acdd-72a2ca89656e tempest-ServerRescueNegativeTestJSON-1573931620 tempest-ServerRescueNegativeTestJSON-1573931620-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 13:01:25.934554 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-afb853c3-96dc-4c5a-acdd-72a2ca89656e tempest-ServerRescueNegativeTestJSON-1573931620 tempest-ServerRescueNegativeTestJSON-1573931620-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 13:01:25.935515 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-afb853c3-96dc-4c5a-acdd-72a2ca89656e tempest-ServerRescueNegativeTestJSON-1573931620 tempest-ServerRescueNegativeTestJSON-1573931620-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 13:01:25.935987 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-afb853c3-96dc-4c5a-acdd-72a2ca89656e tempest-ServerRescueNegativeTestJSON-1573931620 tempest-ServerRescueNegativeTestJSON-1573931620-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 13:01:26.020187 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.api.openstack.wsgi [None req-a8930513-4a99-4eb9-aff4-552634ec26d0 tempest-VolumesSnapshotTestJSON-1649574085 tempest-VolumesSnapshotTestJSON-1649574085-project] Calling method '>' {{(pid=116063) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 13:01:26.020830 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.compute.api [None req-a8930513-4a99-4eb9-aff4-552634ec26d0 tempest-VolumesSnapshotTestJSON-1649574085 tempest-VolumesSnapshotTestJSON-1649574085-project] [instance: 02c92efa-769b-4b6a-94a9-5d059de29e2c] Fetching instance by UUID {{(pid=116063) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 13:01:26.027055 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-a8930513-4a99-4eb9-aff4-552634ec26d0 tempest-VolumesSnapshotTestJSON-1649574085 tempest-VolumesSnapshotTestJSON-1649574085-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 13:01:26.027497 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-a8930513-4a99-4eb9-aff4-552634ec26d0 tempest-VolumesSnapshotTestJSON-1649574085 tempest-VolumesSnapshotTestJSON-1649574085-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 13:01:26.028273 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-a8930513-4a99-4eb9-aff4-552634ec26d0 tempest-VolumesSnapshotTestJSON-1649574085 tempest-VolumesSnapshotTestJSON-1649574085-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 13:01:26.028699 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-a8930513-4a99-4eb9-aff4-552634ec26d0 tempest-VolumesSnapshotTestJSON-1649574085 tempest-VolumesSnapshotTestJSON-1649574085-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 13:01:26.087753 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.policy [None req-afb853c3-96dc-4c5a-acdd-72a2ca89656e tempest-ServerRescueNegativeTestJSON-1573931620 tempest-ServerRescueNegativeTestJSON-1573931620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '731cbbfe17214ded8ac66299d66dfc45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '010919ea84eb4eb8b936c63153600eba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116064) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 13:01:26.096630 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: INFO nova.api.openstack.requestlog [None req-afb853c3-96dc-4c5a-acdd-72a2ca89656e tempest-ServerRescueNegativeTestJSON-1573931620 tempest-ServerRescueNegativeTestJSON-1573931620-project] 10.222.0.49 "GET /compute/v2.1/servers/eb6e04a4-8901-47df-9b51-7c1664bd3f6c" status: 200 len: 1569 microversion: 2.1 time: 0.173523 Dec 14 13:01:26.100068 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: [pid: 116064|app: 0|req: 290/604] 10.222.0.49 () {58 vars in 1235 bytes} [Tue Dec 14 13:01:25 2021] GET /compute/v2.1/servers/eb6e04a4-8901-47df-9b51-7c1664bd3f6c => generated 1569 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 14 13:01:26.123714 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.api.openstack.wsgi [None req-2dfa1984-2fe7-4c20-ac87-47ccda8fd800 tempest-AttachVolumeNegativeTest-1000400951 tempest-AttachVolumeNegativeTest-1000400951-project] Calling method '>' {{(pid=116064) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 13:01:26.124615 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.compute.api [None req-2dfa1984-2fe7-4c20-ac87-47ccda8fd800 tempest-AttachVolumeNegativeTest-1000400951 tempest-AttachVolumeNegativeTest-1000400951-project] [instance: 824eca5b-954f-402d-aa22-14f24ddd77ba] Fetching instance by UUID {{(pid=116064) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 13:01:26.131346 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-2dfa1984-2fe7-4c20-ac87-47ccda8fd800 tempest-AttachVolumeNegativeTest-1000400951 tempest-AttachVolumeNegativeTest-1000400951-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 13:01:26.132072 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-2dfa1984-2fe7-4c20-ac87-47ccda8fd800 tempest-AttachVolumeNegativeTest-1000400951 tempest-AttachVolumeNegativeTest-1000400951-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 13:01:26.133085 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-2dfa1984-2fe7-4c20-ac87-47ccda8fd800 tempest-AttachVolumeNegativeTest-1000400951 tempest-AttachVolumeNegativeTest-1000400951-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 13:01:26.133855 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-2dfa1984-2fe7-4c20-ac87-47ccda8fd800 tempest-AttachVolumeNegativeTest-1000400951 tempest-AttachVolumeNegativeTest-1000400951-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 13:01:26.306648 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.policy [None req-a8930513-4a99-4eb9-aff4-552634ec26d0 tempest-VolumesSnapshotTestJSON-1649574085 tempest-VolumesSnapshotTestJSON-1649574085-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e18311fd2704616a778d36332f199ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1bf776f341b4721b28eb9a5c84ba866', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116063) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 13:01:26.314720 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: INFO nova.api.openstack.requestlog [None req-a8930513-4a99-4eb9-aff4-552634ec26d0 tempest-VolumesSnapshotTestJSON-1649574085 tempest-VolumesSnapshotTestJSON-1649574085-project] 10.222.0.49 "GET /compute/v2.1/servers/02c92efa-769b-4b6a-94a9-5d059de29e2c" status: 200 len: 1319 microversion: 2.1 time: 0.298328 Dec 14 13:01:26.315470 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: [pid: 116063|app: 0|req: 315/605] 10.222.0.49 () {58 vars in 1235 bytes} [Tue Dec 14 13:01:26 2021] GET /compute/v2.1/servers/02c92efa-769b-4b6a-94a9-5d059de29e2c => generated 1319 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 14 13:01:26.343992 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.api.openstack.wsgi [None req-311dfc53-fe46-4416-84c8-559e13363044 tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] Calling method '>' {{(pid=116063) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 13:01:26.345158 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.compute.api [None req-311dfc53-fe46-4416-84c8-559e13363044 tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] [instance: c8de7730-62f2-4a77-b1e9-cf6a74fa366d] Fetching instance by UUID {{(pid=116063) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 13:01:26.368402 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-311dfc53-fe46-4416-84c8-559e13363044 tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 13:01:26.370754 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-311dfc53-fe46-4416-84c8-559e13363044 tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 13:01:26.371935 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-311dfc53-fe46-4416-84c8-559e13363044 tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 13:01:26.385739 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-311dfc53-fe46-4416-84c8-559e13363044 tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 13:01:26.411976 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.policy [None req-2dfa1984-2fe7-4c20-ac87-47ccda8fd800 tempest-AttachVolumeNegativeTest-1000400951 tempest-AttachVolumeNegativeTest-1000400951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57d0ec01f0784c8ea87d339980bed3cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad27b8951cae4eeeafa257f45217653a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116064) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 13:01:26.419482 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: INFO nova.api.openstack.requestlog [None req-2dfa1984-2fe7-4c20-ac87-47ccda8fd800 tempest-AttachVolumeNegativeTest-1000400951 tempest-AttachVolumeNegativeTest-1000400951-project] 10.222.0.49 "GET /compute/v2.1/servers/824eca5b-954f-402d-aa22-14f24ddd77ba" status: 200 len: 1514 microversion: 2.1 time: 0.299669 Dec 14 13:01:26.420882 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: [pid: 116064|app: 0|req: 291/606] 10.222.0.49 () {58 vars in 1235 bytes} [Tue Dec 14 13:01:26 2021] GET /compute/v2.1/servers/824eca5b-954f-402d-aa22-14f24ddd77ba => generated 1514 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 14 13:01:26.560381 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.policy [None req-311dfc53-fe46-4416-84c8-559e13363044 tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79d74a2ea1e541d28d085c15cec34032', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68a8770b8dbe489a8119016fbee64eb5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116063) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 13:01:26.570226 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.policy [None req-311dfc53-fe46-4416-84c8-559e13363044 tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '79d74a2ea1e541d28d085c15cec34032', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68a8770b8dbe489a8119016fbee64eb5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116063) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 13:01:26.572622 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.policy [None req-311dfc53-fe46-4416-84c8-559e13363044 tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '79d74a2ea1e541d28d085c15cec34032', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68a8770b8dbe489a8119016fbee64eb5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116063) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 13:01:26.574294 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: INFO nova.api.openstack.requestlog [None req-311dfc53-fe46-4416-84c8-559e13363044 tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] 10.222.0.49 "GET /compute/v2.1/servers/c8de7730-62f2-4a77-b1e9-cf6a74fa366d" status: 200 len: 1809 microversion: 2.20 time: 0.234481 Dec 14 13:01:26.575084 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: [pid: 116063|app: 0|req: 316/607] 10.222.0.49 () {60 vars in 1276 bytes} [Tue Dec 14 13:01:26 2021] GET /compute/v2.1/servers/c8de7730-62f2-4a77-b1e9-cf6a74fa366d => generated 1809 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Dec 14 13:01:27.116795 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.api.openstack.wsgi [None req-f3cbbe41-78a1-4560-b904-576ef5fed3cc tempest-ServerRescueNegativeTestJSON-1573931620 tempest-ServerRescueNegativeTestJSON-1573931620-project] Calling method '>' {{(pid=116064) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 13:01:27.117425 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.compute.api [None req-f3cbbe41-78a1-4560-b904-576ef5fed3cc tempest-ServerRescueNegativeTestJSON-1573931620 tempest-ServerRescueNegativeTestJSON-1573931620-project] [instance: eb6e04a4-8901-47df-9b51-7c1664bd3f6c] Fetching instance by UUID {{(pid=116064) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 13:01:27.127914 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-f3cbbe41-78a1-4560-b904-576ef5fed3cc tempest-ServerRescueNegativeTestJSON-1573931620 tempest-ServerRescueNegativeTestJSON-1573931620-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 13:01:27.135505 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-f3cbbe41-78a1-4560-b904-576ef5fed3cc tempest-ServerRescueNegativeTestJSON-1573931620 tempest-ServerRescueNegativeTestJSON-1573931620-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 13:01:27.136426 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-f3cbbe41-78a1-4560-b904-576ef5fed3cc tempest-ServerRescueNegativeTestJSON-1573931620 tempest-ServerRescueNegativeTestJSON-1573931620-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 13:01:27.136909 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-f3cbbe41-78a1-4560-b904-576ef5fed3cc tempest-ServerRescueNegativeTestJSON-1573931620 tempest-ServerRescueNegativeTestJSON-1573931620-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 13:01:27.322842 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.policy [None req-f3cbbe41-78a1-4560-b904-576ef5fed3cc tempest-ServerRescueNegativeTestJSON-1573931620 tempest-ServerRescueNegativeTestJSON-1573931620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '731cbbfe17214ded8ac66299d66dfc45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '010919ea84eb4eb8b936c63153600eba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116064) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 13:01:27.335040 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.api.openstack.wsgi [None req-4b0a6c35-d040-422b-b3ee-969ec8b23fb1 tempest-VolumesSnapshotTestJSON-1649574085 tempest-VolumesSnapshotTestJSON-1649574085-project] Calling method '>' {{(pid=116063) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 13:01:27.336913 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.compute.api [None req-4b0a6c35-d040-422b-b3ee-969ec8b23fb1 tempest-VolumesSnapshotTestJSON-1649574085 tempest-VolumesSnapshotTestJSON-1649574085-project] [instance: 02c92efa-769b-4b6a-94a9-5d059de29e2c] Fetching instance by UUID {{(pid=116063) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 13:01:27.356888 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: INFO nova.api.openstack.requestlog [None req-f3cbbe41-78a1-4560-b904-576ef5fed3cc tempest-ServerRescueNegativeTestJSON-1573931620 tempest-ServerRescueNegativeTestJSON-1573931620-project] 10.222.0.49 "GET /compute/v2.1/servers/eb6e04a4-8901-47df-9b51-7c1664bd3f6c" status: 200 len: 1569 microversion: 2.1 time: 0.245017 Dec 14 13:01:27.359174 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: [pid: 116064|app: 0|req: 292/608] 10.222.0.49 () {58 vars in 1235 bytes} [Tue Dec 14 13:01:27 2021] GET /compute/v2.1/servers/eb6e04a4-8901-47df-9b51-7c1664bd3f6c => generated 1569 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 14 13:01:27.370507 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-4b0a6c35-d040-422b-b3ee-969ec8b23fb1 tempest-VolumesSnapshotTestJSON-1649574085 tempest-VolumesSnapshotTestJSON-1649574085-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 13:01:27.371623 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-4b0a6c35-d040-422b-b3ee-969ec8b23fb1 tempest-VolumesSnapshotTestJSON-1649574085 tempest-VolumesSnapshotTestJSON-1649574085-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 13:01:27.372596 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-4b0a6c35-d040-422b-b3ee-969ec8b23fb1 tempest-VolumesSnapshotTestJSON-1649574085 tempest-VolumesSnapshotTestJSON-1649574085-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 13:01:27.373264 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-4b0a6c35-d040-422b-b3ee-969ec8b23fb1 tempest-VolumesSnapshotTestJSON-1649574085 tempest-VolumesSnapshotTestJSON-1649574085-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 13:01:27.437747 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.api.openstack.wsgi [None req-ae264f3e-9e91-47e0-88e0-e3fc430200be tempest-AttachVolumeNegativeTest-1000400951 tempest-AttachVolumeNegativeTest-1000400951-project] Calling method '>' {{(pid=116064) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 13:01:27.438711 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.compute.api [None req-ae264f3e-9e91-47e0-88e0-e3fc430200be tempest-AttachVolumeNegativeTest-1000400951 tempest-AttachVolumeNegativeTest-1000400951-project] [instance: 824eca5b-954f-402d-aa22-14f24ddd77ba] Fetching instance by UUID {{(pid=116064) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 13:01:27.447044 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-ae264f3e-9e91-47e0-88e0-e3fc430200be tempest-AttachVolumeNegativeTest-1000400951 tempest-AttachVolumeNegativeTest-1000400951-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 13:01:27.448405 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-ae264f3e-9e91-47e0-88e0-e3fc430200be tempest-AttachVolumeNegativeTest-1000400951 tempest-AttachVolumeNegativeTest-1000400951-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 13:01:27.453446 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-ae264f3e-9e91-47e0-88e0-e3fc430200be tempest-AttachVolumeNegativeTest-1000400951 tempest-AttachVolumeNegativeTest-1000400951-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 13:01:27.456187 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-ae264f3e-9e91-47e0-88e0-e3fc430200be tempest-AttachVolumeNegativeTest-1000400951 tempest-AttachVolumeNegativeTest-1000400951-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 13:01:27.667500 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.policy [None req-4b0a6c35-d040-422b-b3ee-969ec8b23fb1 tempest-VolumesSnapshotTestJSON-1649574085 tempest-VolumesSnapshotTestJSON-1649574085-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e18311fd2704616a778d36332f199ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1bf776f341b4721b28eb9a5c84ba866', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116063) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 13:01:27.679492 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: INFO nova.api.openstack.requestlog [None req-4b0a6c35-d040-422b-b3ee-969ec8b23fb1 tempest-VolumesSnapshotTestJSON-1649574085 tempest-VolumesSnapshotTestJSON-1649574085-project] 10.222.0.49 "GET /compute/v2.1/servers/02c92efa-769b-4b6a-94a9-5d059de29e2c" status: 200 len: 1319 microversion: 2.1 time: 0.351614 Dec 14 13:01:27.688713 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: [pid: 116063|app: 0|req: 317/609] 10.222.0.49 () {58 vars in 1235 bytes} [Tue Dec 14 13:01:27 2021] GET /compute/v2.1/servers/02c92efa-769b-4b6a-94a9-5d059de29e2c => generated 1319 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 14 13:01:27.688713 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.api.openstack.wsgi [None req-94a0f14c-8237-4fcf-aa4a-000dbb4704af tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] Calling method '>' {{(pid=116063) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 13:01:27.688713 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.compute.api [None req-94a0f14c-8237-4fcf-aa4a-000dbb4704af tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] [instance: c8de7730-62f2-4a77-b1e9-cf6a74fa366d] Fetching instance by UUID {{(pid=116063) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 13:01:27.700771 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-94a0f14c-8237-4fcf-aa4a-000dbb4704af tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 13:01:27.701272 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-94a0f14c-8237-4fcf-aa4a-000dbb4704af tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 13:01:27.705498 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-94a0f14c-8237-4fcf-aa4a-000dbb4704af tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 13:01:27.706715 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-94a0f14c-8237-4fcf-aa4a-000dbb4704af tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 13:01:27.733955 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.policy [None req-ae264f3e-9e91-47e0-88e0-e3fc430200be tempest-AttachVolumeNegativeTest-1000400951 tempest-AttachVolumeNegativeTest-1000400951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57d0ec01f0784c8ea87d339980bed3cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad27b8951cae4eeeafa257f45217653a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116064) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 13:01:27.753492 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: INFO nova.api.openstack.requestlog [None req-ae264f3e-9e91-47e0-88e0-e3fc430200be tempest-AttachVolumeNegativeTest-1000400951 tempest-AttachVolumeNegativeTest-1000400951-project] 10.222.0.49 "GET /compute/v2.1/servers/824eca5b-954f-402d-aa22-14f24ddd77ba" status: 200 len: 1514 microversion: 2.1 time: 0.317872 Dec 14 13:01:27.764305 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: [pid: 116064|app: 0|req: 293/610] 10.222.0.49 () {58 vars in 1235 bytes} [Tue Dec 14 13:01:27 2021] GET /compute/v2.1/servers/824eca5b-954f-402d-aa22-14f24ddd77ba => generated 1514 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 14 13:01:27.885185 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.policy [None req-94a0f14c-8237-4fcf-aa4a-000dbb4704af tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79d74a2ea1e541d28d085c15cec34032', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68a8770b8dbe489a8119016fbee64eb5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116063) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 13:01:27.894744 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.policy [None req-94a0f14c-8237-4fcf-aa4a-000dbb4704af tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '79d74a2ea1e541d28d085c15cec34032', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68a8770b8dbe489a8119016fbee64eb5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116063) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 13:01:27.896643 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.policy [None req-94a0f14c-8237-4fcf-aa4a-000dbb4704af tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '79d74a2ea1e541d28d085c15cec34032', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68a8770b8dbe489a8119016fbee64eb5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116063) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 13:01:27.898115 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: INFO nova.api.openstack.requestlog [None req-94a0f14c-8237-4fcf-aa4a-000dbb4704af tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] 10.222.0.49 "GET /compute/v2.1/servers/c8de7730-62f2-4a77-b1e9-cf6a74fa366d" status: 200 len: 1809 microversion: 2.20 time: 0.217064 Dec 14 13:01:27.908942 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: [pid: 116063|app: 0|req: 318/611] 10.222.0.49 () {60 vars in 1276 bytes} [Tue Dec 14 13:01:27 2021] GET /compute/v2.1/servers/c8de7730-62f2-4a77-b1e9-cf6a74fa366d => generated 1809 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 14 13:01:28.381770 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.api.openstack.wsgi [None req-30c6664a-0a7f-4fa3-858b-1a0019b455a5 tempest-ServerRescueNegativeTestJSON-1573931620 tempest-ServerRescueNegativeTestJSON-1573931620-project] Calling method '>' {{(pid=116064) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 13:01:28.382769 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.compute.api [None req-30c6664a-0a7f-4fa3-858b-1a0019b455a5 tempest-ServerRescueNegativeTestJSON-1573931620 tempest-ServerRescueNegativeTestJSON-1573931620-project] [instance: eb6e04a4-8901-47df-9b51-7c1664bd3f6c] Fetching instance by UUID {{(pid=116064) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 13:01:28.393833 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-30c6664a-0a7f-4fa3-858b-1a0019b455a5 tempest-ServerRescueNegativeTestJSON-1573931620 tempest-ServerRescueNegativeTestJSON-1573931620-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 13:01:28.394281 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-30c6664a-0a7f-4fa3-858b-1a0019b455a5 tempest-ServerRescueNegativeTestJSON-1573931620 tempest-ServerRescueNegativeTestJSON-1573931620-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 13:01:28.395721 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-30c6664a-0a7f-4fa3-858b-1a0019b455a5 tempest-ServerRescueNegativeTestJSON-1573931620 tempest-ServerRescueNegativeTestJSON-1573931620-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 13:01:28.396177 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-30c6664a-0a7f-4fa3-858b-1a0019b455a5 tempest-ServerRescueNegativeTestJSON-1573931620 tempest-ServerRescueNegativeTestJSON-1573931620-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 13:01:28.529445 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.policy [None req-30c6664a-0a7f-4fa3-858b-1a0019b455a5 tempest-ServerRescueNegativeTestJSON-1573931620 tempest-ServerRescueNegativeTestJSON-1573931620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '731cbbfe17214ded8ac66299d66dfc45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '010919ea84eb4eb8b936c63153600eba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116064) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 13:01:28.537686 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: INFO nova.api.openstack.requestlog [None req-30c6664a-0a7f-4fa3-858b-1a0019b455a5 tempest-ServerRescueNegativeTestJSON-1573931620 tempest-ServerRescueNegativeTestJSON-1573931620-project] 10.222.0.49 "GET /compute/v2.1/servers/eb6e04a4-8901-47df-9b51-7c1664bd3f6c" status: 200 len: 1569 microversion: 2.1 time: 0.164549 Dec 14 13:01:28.538291 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: [pid: 116064|app: 0|req: 294/612] 10.222.0.49 () {58 vars in 1235 bytes} [Tue Dec 14 13:01:28 2021] GET /compute/v2.1/servers/eb6e04a4-8901-47df-9b51-7c1664bd3f6c => generated 1569 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 14 13:01:28.699522 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.api.openstack.wsgi [None req-6f11e081-39c4-49ac-a33e-e50d392d23f4 tempest-VolumesSnapshotTestJSON-1649574085 tempest-VolumesSnapshotTestJSON-1649574085-project] Calling method '>' {{(pid=116063) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 13:01:28.700429 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.compute.api [None req-6f11e081-39c4-49ac-a33e-e50d392d23f4 tempest-VolumesSnapshotTestJSON-1649574085 tempest-VolumesSnapshotTestJSON-1649574085-project] [instance: 02c92efa-769b-4b6a-94a9-5d059de29e2c] Fetching instance by UUID {{(pid=116063) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 13:01:28.710947 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-6f11e081-39c4-49ac-a33e-e50d392d23f4 tempest-VolumesSnapshotTestJSON-1649574085 tempest-VolumesSnapshotTestJSON-1649574085-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 13:01:28.711715 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-6f11e081-39c4-49ac-a33e-e50d392d23f4 tempest-VolumesSnapshotTestJSON-1649574085 tempest-VolumesSnapshotTestJSON-1649574085-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 13:01:28.713020 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-6f11e081-39c4-49ac-a33e-e50d392d23f4 tempest-VolumesSnapshotTestJSON-1649574085 tempest-VolumesSnapshotTestJSON-1649574085-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 13:01:28.713727 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-6f11e081-39c4-49ac-a33e-e50d392d23f4 tempest-VolumesSnapshotTestJSON-1649574085 tempest-VolumesSnapshotTestJSON-1649574085-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 13:01:28.770168 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.api.openstack.wsgi [None req-497a08ba-6582-4323-b605-2d2f9234bf39 tempest-AttachVolumeNegativeTest-1000400951 tempest-AttachVolumeNegativeTest-1000400951-project] Calling method '>' {{(pid=116064) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 13:01:28.770770 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.compute.api [None req-497a08ba-6582-4323-b605-2d2f9234bf39 tempest-AttachVolumeNegativeTest-1000400951 tempest-AttachVolumeNegativeTest-1000400951-project] [instance: 824eca5b-954f-402d-aa22-14f24ddd77ba] Fetching instance by UUID {{(pid=116064) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 13:01:28.777112 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-497a08ba-6582-4323-b605-2d2f9234bf39 tempest-AttachVolumeNegativeTest-1000400951 tempest-AttachVolumeNegativeTest-1000400951-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 13:01:28.777553 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-497a08ba-6582-4323-b605-2d2f9234bf39 tempest-AttachVolumeNegativeTest-1000400951 tempest-AttachVolumeNegativeTest-1000400951-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 13:01:28.778334 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-497a08ba-6582-4323-b605-2d2f9234bf39 tempest-AttachVolumeNegativeTest-1000400951 tempest-AttachVolumeNegativeTest-1000400951-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 13:01:28.778766 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-497a08ba-6582-4323-b605-2d2f9234bf39 tempest-AttachVolumeNegativeTest-1000400951 tempest-AttachVolumeNegativeTest-1000400951-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 13:01:28.875444 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.policy [None req-6f11e081-39c4-49ac-a33e-e50d392d23f4 tempest-VolumesSnapshotTestJSON-1649574085 tempest-VolumesSnapshotTestJSON-1649574085-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e18311fd2704616a778d36332f199ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1bf776f341b4721b28eb9a5c84ba866', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116063) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 13:01:28.883587 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: INFO nova.api.openstack.requestlog [None req-6f11e081-39c4-49ac-a33e-e50d392d23f4 tempest-VolumesSnapshotTestJSON-1649574085 tempest-VolumesSnapshotTestJSON-1649574085-project] 10.222.0.49 "GET /compute/v2.1/servers/02c92efa-769b-4b6a-94a9-5d059de29e2c" status: 200 len: 1319 microversion: 2.1 time: 0.190240 Dec 14 13:01:28.884264 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: [pid: 116063|app: 0|req: 319/613] 10.222.0.49 () {58 vars in 1235 bytes} [Tue Dec 14 13:01:28 2021] GET /compute/v2.1/servers/02c92efa-769b-4b6a-94a9-5d059de29e2c => generated 1319 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 14 13:01:28.918013 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.api.openstack.wsgi [None req-63953055-109c-4a19-bc9c-e77f28b6428a tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] Calling method '>' {{(pid=116063) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 13:01:28.918623 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.compute.api [None req-63953055-109c-4a19-bc9c-e77f28b6428a tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] [instance: c8de7730-62f2-4a77-b1e9-cf6a74fa366d] Fetching instance by UUID {{(pid=116063) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 13:01:28.924947 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-63953055-109c-4a19-bc9c-e77f28b6428a tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 13:01:28.925410 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-63953055-109c-4a19-bc9c-e77f28b6428a tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 13:01:28.926210 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-63953055-109c-4a19-bc9c-e77f28b6428a tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 13:01:28.926637 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-63953055-109c-4a19-bc9c-e77f28b6428a tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 13:01:28.937652 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.policy [None req-497a08ba-6582-4323-b605-2d2f9234bf39 tempest-AttachVolumeNegativeTest-1000400951 tempest-AttachVolumeNegativeTest-1000400951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57d0ec01f0784c8ea87d339980bed3cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad27b8951cae4eeeafa257f45217653a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116064) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 13:01:28.945432 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: INFO nova.api.openstack.requestlog [None req-497a08ba-6582-4323-b605-2d2f9234bf39 tempest-AttachVolumeNegativeTest-1000400951 tempest-AttachVolumeNegativeTest-1000400951-project] 10.222.0.49 "GET /compute/v2.1/servers/824eca5b-954f-402d-aa22-14f24ddd77ba" status: 200 len: 1514 microversion: 2.1 time: 0.178947 Dec 14 13:01:28.946105 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: [pid: 116064|app: 0|req: 295/614] 10.222.0.49 () {58 vars in 1235 bytes} [Tue Dec 14 13:01:28 2021] GET /compute/v2.1/servers/824eca5b-954f-402d-aa22-14f24ddd77ba => generated 1514 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 14 13:01:29.058688 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.policy [None req-63953055-109c-4a19-bc9c-e77f28b6428a tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79d74a2ea1e541d28d085c15cec34032', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68a8770b8dbe489a8119016fbee64eb5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116063) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 13:01:29.067497 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.policy [None req-63953055-109c-4a19-bc9c-e77f28b6428a tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '79d74a2ea1e541d28d085c15cec34032', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68a8770b8dbe489a8119016fbee64eb5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116063) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 13:01:29.069028 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.policy [None req-63953055-109c-4a19-bc9c-e77f28b6428a tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '79d74a2ea1e541d28d085c15cec34032', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68a8770b8dbe489a8119016fbee64eb5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116063) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 13:01:29.070188 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: INFO nova.api.openstack.requestlog [None req-63953055-109c-4a19-bc9c-e77f28b6428a tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] 10.222.0.49 "GET /compute/v2.1/servers/c8de7730-62f2-4a77-b1e9-cf6a74fa366d" status: 200 len: 1809 microversion: 2.20 time: 0.155840 Dec 14 13:01:29.070748 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: [pid: 116063|app: 0|req: 320/615] 10.222.0.49 () {60 vars in 1276 bytes} [Tue Dec 14 13:01:28 2021] GET /compute/v2.1/servers/c8de7730-62f2-4a77-b1e9-cf6a74fa366d => generated 1809 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Dec 14 13:01:29.554383 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.api.openstack.wsgi [None req-ec6a694e-c485-4edc-be95-4383b2b00121 tempest-ServerRescueNegativeTestJSON-1573931620 tempest-ServerRescueNegativeTestJSON-1573931620-project] Calling method '>' {{(pid=116064) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 13:01:29.554981 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.compute.api [None req-ec6a694e-c485-4edc-be95-4383b2b00121 tempest-ServerRescueNegativeTestJSON-1573931620 tempest-ServerRescueNegativeTestJSON-1573931620-project] [instance: eb6e04a4-8901-47df-9b51-7c1664bd3f6c] Fetching instance by UUID {{(pid=116064) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 13:01:29.564205 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-ec6a694e-c485-4edc-be95-4383b2b00121 tempest-ServerRescueNegativeTestJSON-1573931620 tempest-ServerRescueNegativeTestJSON-1573931620-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 13:01:29.564671 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-ec6a694e-c485-4edc-be95-4383b2b00121 tempest-ServerRescueNegativeTestJSON-1573931620 tempest-ServerRescueNegativeTestJSON-1573931620-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 13:01:29.565473 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-ec6a694e-c485-4edc-be95-4383b2b00121 tempest-ServerRescueNegativeTestJSON-1573931620 tempest-ServerRescueNegativeTestJSON-1573931620-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 13:01:29.565872 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-ec6a694e-c485-4edc-be95-4383b2b00121 tempest-ServerRescueNegativeTestJSON-1573931620 tempest-ServerRescueNegativeTestJSON-1573931620-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 13:01:29.702276 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.policy [None req-ec6a694e-c485-4edc-be95-4383b2b00121 tempest-ServerRescueNegativeTestJSON-1573931620 tempest-ServerRescueNegativeTestJSON-1573931620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '731cbbfe17214ded8ac66299d66dfc45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '010919ea84eb4eb8b936c63153600eba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116064) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 13:01:29.712390 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: INFO nova.api.openstack.requestlog [None req-ec6a694e-c485-4edc-be95-4383b2b00121 tempest-ServerRescueNegativeTestJSON-1573931620 tempest-ServerRescueNegativeTestJSON-1573931620-project] 10.222.0.49 "GET /compute/v2.1/servers/eb6e04a4-8901-47df-9b51-7c1664bd3f6c" status: 200 len: 1569 microversion: 2.1 time: 0.161627 Dec 14 13:01:29.712996 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: [pid: 116064|app: 0|req: 296/616] 10.222.0.49 () {58 vars in 1235 bytes} [Tue Dec 14 13:01:29 2021] GET /compute/v2.1/servers/eb6e04a4-8901-47df-9b51-7c1664bd3f6c => generated 1569 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 14 13:01:29.840455 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.api.openstack.wsgi [req-658f654f-445c-4062-9e74-78937c8682dd req-46d0238c-a02e-4b20-9db7-868f96603fa1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "824eca5b-954f-402d-aa22-14f24ddd77ba", "name": "network-vif-deleted", "tag": "11ccc809-2261-401d-8da3-2d48bb297543"}]} {{(pid=116063) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 14 13:01:29.840455 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 14 13:01:29.840455 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: warnings.warn(msg) Dec 14 13:01:29.847581 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [req-658f654f-445c-4062-9e74-78937c8682dd req-46d0238c-a02e-4b20-9db7-868f96603fa1 service nova] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 13:01:29.848022 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [req-658f654f-445c-4062-9e74-78937c8682dd req-46d0238c-a02e-4b20-9db7-868f96603fa1 service nova] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 13:01:29.864077 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: INFO nova.api.openstack.compute.server_external_events [req-658f654f-445c-4062-9e74-78937c8682dd req-46d0238c-a02e-4b20-9db7-868f96603fa1 service nova] Creating event network-vif-deleted:11ccc809-2261-401d-8da3-2d48bb297543 for instance 824eca5b-954f-402d-aa22-14f24ddd77ba on hv-cinder-78447 Dec 14 13:01:29.869654 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: INFO nova.api.openstack.requestlog [req-658f654f-445c-4062-9e74-78937c8682dd req-46d0238c-a02e-4b20-9db7-868f96603fa1 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036034 Dec 14 13:01:29.870617 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: [pid: 116063|app: 0|req: 321/617] 10.222.0.49 () {64 vars in 1317 bytes} [Tue Dec 14 13:01:29 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 14 13:01:29.900475 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.api.openstack.wsgi [None req-cc146e87-ca74-4045-a17c-97f8744eae1c tempest-VolumesSnapshotTestJSON-1649574085 tempest-VolumesSnapshotTestJSON-1649574085-project] Calling method '>' {{(pid=116064) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 13:01:29.901102 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.compute.api [None req-cc146e87-ca74-4045-a17c-97f8744eae1c tempest-VolumesSnapshotTestJSON-1649574085 tempest-VolumesSnapshotTestJSON-1649574085-project] [instance: 02c92efa-769b-4b6a-94a9-5d059de29e2c] Fetching instance by UUID {{(pid=116064) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 13:01:29.907899 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-cc146e87-ca74-4045-a17c-97f8744eae1c tempest-VolumesSnapshotTestJSON-1649574085 tempest-VolumesSnapshotTestJSON-1649574085-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 13:01:29.908353 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-cc146e87-ca74-4045-a17c-97f8744eae1c tempest-VolumesSnapshotTestJSON-1649574085 tempest-VolumesSnapshotTestJSON-1649574085-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 13:01:29.909166 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-cc146e87-ca74-4045-a17c-97f8744eae1c tempest-VolumesSnapshotTestJSON-1649574085 tempest-VolumesSnapshotTestJSON-1649574085-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 13:01:29.909604 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-cc146e87-ca74-4045-a17c-97f8744eae1c tempest-VolumesSnapshotTestJSON-1649574085 tempest-VolumesSnapshotTestJSON-1649574085-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 13:01:29.963291 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.api.openstack.wsgi [None req-c1bd8d23-52e7-42de-a817-4f9171fdcd4d tempest-AttachVolumeNegativeTest-1000400951 tempest-AttachVolumeNegativeTest-1000400951-project] Calling method '>' {{(pid=116063) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 13:01:29.963988 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.compute.api [None req-c1bd8d23-52e7-42de-a817-4f9171fdcd4d tempest-AttachVolumeNegativeTest-1000400951 tempest-AttachVolumeNegativeTest-1000400951-project] [instance: 824eca5b-954f-402d-aa22-14f24ddd77ba] Fetching instance by UUID {{(pid=116063) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 13:01:29.970598 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-c1bd8d23-52e7-42de-a817-4f9171fdcd4d tempest-AttachVolumeNegativeTest-1000400951 tempest-AttachVolumeNegativeTest-1000400951-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 13:01:29.971018 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-c1bd8d23-52e7-42de-a817-4f9171fdcd4d tempest-AttachVolumeNegativeTest-1000400951 tempest-AttachVolumeNegativeTest-1000400951-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 13:01:29.971797 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-c1bd8d23-52e7-42de-a817-4f9171fdcd4d tempest-AttachVolumeNegativeTest-1000400951 tempest-AttachVolumeNegativeTest-1000400951-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 13:01:29.972204 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-c1bd8d23-52e7-42de-a817-4f9171fdcd4d tempest-AttachVolumeNegativeTest-1000400951 tempest-AttachVolumeNegativeTest-1000400951-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 13:01:30.003764 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-c1bd8d23-52e7-42de-a817-4f9171fdcd4d tempest-AttachVolumeNegativeTest-1000400951 tempest-AttachVolumeNegativeTest-1000400951-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 13:01:30.004226 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-c1bd8d23-52e7-42de-a817-4f9171fdcd4d tempest-AttachVolumeNegativeTest-1000400951 tempest-AttachVolumeNegativeTest-1000400951-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 13:01:30.004667 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.objects.instance [None req-c1bd8d23-52e7-42de-a817-4f9171fdcd4d tempest-AttachVolumeNegativeTest-1000400951 tempest-AttachVolumeNegativeTest-1000400951-project] Lazy-loading 'fault' on Instance uuid 824eca5b-954f-402d-aa22-14f24ddd77ba {{(pid=116063) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Dec 14 13:01:30.057189 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.policy [None req-c1bd8d23-52e7-42de-a817-4f9171fdcd4d tempest-AttachVolumeNegativeTest-1000400951 tempest-AttachVolumeNegativeTest-1000400951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57d0ec01f0784c8ea87d339980bed3cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad27b8951cae4eeeafa257f45217653a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116063) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 13:01:30.065105 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: INFO nova.api.openstack.requestlog [None req-c1bd8d23-52e7-42de-a817-4f9171fdcd4d tempest-AttachVolumeNegativeTest-1000400951 tempest-AttachVolumeNegativeTest-1000400951-project] 10.222.0.49 "GET /compute/v2.1/servers/824eca5b-954f-402d-aa22-14f24ddd77ba" status: 200 len: 1308 microversion: 2.1 time: 0.105814 Dec 14 13:01:30.065658 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: [pid: 116063|app: 0|req: 322/618] 10.222.0.49 () {58 vars in 1235 bytes} [Tue Dec 14 13:01:29 2021] GET /compute/v2.1/servers/824eca5b-954f-402d-aa22-14f24ddd77ba => generated 1308 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 14 13:01:30.073803 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.policy [None req-cc146e87-ca74-4045-a17c-97f8744eae1c tempest-VolumesSnapshotTestJSON-1649574085 tempest-VolumesSnapshotTestJSON-1649574085-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e18311fd2704616a778d36332f199ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1bf776f341b4721b28eb9a5c84ba866', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116064) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 13:01:30.081957 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: INFO nova.api.openstack.requestlog [None req-cc146e87-ca74-4045-a17c-97f8744eae1c tempest-VolumesSnapshotTestJSON-1649574085 tempest-VolumesSnapshotTestJSON-1649574085-project] 10.222.0.49 "GET /compute/v2.1/servers/02c92efa-769b-4b6a-94a9-5d059de29e2c" status: 200 len: 1508 microversion: 2.1 time: 0.185287 Dec 14 13:01:30.082535 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: [pid: 116064|app: 0|req: 297/619] 10.222.0.49 () {58 vars in 1235 bytes} [Tue Dec 14 13:01:29 2021] GET /compute/v2.1/servers/02c92efa-769b-4b6a-94a9-5d059de29e2c => generated 1508 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 14 13:01:30.088377 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.api.openstack.wsgi [None req-106aa920-2fd8-44b1-b1b5-7e2ade91835c tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] Calling method '>' {{(pid=116063) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 13:01:30.089010 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.compute.api [None req-106aa920-2fd8-44b1-b1b5-7e2ade91835c tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] [instance: c8de7730-62f2-4a77-b1e9-cf6a74fa366d] Fetching instance by UUID {{(pid=116063) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 13:01:30.095073 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-106aa920-2fd8-44b1-b1b5-7e2ade91835c tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 13:01:30.095524 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-106aa920-2fd8-44b1-b1b5-7e2ade91835c tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 13:01:30.096304 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-106aa920-2fd8-44b1-b1b5-7e2ade91835c tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 13:01:30.096741 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-106aa920-2fd8-44b1-b1b5-7e2ade91835c tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 13:01:30.098429 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.api.openstack.wsgi [None req-a5d27acd-e914-419d-8b1c-10c32d45a2f4 tempest-VolumesSnapshotTestJSON-1649574085 tempest-VolumesSnapshotTestJSON-1649574085-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "ab53e720-77c3-4722-8470-7a6cc92b136a", "device": "/dev/sdb"}} {{(pid=116064) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 14 13:01:30.099611 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.compute.api [None req-a5d27acd-e914-419d-8b1c-10c32d45a2f4 tempest-VolumesSnapshotTestJSON-1649574085 tempest-VolumesSnapshotTestJSON-1649574085-project] [instance: 02c92efa-769b-4b6a-94a9-5d059de29e2c] Fetching instance by UUID {{(pid=116064) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 13:01:30.105547 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-a5d27acd-e914-419d-8b1c-10c32d45a2f4 tempest-VolumesSnapshotTestJSON-1649574085 tempest-VolumesSnapshotTestJSON-1649574085-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 13:01:30.106108 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-a5d27acd-e914-419d-8b1c-10c32d45a2f4 tempest-VolumesSnapshotTestJSON-1649574085 tempest-VolumesSnapshotTestJSON-1649574085-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 13:01:30.106883 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-a5d27acd-e914-419d-8b1c-10c32d45a2f4 tempest-VolumesSnapshotTestJSON-1649574085 tempest-VolumesSnapshotTestJSON-1649574085-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 13:01:30.107332 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-a5d27acd-e914-419d-8b1c-10c32d45a2f4 tempest-VolumesSnapshotTestJSON-1649574085 tempest-VolumesSnapshotTestJSON-1649574085-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 13:01:30.230519 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.policy [None req-106aa920-2fd8-44b1-b1b5-7e2ade91835c tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79d74a2ea1e541d28d085c15cec34032', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68a8770b8dbe489a8119016fbee64eb5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116063) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 13:01:30.239143 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.policy [None req-106aa920-2fd8-44b1-b1b5-7e2ade91835c tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '79d74a2ea1e541d28d085c15cec34032', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68a8770b8dbe489a8119016fbee64eb5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116063) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 13:01:30.240635 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.policy [None req-106aa920-2fd8-44b1-b1b5-7e2ade91835c tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '79d74a2ea1e541d28d085c15cec34032', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68a8770b8dbe489a8119016fbee64eb5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116063) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 13:01:30.241823 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: INFO nova.api.openstack.requestlog [None req-106aa920-2fd8-44b1-b1b5-7e2ade91835c tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] 10.222.0.49 "GET /compute/v2.1/servers/c8de7730-62f2-4a77-b1e9-cf6a74fa366d" status: 200 len: 1809 microversion: 2.20 time: 0.157101 Dec 14 13:01:30.242466 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: [pid: 116063|app: 0|req: 323/620] 10.222.0.49 () {60 vars in 1276 bytes} [Tue Dec 14 13:01:30 2021] GET /compute/v2.1/servers/c8de7730-62f2-4a77-b1e9-cf6a74fa366d => generated 1809 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 14 13:01:30.350524 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: INFO nova.api.openstack.requestlog [None req-a5d27acd-e914-419d-8b1c-10c32d45a2f4 tempest-VolumesSnapshotTestJSON-1649574085 tempest-VolumesSnapshotTestJSON-1649574085-project] 10.222.0.49 "POST /compute/v2.1/servers/02c92efa-769b-4b6a-94a9-5d059de29e2c/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.255982 Dec 14 13:01:30.351159 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: [pid: 116064|app: 0|req: 298/621] 10.222.0.49 () {60 vars in 1322 bytes} [Tue Dec 14 13:01:30 2021] POST /compute/v2.1/servers/02c92efa-769b-4b6a-94a9-5d059de29e2c/os-volume_attachments => generated 194 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 14 13:01:30.729075 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.api.openstack.wsgi [None req-6d0d112a-d254-437c-9f9a-7b26488e3b6f tempest-ServerRescueNegativeTestJSON-1573931620 tempest-ServerRescueNegativeTestJSON-1573931620-project] Calling method '>' {{(pid=116063) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 13:01:30.729798 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.compute.api [None req-6d0d112a-d254-437c-9f9a-7b26488e3b6f tempest-ServerRescueNegativeTestJSON-1573931620 tempest-ServerRescueNegativeTestJSON-1573931620-project] [instance: eb6e04a4-8901-47df-9b51-7c1664bd3f6c] Fetching instance by UUID {{(pid=116063) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 13:01:30.737680 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-6d0d112a-d254-437c-9f9a-7b26488e3b6f tempest-ServerRescueNegativeTestJSON-1573931620 tempest-ServerRescueNegativeTestJSON-1573931620-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 13:01:30.738119 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-6d0d112a-d254-437c-9f9a-7b26488e3b6f tempest-ServerRescueNegativeTestJSON-1573931620 tempest-ServerRescueNegativeTestJSON-1573931620-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 13:01:30.738895 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-6d0d112a-d254-437c-9f9a-7b26488e3b6f tempest-ServerRescueNegativeTestJSON-1573931620 tempest-ServerRescueNegativeTestJSON-1573931620-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 13:01:30.739443 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-6d0d112a-d254-437c-9f9a-7b26488e3b6f tempest-ServerRescueNegativeTestJSON-1573931620 tempest-ServerRescueNegativeTestJSON-1573931620-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 13:01:30.940689 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.policy [None req-6d0d112a-d254-437c-9f9a-7b26488e3b6f tempest-ServerRescueNegativeTestJSON-1573931620 tempest-ServerRescueNegativeTestJSON-1573931620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '731cbbfe17214ded8ac66299d66dfc45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '010919ea84eb4eb8b936c63153600eba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116063) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 13:01:30.949779 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: INFO nova.api.openstack.requestlog [None req-6d0d112a-d254-437c-9f9a-7b26488e3b6f tempest-ServerRescueNegativeTestJSON-1573931620 tempest-ServerRescueNegativeTestJSON-1573931620-project] 10.222.0.49 "GET /compute/v2.1/servers/eb6e04a4-8901-47df-9b51-7c1664bd3f6c" status: 200 len: 1569 microversion: 2.1 time: 0.224637 Dec 14 13:01:30.956620 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: [pid: 116063|app: 0|req: 324/622] 10.222.0.49 () {58 vars in 1235 bytes} [Tue Dec 14 13:01:30 2021] GET /compute/v2.1/servers/eb6e04a4-8901-47df-9b51-7c1664bd3f6c => generated 1569 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 14 13:01:31.084894 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.api.openstack.wsgi [None req-0757137e-19a6-4180-9023-b1c36005e3a8 tempest-AttachVolumeNegativeTest-1000400951 tempest-AttachVolumeNegativeTest-1000400951-project] Calling method '>' {{(pid=116064) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 13:01:31.084894 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.compute.api [None req-0757137e-19a6-4180-9023-b1c36005e3a8 tempest-AttachVolumeNegativeTest-1000400951 tempest-AttachVolumeNegativeTest-1000400951-project] [instance: 824eca5b-954f-402d-aa22-14f24ddd77ba] Fetching instance by UUID {{(pid=116064) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 13:01:31.089775 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-0757137e-19a6-4180-9023-b1c36005e3a8 tempest-AttachVolumeNegativeTest-1000400951 tempest-AttachVolumeNegativeTest-1000400951-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 13:01:31.090274 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-0757137e-19a6-4180-9023-b1c36005e3a8 tempest-AttachVolumeNegativeTest-1000400951 tempest-AttachVolumeNegativeTest-1000400951-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 13:01:31.091016 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-0757137e-19a6-4180-9023-b1c36005e3a8 tempest-AttachVolumeNegativeTest-1000400951 tempest-AttachVolumeNegativeTest-1000400951-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 13:01:31.091447 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-0757137e-19a6-4180-9023-b1c36005e3a8 tempest-AttachVolumeNegativeTest-1000400951 tempest-AttachVolumeNegativeTest-1000400951-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 13:01:31.105115 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: INFO nova.api.openstack.wsgi [None req-0757137e-19a6-4180-9023-b1c36005e3a8 tempest-AttachVolumeNegativeTest-1000400951 tempest-AttachVolumeNegativeTest-1000400951-project] HTTP exception thrown: Instance 824eca5b-954f-402d-aa22-14f24ddd77ba could not be found. Dec 14 13:01:31.105711 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.api.openstack.wsgi [None req-0757137e-19a6-4180-9023-b1c36005e3a8 tempest-AttachVolumeNegativeTest-1000400951 tempest-AttachVolumeNegativeTest-1000400951-project] Returning 404 to user: Instance 824eca5b-954f-402d-aa22-14f24ddd77ba could not be found. {{(pid=116064) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 14 13:01:31.106540 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: INFO nova.api.openstack.requestlog [None req-0757137e-19a6-4180-9023-b1c36005e3a8 tempest-AttachVolumeNegativeTest-1000400951 tempest-AttachVolumeNegativeTest-1000400951-project] 10.222.0.49 "GET /compute/v2.1/servers/824eca5b-954f-402d-aa22-14f24ddd77ba" status: 404 len: 111 microversion: 2.1 time: 0.028929 Dec 14 13:01:31.107092 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: [pid: 116064|app: 0|req: 299/623] 10.222.0.49 () {58 vars in 1235 bytes} [Tue Dec 14 13:01:31 2021] GET /compute/v2.1/servers/824eca5b-954f-402d-aa22-14f24ddd77ba => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Dec 14 13:01:31.259828 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.api.openstack.wsgi [None req-5cb6dc65-c158-40dd-927f-0fb210f2947d tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] Calling method '>' {{(pid=116063) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 13:01:31.261067 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.compute.api [None req-5cb6dc65-c158-40dd-927f-0fb210f2947d tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] [instance: c8de7730-62f2-4a77-b1e9-cf6a74fa366d] Fetching instance by UUID {{(pid=116063) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 13:01:31.268090 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-5cb6dc65-c158-40dd-927f-0fb210f2947d tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 13:01:31.268500 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-5cb6dc65-c158-40dd-927f-0fb210f2947d tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 13:01:31.269647 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-5cb6dc65-c158-40dd-927f-0fb210f2947d tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 13:01:31.270233 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-5cb6dc65-c158-40dd-927f-0fb210f2947d tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 13:01:31.411084 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.policy [None req-5cb6dc65-c158-40dd-927f-0fb210f2947d tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79d74a2ea1e541d28d085c15cec34032', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68a8770b8dbe489a8119016fbee64eb5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116063) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 13:01:31.420618 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.policy [None req-5cb6dc65-c158-40dd-927f-0fb210f2947d tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '79d74a2ea1e541d28d085c15cec34032', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68a8770b8dbe489a8119016fbee64eb5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116063) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 13:01:31.422349 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.policy [None req-5cb6dc65-c158-40dd-927f-0fb210f2947d tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '79d74a2ea1e541d28d085c15cec34032', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68a8770b8dbe489a8119016fbee64eb5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116063) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 13:01:31.423622 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: INFO nova.api.openstack.requestlog [None req-5cb6dc65-c158-40dd-927f-0fb210f2947d tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] 10.222.0.49 "GET /compute/v2.1/servers/c8de7730-62f2-4a77-b1e9-cf6a74fa366d" status: 200 len: 1809 microversion: 2.20 time: 0.167728 Dec 14 13:01:31.424900 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: [pid: 116063|app: 0|req: 325/624] 10.222.0.49 () {60 vars in 1276 bytes} [Tue Dec 14 13:01:31 2021] GET /compute/v2.1/servers/c8de7730-62f2-4a77-b1e9-cf6a74fa366d => generated 1809 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Dec 14 13:01:31.967843 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.api.openstack.wsgi [None req-fe4a8f6f-ba4c-401f-89ca-438204a29d02 tempest-ServerRescueNegativeTestJSON-1573931620 tempest-ServerRescueNegativeTestJSON-1573931620-project] Calling method '>' {{(pid=116064) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 13:01:31.968427 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.compute.api [None req-fe4a8f6f-ba4c-401f-89ca-438204a29d02 tempest-ServerRescueNegativeTestJSON-1573931620 tempest-ServerRescueNegativeTestJSON-1573931620-project] [instance: eb6e04a4-8901-47df-9b51-7c1664bd3f6c] Fetching instance by UUID {{(pid=116064) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 13:01:31.975012 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-fe4a8f6f-ba4c-401f-89ca-438204a29d02 tempest-ServerRescueNegativeTestJSON-1573931620 tempest-ServerRescueNegativeTestJSON-1573931620-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 13:01:31.975723 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-fe4a8f6f-ba4c-401f-89ca-438204a29d02 tempest-ServerRescueNegativeTestJSON-1573931620 tempest-ServerRescueNegativeTestJSON-1573931620-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 13:01:31.976866 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-fe4a8f6f-ba4c-401f-89ca-438204a29d02 tempest-ServerRescueNegativeTestJSON-1573931620 tempest-ServerRescueNegativeTestJSON-1573931620-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 13:01:31.977383 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-fe4a8f6f-ba4c-401f-89ca-438204a29d02 tempest-ServerRescueNegativeTestJSON-1573931620 tempest-ServerRescueNegativeTestJSON-1573931620-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 13:01:32.114768 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.policy [None req-fe4a8f6f-ba4c-401f-89ca-438204a29d02 tempest-ServerRescueNegativeTestJSON-1573931620 tempest-ServerRescueNegativeTestJSON-1573931620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '731cbbfe17214ded8ac66299d66dfc45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '010919ea84eb4eb8b936c63153600eba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116064) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 13:01:32.122999 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: INFO nova.api.openstack.requestlog [None req-fe4a8f6f-ba4c-401f-89ca-438204a29d02 tempest-ServerRescueNegativeTestJSON-1573931620 tempest-ServerRescueNegativeTestJSON-1573931620-project] 10.222.0.49 "GET /compute/v2.1/servers/eb6e04a4-8901-47df-9b51-7c1664bd3f6c" status: 200 len: 1569 microversion: 2.1 time: 0.159355 Dec 14 13:01:32.123568 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: [pid: 116064|app: 0|req: 300/625] 10.222.0.49 () {58 vars in 1235 bytes} [Tue Dec 14 13:01:31 2021] GET /compute/v2.1/servers/eb6e04a4-8901-47df-9b51-7c1664bd3f6c => generated 1569 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 14 13:01:32.442861 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.api.openstack.wsgi [None req-448e75de-6937-4a7c-9178-7673eb04407d tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] Calling method '>' {{(pid=116063) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 13:01:32.443572 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.compute.api [None req-448e75de-6937-4a7c-9178-7673eb04407d tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] [instance: c8de7730-62f2-4a77-b1e9-cf6a74fa366d] Fetching instance by UUID {{(pid=116063) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 13:01:32.450079 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-448e75de-6937-4a7c-9178-7673eb04407d tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 13:01:32.450525 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-448e75de-6937-4a7c-9178-7673eb04407d tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 13:01:32.451315 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-448e75de-6937-4a7c-9178-7673eb04407d tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 13:01:32.451747 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-448e75de-6937-4a7c-9178-7673eb04407d tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 13:01:32.587254 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.policy [None req-448e75de-6937-4a7c-9178-7673eb04407d tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79d74a2ea1e541d28d085c15cec34032', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68a8770b8dbe489a8119016fbee64eb5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116063) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 13:01:32.595739 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.policy [None req-448e75de-6937-4a7c-9178-7673eb04407d tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '79d74a2ea1e541d28d085c15cec34032', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68a8770b8dbe489a8119016fbee64eb5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116063) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 13:01:32.597265 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.policy [None req-448e75de-6937-4a7c-9178-7673eb04407d tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '79d74a2ea1e541d28d085c15cec34032', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68a8770b8dbe489a8119016fbee64eb5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116063) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 13:01:32.598409 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: INFO nova.api.openstack.requestlog [None req-448e75de-6937-4a7c-9178-7673eb04407d tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] 10.222.0.49 "GET /compute/v2.1/servers/c8de7730-62f2-4a77-b1e9-cf6a74fa366d" status: 200 len: 1809 microversion: 2.20 time: 0.159284 Dec 14 13:01:32.598971 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: [pid: 116063|app: 0|req: 326/626] 10.222.0.49 () {60 vars in 1276 bytes} [Tue Dec 14 13:01:32 2021] GET /compute/v2.1/servers/c8de7730-62f2-4a77-b1e9-cf6a74fa366d => generated 1809 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 14 13:01:33.139246 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.api.openstack.wsgi [None req-4a56fdcc-3ce2-4a0d-bd93-f1ccfcd5883f tempest-ServerRescueNegativeTestJSON-1573931620 tempest-ServerRescueNegativeTestJSON-1573931620-project] Calling method '>' {{(pid=116064) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 13:01:33.140448 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.compute.api [None req-4a56fdcc-3ce2-4a0d-bd93-f1ccfcd5883f tempest-ServerRescueNegativeTestJSON-1573931620 tempest-ServerRescueNegativeTestJSON-1573931620-project] [instance: eb6e04a4-8901-47df-9b51-7c1664bd3f6c] Fetching instance by UUID {{(pid=116064) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 13:01:33.146698 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-4a56fdcc-3ce2-4a0d-bd93-f1ccfcd5883f tempest-ServerRescueNegativeTestJSON-1573931620 tempest-ServerRescueNegativeTestJSON-1573931620-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 13:01:33.147137 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-4a56fdcc-3ce2-4a0d-bd93-f1ccfcd5883f tempest-ServerRescueNegativeTestJSON-1573931620 tempest-ServerRescueNegativeTestJSON-1573931620-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 13:01:33.147875 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-4a56fdcc-3ce2-4a0d-bd93-f1ccfcd5883f tempest-ServerRescueNegativeTestJSON-1573931620 tempest-ServerRescueNegativeTestJSON-1573931620-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 13:01:33.148499 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-4a56fdcc-3ce2-4a0d-bd93-f1ccfcd5883f tempest-ServerRescueNegativeTestJSON-1573931620 tempest-ServerRescueNegativeTestJSON-1573931620-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 13:01:33.283164 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.policy [None req-4a56fdcc-3ce2-4a0d-bd93-f1ccfcd5883f tempest-ServerRescueNegativeTestJSON-1573931620 tempest-ServerRescueNegativeTestJSON-1573931620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '731cbbfe17214ded8ac66299d66dfc45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '010919ea84eb4eb8b936c63153600eba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116064) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 13:01:33.291097 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: INFO nova.api.openstack.requestlog [None req-4a56fdcc-3ce2-4a0d-bd93-f1ccfcd5883f tempest-ServerRescueNegativeTestJSON-1573931620 tempest-ServerRescueNegativeTestJSON-1573931620-project] 10.222.0.49 "GET /compute/v2.1/servers/eb6e04a4-8901-47df-9b51-7c1664bd3f6c" status: 200 len: 1569 microversion: 2.1 time: 0.155530 Dec 14 13:01:33.291690 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: [pid: 116064|app: 0|req: 301/627] 10.222.0.49 () {58 vars in 1235 bytes} [Tue Dec 14 13:01:33 2021] GET /compute/v2.1/servers/eb6e04a4-8901-47df-9b51-7c1664bd3f6c => generated 1569 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 14 13:01:33.615657 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.api.openstack.wsgi [None req-c51cb6bb-0b2a-4f18-a253-d9b1af16ba7e tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] Calling method '>' {{(pid=116063) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 13:01:33.616191 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.compute.api [None req-c51cb6bb-0b2a-4f18-a253-d9b1af16ba7e tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] [instance: c8de7730-62f2-4a77-b1e9-cf6a74fa366d] Fetching instance by UUID {{(pid=116063) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 13:01:33.630123 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-c51cb6bb-0b2a-4f18-a253-d9b1af16ba7e tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 13:01:33.630567 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-c51cb6bb-0b2a-4f18-a253-d9b1af16ba7e tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 13:01:33.631352 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-c51cb6bb-0b2a-4f18-a253-d9b1af16ba7e tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 13:01:33.631780 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-c51cb6bb-0b2a-4f18-a253-d9b1af16ba7e tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 13:01:33.762230 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.policy [None req-c51cb6bb-0b2a-4f18-a253-d9b1af16ba7e tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79d74a2ea1e541d28d085c15cec34032', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68a8770b8dbe489a8119016fbee64eb5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116063) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 13:01:33.770517 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.policy [None req-c51cb6bb-0b2a-4f18-a253-d9b1af16ba7e tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '79d74a2ea1e541d28d085c15cec34032', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68a8770b8dbe489a8119016fbee64eb5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116063) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 13:01:33.771999 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.policy [None req-c51cb6bb-0b2a-4f18-a253-d9b1af16ba7e tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '79d74a2ea1e541d28d085c15cec34032', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68a8770b8dbe489a8119016fbee64eb5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116063) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 13:01:33.773175 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: INFO nova.api.openstack.requestlog [None req-c51cb6bb-0b2a-4f18-a253-d9b1af16ba7e tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] 10.222.0.49 "GET /compute/v2.1/servers/c8de7730-62f2-4a77-b1e9-cf6a74fa366d" status: 200 len: 1809 microversion: 2.20 time: 0.161299 Dec 14 13:01:33.773738 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: [pid: 116063|app: 0|req: 327/628] 10.222.0.49 () {60 vars in 1276 bytes} [Tue Dec 14 13:01:33 2021] GET /compute/v2.1/servers/c8de7730-62f2-4a77-b1e9-cf6a74fa366d => generated 1809 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 14 13:01:34.312353 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.api.openstack.wsgi [None req-e06a1aaa-89ed-4663-8f2c-1679c9e1f5e2 tempest-ServerRescueNegativeTestJSON-1573931620 tempest-ServerRescueNegativeTestJSON-1573931620-project] Calling method '>' {{(pid=116064) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 13:01:34.313411 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.compute.api [None req-e06a1aaa-89ed-4663-8f2c-1679c9e1f5e2 tempest-ServerRescueNegativeTestJSON-1573931620 tempest-ServerRescueNegativeTestJSON-1573931620-project] [instance: eb6e04a4-8901-47df-9b51-7c1664bd3f6c] Fetching instance by UUID {{(pid=116064) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 13:01:34.324160 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-e06a1aaa-89ed-4663-8f2c-1679c9e1f5e2 tempest-ServerRescueNegativeTestJSON-1573931620 tempest-ServerRescueNegativeTestJSON-1573931620-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 13:01:34.324950 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-e06a1aaa-89ed-4663-8f2c-1679c9e1f5e2 tempest-ServerRescueNegativeTestJSON-1573931620 tempest-ServerRescueNegativeTestJSON-1573931620-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 13:01:34.326264 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-e06a1aaa-89ed-4663-8f2c-1679c9e1f5e2 tempest-ServerRescueNegativeTestJSON-1573931620 tempest-ServerRescueNegativeTestJSON-1573931620-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 13:01:34.327003 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-e06a1aaa-89ed-4663-8f2c-1679c9e1f5e2 tempest-ServerRescueNegativeTestJSON-1573931620 tempest-ServerRescueNegativeTestJSON-1573931620-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 13:01:34.456242 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.policy [None req-e06a1aaa-89ed-4663-8f2c-1679c9e1f5e2 tempest-ServerRescueNegativeTestJSON-1573931620 tempest-ServerRescueNegativeTestJSON-1573931620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '731cbbfe17214ded8ac66299d66dfc45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '010919ea84eb4eb8b936c63153600eba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116064) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 13:01:34.464840 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: INFO nova.api.openstack.requestlog [None req-e06a1aaa-89ed-4663-8f2c-1679c9e1f5e2 tempest-ServerRescueNegativeTestJSON-1573931620 tempest-ServerRescueNegativeTestJSON-1573931620-project] 10.222.0.49 "GET /compute/v2.1/servers/eb6e04a4-8901-47df-9b51-7c1664bd3f6c" status: 200 len: 1569 microversion: 2.1 time: 0.158602 Dec 14 13:01:34.465422 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: [pid: 116064|app: 0|req: 302/629] 10.222.0.49 () {58 vars in 1235 bytes} [Tue Dec 14 13:01:34 2021] GET /compute/v2.1/servers/eb6e04a4-8901-47df-9b51-7c1664bd3f6c => generated 1569 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 14 13:01:34.791562 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.api.openstack.wsgi [None req-7b2f8ee9-8f1f-4f03-aed6-b01a97e2e4d2 tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] Calling method '>' {{(pid=116063) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 13:01:34.792159 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.compute.api [None req-7b2f8ee9-8f1f-4f03-aed6-b01a97e2e4d2 tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] [instance: c8de7730-62f2-4a77-b1e9-cf6a74fa366d] Fetching instance by UUID {{(pid=116063) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 13:01:34.799381 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-7b2f8ee9-8f1f-4f03-aed6-b01a97e2e4d2 tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 13:01:34.799868 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-7b2f8ee9-8f1f-4f03-aed6-b01a97e2e4d2 tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 13:01:34.800689 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-7b2f8ee9-8f1f-4f03-aed6-b01a97e2e4d2 tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 13:01:34.801257 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-7b2f8ee9-8f1f-4f03-aed6-b01a97e2e4d2 tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 13:01:34.945318 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.policy [None req-7b2f8ee9-8f1f-4f03-aed6-b01a97e2e4d2 tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79d74a2ea1e541d28d085c15cec34032', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68a8770b8dbe489a8119016fbee64eb5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116063) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 13:01:34.955638 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.policy [None req-7b2f8ee9-8f1f-4f03-aed6-b01a97e2e4d2 tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '79d74a2ea1e541d28d085c15cec34032', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68a8770b8dbe489a8119016fbee64eb5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116063) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 13:01:34.957921 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.policy [None req-7b2f8ee9-8f1f-4f03-aed6-b01a97e2e4d2 tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '79d74a2ea1e541d28d085c15cec34032', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68a8770b8dbe489a8119016fbee64eb5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116063) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 13:01:34.959097 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: INFO nova.api.openstack.requestlog [None req-7b2f8ee9-8f1f-4f03-aed6-b01a97e2e4d2 tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] 10.222.0.49 "GET /compute/v2.1/servers/c8de7730-62f2-4a77-b1e9-cf6a74fa366d" status: 200 len: 1809 microversion: 2.20 time: 0.171296 Dec 14 13:01:34.959818 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: [pid: 116063|app: 0|req: 328/630] 10.222.0.49 () {60 vars in 1276 bytes} [Tue Dec 14 13:01:34 2021] GET /compute/v2.1/servers/c8de7730-62f2-4a77-b1e9-cf6a74fa366d => generated 1809 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 14 13:01:35.217805 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Dec 14 13:01:35.218145 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: Tue Dec 14 13:01:35 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Dec 14 13:01:35.490687 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.api.openstack.wsgi [None req-584a5fe4-8c02-448f-9a56-35c6d9158d98 tempest-ServerRescueNegativeTestJSON-1573931620 tempest-ServerRescueNegativeTestJSON-1573931620-project] Calling method '>' {{(pid=116064) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 13:01:35.491516 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.compute.api [None req-584a5fe4-8c02-448f-9a56-35c6d9158d98 tempest-ServerRescueNegativeTestJSON-1573931620 tempest-ServerRescueNegativeTestJSON-1573931620-project] [instance: eb6e04a4-8901-47df-9b51-7c1664bd3f6c] Fetching instance by UUID {{(pid=116064) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 13:01:35.501327 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-584a5fe4-8c02-448f-9a56-35c6d9158d98 tempest-ServerRescueNegativeTestJSON-1573931620 tempest-ServerRescueNegativeTestJSON-1573931620-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 13:01:35.501776 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-584a5fe4-8c02-448f-9a56-35c6d9158d98 tempest-ServerRescueNegativeTestJSON-1573931620 tempest-ServerRescueNegativeTestJSON-1573931620-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 13:01:35.502563 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-584a5fe4-8c02-448f-9a56-35c6d9158d98 tempest-ServerRescueNegativeTestJSON-1573931620 tempest-ServerRescueNegativeTestJSON-1573931620-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 13:01:35.503000 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-584a5fe4-8c02-448f-9a56-35c6d9158d98 tempest-ServerRescueNegativeTestJSON-1573931620 tempest-ServerRescueNegativeTestJSON-1573931620-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 13:01:35.639546 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.policy [None req-584a5fe4-8c02-448f-9a56-35c6d9158d98 tempest-ServerRescueNegativeTestJSON-1573931620 tempest-ServerRescueNegativeTestJSON-1573931620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '731cbbfe17214ded8ac66299d66dfc45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '010919ea84eb4eb8b936c63153600eba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116064) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 13:01:35.647956 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: INFO nova.api.openstack.requestlog [None req-584a5fe4-8c02-448f-9a56-35c6d9158d98 tempest-ServerRescueNegativeTestJSON-1573931620 tempest-ServerRescueNegativeTestJSON-1573931620-project] 10.222.0.49 "GET /compute/v2.1/servers/eb6e04a4-8901-47df-9b51-7c1664bd3f6c" status: 200 len: 1569 microversion: 2.1 time: 0.163497 Dec 14 13:01:35.648517 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: [pid: 116064|app: 0|req: 303/631] 10.222.0.49 () {58 vars in 1235 bytes} [Tue Dec 14 13:01:35 2021] GET /compute/v2.1/servers/eb6e04a4-8901-47df-9b51-7c1664bd3f6c => generated 1569 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 14 13:01:35.977635 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.api.openstack.wsgi [None req-1046bd34-a60e-4091-b3fd-adfc89b3bdc4 tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] Calling method '>' {{(pid=116063) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 13:01:35.978223 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.compute.api [None req-1046bd34-a60e-4091-b3fd-adfc89b3bdc4 tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] [instance: c8de7730-62f2-4a77-b1e9-cf6a74fa366d] Fetching instance by UUID {{(pid=116063) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 13:01:35.984947 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-1046bd34-a60e-4091-b3fd-adfc89b3bdc4 tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 13:01:35.985390 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-1046bd34-a60e-4091-b3fd-adfc89b3bdc4 tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 13:01:35.986166 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-1046bd34-a60e-4091-b3fd-adfc89b3bdc4 tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 13:01:35.986591 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-1046bd34-a60e-4091-b3fd-adfc89b3bdc4 tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 13:01:36.133439 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.policy [None req-1046bd34-a60e-4091-b3fd-adfc89b3bdc4 tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79d74a2ea1e541d28d085c15cec34032', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68a8770b8dbe489a8119016fbee64eb5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116063) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 13:01:36.141971 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.policy [None req-1046bd34-a60e-4091-b3fd-adfc89b3bdc4 tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '79d74a2ea1e541d28d085c15cec34032', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68a8770b8dbe489a8119016fbee64eb5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116063) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 13:01:36.143493 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.policy [None req-1046bd34-a60e-4091-b3fd-adfc89b3bdc4 tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '79d74a2ea1e541d28d085c15cec34032', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68a8770b8dbe489a8119016fbee64eb5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116063) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 13:01:36.144656 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: INFO nova.api.openstack.requestlog [None req-1046bd34-a60e-4091-b3fd-adfc89b3bdc4 tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] 10.222.0.49 "GET /compute/v2.1/servers/c8de7730-62f2-4a77-b1e9-cf6a74fa366d" status: 200 len: 1809 microversion: 2.20 time: 0.170794 Dec 14 13:01:36.145236 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: [pid: 116063|app: 0|req: 329/632] 10.222.0.49 () {60 vars in 1276 bytes} [Tue Dec 14 13:01:35 2021] GET /compute/v2.1/servers/c8de7730-62f2-4a77-b1e9-cf6a74fa366d => generated 1809 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 14 13:01:36.668268 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.api.openstack.wsgi [None req-a80ad101-59f3-4003-8f62-7e767e4f300f tempest-ServerRescueNegativeTestJSON-1573931620 tempest-ServerRescueNegativeTestJSON-1573931620-project] Calling method '>' {{(pid=116064) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 13:01:36.668836 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.compute.api [None req-a80ad101-59f3-4003-8f62-7e767e4f300f tempest-ServerRescueNegativeTestJSON-1573931620 tempest-ServerRescueNegativeTestJSON-1573931620-project] [instance: eb6e04a4-8901-47df-9b51-7c1664bd3f6c] Fetching instance by UUID {{(pid=116064) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 13:01:36.676314 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-a80ad101-59f3-4003-8f62-7e767e4f300f tempest-ServerRescueNegativeTestJSON-1573931620 tempest-ServerRescueNegativeTestJSON-1573931620-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 13:01:36.676762 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-a80ad101-59f3-4003-8f62-7e767e4f300f tempest-ServerRescueNegativeTestJSON-1573931620 tempest-ServerRescueNegativeTestJSON-1573931620-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 13:01:36.677573 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-a80ad101-59f3-4003-8f62-7e767e4f300f tempest-ServerRescueNegativeTestJSON-1573931620 tempest-ServerRescueNegativeTestJSON-1573931620-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 13:01:36.678007 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-a80ad101-59f3-4003-8f62-7e767e4f300f tempest-ServerRescueNegativeTestJSON-1573931620 tempest-ServerRescueNegativeTestJSON-1573931620-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 13:01:36.812253 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.policy [None req-a80ad101-59f3-4003-8f62-7e767e4f300f tempest-ServerRescueNegativeTestJSON-1573931620 tempest-ServerRescueNegativeTestJSON-1573931620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '731cbbfe17214ded8ac66299d66dfc45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '010919ea84eb4eb8b936c63153600eba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116064) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 13:01:36.820595 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: INFO nova.api.openstack.requestlog [None req-a80ad101-59f3-4003-8f62-7e767e4f300f tempest-ServerRescueNegativeTestJSON-1573931620 tempest-ServerRescueNegativeTestJSON-1573931620-project] 10.222.0.49 "GET /compute/v2.1/servers/eb6e04a4-8901-47df-9b51-7c1664bd3f6c" status: 200 len: 1549 microversion: 2.1 time: 0.158282 Dec 14 13:01:36.821186 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: [pid: 116064|app: 0|req: 304/633] 10.222.0.49 () {58 vars in 1235 bytes} [Tue Dec 14 13:01:36 2021] GET /compute/v2.1/servers/eb6e04a4-8901-47df-9b51-7c1664bd3f6c => generated 1549 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 14 13:01:36.839450 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.api.openstack.wsgi [None req-f68f1e13-c721-4ac3-9746-a55060ac176a tempest-ServerRescueNegativeTestJSON-1573931620 tempest-ServerRescueNegativeTestJSON-1573931620-project] Calling method '>' {{(pid=116063) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 13:01:36.840123 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.compute.api [None req-f68f1e13-c721-4ac3-9746-a55060ac176a tempest-ServerRescueNegativeTestJSON-1573931620 tempest-ServerRescueNegativeTestJSON-1573931620-project] [instance: eb6e04a4-8901-47df-9b51-7c1664bd3f6c] Fetching instance by UUID {{(pid=116063) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 13:01:36.847378 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-f68f1e13-c721-4ac3-9746-a55060ac176a tempest-ServerRescueNegativeTestJSON-1573931620 tempest-ServerRescueNegativeTestJSON-1573931620-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 13:01:36.847823 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-f68f1e13-c721-4ac3-9746-a55060ac176a tempest-ServerRescueNegativeTestJSON-1573931620 tempest-ServerRescueNegativeTestJSON-1573931620-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 13:01:36.848599 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-f68f1e13-c721-4ac3-9746-a55060ac176a tempest-ServerRescueNegativeTestJSON-1573931620 tempest-ServerRescueNegativeTestJSON-1573931620-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 13:01:36.849065 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-f68f1e13-c721-4ac3-9746-a55060ac176a tempest-ServerRescueNegativeTestJSON-1573931620 tempest-ServerRescueNegativeTestJSON-1573931620-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 13:01:36.929290 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: INFO nova.api.openstack.wsgi [None req-f68f1e13-c721-4ac3-9746-a55060ac176a tempest-ServerRescueNegativeTestJSON-1573931620 tempest-ServerRescueNegativeTestJSON-1573931620-project] HTTP exception thrown: Cannot 'detach_volume' instance eb6e04a4-8901-47df-9b51-7c1664bd3f6c while it is in vm_state rescued Dec 14 13:01:36.929889 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.api.openstack.wsgi [None req-f68f1e13-c721-4ac3-9746-a55060ac176a tempest-ServerRescueNegativeTestJSON-1573931620 tempest-ServerRescueNegativeTestJSON-1573931620-project] Returning 409 to user: Cannot 'detach_volume' instance eb6e04a4-8901-47df-9b51-7c1664bd3f6c while it is in vm_state rescued {{(pid=116063) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 14 13:01:36.930718 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: INFO nova.api.openstack.requestlog [None req-f68f1e13-c721-4ac3-9746-a55060ac176a tempest-ServerRescueNegativeTestJSON-1573931620 tempest-ServerRescueNegativeTestJSON-1573931620-project] 10.222.0.49 "DELETE /compute/v2.1/servers/eb6e04a4-8901-47df-9b51-7c1664bd3f6c/os-volume_attachments/114b9795-4e4c-4e93-a120-0d2eafeb4b02" status: 409 len: 152 microversion: 2.1 time: 0.097001 Dec 14 13:01:36.931262 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: [pid: 116063|app: 0|req: 330/634] 10.222.0.49 () {58 vars in 1415 bytes} [Tue Dec 14 13:01:36 2021] DELETE /compute/v2.1/servers/eb6e04a4-8901-47df-9b51-7c1664bd3f6c/os-volume_attachments/114b9795-4e4c-4e93-a120-0d2eafeb4b02 => generated 152 bytes in 98 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Dec 14 13:01:36.939819 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.api.openstack.wsgi [None req-2a1493b7-b58b-4afd-b79b-4337a27e98a4 tempest-ServerRescueNegativeTestJSON-1573931620 tempest-ServerRescueNegativeTestJSON-1573931620-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=116064) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 14 13:01:36.940357 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.compute.api [None req-2a1493b7-b58b-4afd-b79b-4337a27e98a4 tempest-ServerRescueNegativeTestJSON-1573931620 tempest-ServerRescueNegativeTestJSON-1573931620-project] [instance: eb6e04a4-8901-47df-9b51-7c1664bd3f6c] Fetching instance by UUID {{(pid=116064) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 13:01:36.946787 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-2a1493b7-b58b-4afd-b79b-4337a27e98a4 tempest-ServerRescueNegativeTestJSON-1573931620 tempest-ServerRescueNegativeTestJSON-1573931620-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 13:01:36.947236 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-2a1493b7-b58b-4afd-b79b-4337a27e98a4 tempest-ServerRescueNegativeTestJSON-1573931620 tempest-ServerRescueNegativeTestJSON-1573931620-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 13:01:36.948012 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-2a1493b7-b58b-4afd-b79b-4337a27e98a4 tempest-ServerRescueNegativeTestJSON-1573931620 tempest-ServerRescueNegativeTestJSON-1573931620-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 13:01:36.948440 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-2a1493b7-b58b-4afd-b79b-4337a27e98a4 tempest-ServerRescueNegativeTestJSON-1573931620 tempest-ServerRescueNegativeTestJSON-1573931620-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 13:01:37.014308 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: INFO nova.api.openstack.requestlog [None req-2a1493b7-b58b-4afd-b79b-4337a27e98a4 tempest-ServerRescueNegativeTestJSON-1573931620 tempest-ServerRescueNegativeTestJSON-1573931620-project] 10.222.0.49 "POST /compute/v2.1/servers/eb6e04a4-8901-47df-9b51-7c1664bd3f6c/action" status: 202 len: 0 microversion: 2.1 time: 0.078040 Dec 14 13:01:37.017957 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: [pid: 116064|app: 0|req: 305/635] 10.222.0.49 () {60 vars in 1277 bytes} [Tue Dec 14 13:01:36 2021] POST /compute/v2.1/servers/eb6e04a4-8901-47df-9b51-7c1664bd3f6c/action => generated 0 bytes in 79 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Dec 14 13:01:37.023156 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.api.openstack.wsgi [None req-98028339-6b7b-4866-9a3d-8044852ec7bd tempest-ServerRescueNegativeTestJSON-1573931620 tempest-ServerRescueNegativeTestJSON-1573931620-project] Calling method '>' {{(pid=116063) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 13:01:37.023758 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.compute.api [None req-98028339-6b7b-4866-9a3d-8044852ec7bd tempest-ServerRescueNegativeTestJSON-1573931620 tempest-ServerRescueNegativeTestJSON-1573931620-project] [instance: eb6e04a4-8901-47df-9b51-7c1664bd3f6c] Fetching instance by UUID {{(pid=116063) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 13:01:37.030947 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-98028339-6b7b-4866-9a3d-8044852ec7bd tempest-ServerRescueNegativeTestJSON-1573931620 tempest-ServerRescueNegativeTestJSON-1573931620-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 13:01:37.031375 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-98028339-6b7b-4866-9a3d-8044852ec7bd tempest-ServerRescueNegativeTestJSON-1573931620 tempest-ServerRescueNegativeTestJSON-1573931620-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 13:01:37.032352 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-98028339-6b7b-4866-9a3d-8044852ec7bd tempest-ServerRescueNegativeTestJSON-1573931620 tempest-ServerRescueNegativeTestJSON-1573931620-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 13:01:37.032781 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-98028339-6b7b-4866-9a3d-8044852ec7bd tempest-ServerRescueNegativeTestJSON-1573931620 tempest-ServerRescueNegativeTestJSON-1573931620-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 13:01:37.164081 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.api.openstack.wsgi [None req-57326868-c5e5-47eb-a1fd-9218b1420087 tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] Calling method '>' {{(pid=116064) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 13:01:37.164883 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.compute.api [None req-57326868-c5e5-47eb-a1fd-9218b1420087 tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] [instance: c8de7730-62f2-4a77-b1e9-cf6a74fa366d] Fetching instance by UUID {{(pid=116064) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 13:01:37.171788 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-57326868-c5e5-47eb-a1fd-9218b1420087 tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 13:01:37.172245 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-57326868-c5e5-47eb-a1fd-9218b1420087 tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 13:01:37.173075 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-57326868-c5e5-47eb-a1fd-9218b1420087 tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 13:01:37.173503 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-57326868-c5e5-47eb-a1fd-9218b1420087 tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 13:01:37.179593 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.policy [None req-98028339-6b7b-4866-9a3d-8044852ec7bd tempest-ServerRescueNegativeTestJSON-1573931620 tempest-ServerRescueNegativeTestJSON-1573931620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '731cbbfe17214ded8ac66299d66dfc45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '010919ea84eb4eb8b936c63153600eba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116063) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 13:01:37.187985 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: INFO nova.api.openstack.requestlog [None req-98028339-6b7b-4866-9a3d-8044852ec7bd tempest-ServerRescueNegativeTestJSON-1573931620 tempest-ServerRescueNegativeTestJSON-1573931620-project] 10.222.0.49 "GET /compute/v2.1/servers/eb6e04a4-8901-47df-9b51-7c1664bd3f6c" status: 200 len: 1557 microversion: 2.1 time: 0.168458 Dec 14 13:01:37.188553 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: [pid: 116063|app: 0|req: 331/636] 10.222.0.49 () {58 vars in 1235 bytes} [Tue Dec 14 13:01:37 2021] GET /compute/v2.1/servers/eb6e04a4-8901-47df-9b51-7c1664bd3f6c => generated 1557 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 14 13:01:37.311067 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.policy [None req-57326868-c5e5-47eb-a1fd-9218b1420087 tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79d74a2ea1e541d28d085c15cec34032', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68a8770b8dbe489a8119016fbee64eb5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116064) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 13:01:37.319336 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.policy [None req-57326868-c5e5-47eb-a1fd-9218b1420087 tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '79d74a2ea1e541d28d085c15cec34032', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68a8770b8dbe489a8119016fbee64eb5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116064) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 13:01:37.320825 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.policy [None req-57326868-c5e5-47eb-a1fd-9218b1420087 tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '79d74a2ea1e541d28d085c15cec34032', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68a8770b8dbe489a8119016fbee64eb5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116064) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 13:01:37.321992 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: INFO nova.api.openstack.requestlog [None req-57326868-c5e5-47eb-a1fd-9218b1420087 tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] 10.222.0.49 "GET /compute/v2.1/servers/c8de7730-62f2-4a77-b1e9-cf6a74fa366d" status: 200 len: 1809 microversion: 2.20 time: 0.162037 Dec 14 13:01:37.322572 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: [pid: 116064|app: 0|req: 306/637] 10.222.0.49 () {60 vars in 1276 bytes} [Tue Dec 14 13:01:37 2021] GET /compute/v2.1/servers/c8de7730-62f2-4a77-b1e9-cf6a74fa366d => generated 1809 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Dec 14 13:01:38.210045 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.api.openstack.wsgi [None req-fe59312f-753f-4042-8de7-e207051c6174 tempest-ServerRescueNegativeTestJSON-1573931620 tempest-ServerRescueNegativeTestJSON-1573931620-project] Calling method '>' {{(pid=116063) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 13:01:38.211047 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.compute.api [None req-fe59312f-753f-4042-8de7-e207051c6174 tempest-ServerRescueNegativeTestJSON-1573931620 tempest-ServerRescueNegativeTestJSON-1573931620-project] [instance: eb6e04a4-8901-47df-9b51-7c1664bd3f6c] Fetching instance by UUID {{(pid=116063) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 13:01:38.221613 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-fe59312f-753f-4042-8de7-e207051c6174 tempest-ServerRescueNegativeTestJSON-1573931620 tempest-ServerRescueNegativeTestJSON-1573931620-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 13:01:38.222351 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-fe59312f-753f-4042-8de7-e207051c6174 tempest-ServerRescueNegativeTestJSON-1573931620 tempest-ServerRescueNegativeTestJSON-1573931620-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 13:01:38.223618 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-fe59312f-753f-4042-8de7-e207051c6174 tempest-ServerRescueNegativeTestJSON-1573931620 tempest-ServerRescueNegativeTestJSON-1573931620-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 13:01:38.224335 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-fe59312f-753f-4042-8de7-e207051c6174 tempest-ServerRescueNegativeTestJSON-1573931620 tempest-ServerRescueNegativeTestJSON-1573931620-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 13:01:38.339408 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.api.openstack.wsgi [None req-6232bdcb-7e71-4da7-8175-59656f387f3f tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] Calling method '>' {{(pid=116064) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 13:01:38.340034 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.compute.api [None req-6232bdcb-7e71-4da7-8175-59656f387f3f tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] [instance: c8de7730-62f2-4a77-b1e9-cf6a74fa366d] Fetching instance by UUID {{(pid=116064) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 13:01:38.346764 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-6232bdcb-7e71-4da7-8175-59656f387f3f tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 13:01:38.347212 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-6232bdcb-7e71-4da7-8175-59656f387f3f tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 13:01:38.347996 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-6232bdcb-7e71-4da7-8175-59656f387f3f tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 13:01:38.348428 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-6232bdcb-7e71-4da7-8175-59656f387f3f tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 13:01:38.361918 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.policy [None req-fe59312f-753f-4042-8de7-e207051c6174 tempest-ServerRescueNegativeTestJSON-1573931620 tempest-ServerRescueNegativeTestJSON-1573931620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '731cbbfe17214ded8ac66299d66dfc45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '010919ea84eb4eb8b936c63153600eba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116063) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 13:01:38.370750 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: INFO nova.api.openstack.requestlog [None req-fe59312f-753f-4042-8de7-e207051c6174 tempest-ServerRescueNegativeTestJSON-1573931620 tempest-ServerRescueNegativeTestJSON-1573931620-project] 10.222.0.49 "GET /compute/v2.1/servers/eb6e04a4-8901-47df-9b51-7c1664bd3f6c" status: 200 len: 1557 microversion: 2.1 time: 0.166971 Dec 14 13:01:38.371311 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: [pid: 116063|app: 0|req: 332/638] 10.222.0.49 () {58 vars in 1235 bytes} [Tue Dec 14 13:01:38 2021] GET /compute/v2.1/servers/eb6e04a4-8901-47df-9b51-7c1664bd3f6c => generated 1557 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 14 13:01:38.489347 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.policy [None req-6232bdcb-7e71-4da7-8175-59656f387f3f tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79d74a2ea1e541d28d085c15cec34032', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68a8770b8dbe489a8119016fbee64eb5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116064) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 13:01:38.498089 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.policy [None req-6232bdcb-7e71-4da7-8175-59656f387f3f tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '79d74a2ea1e541d28d085c15cec34032', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68a8770b8dbe489a8119016fbee64eb5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116064) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 13:01:38.499666 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.policy [None req-6232bdcb-7e71-4da7-8175-59656f387f3f tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '79d74a2ea1e541d28d085c15cec34032', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68a8770b8dbe489a8119016fbee64eb5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116064) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 13:01:38.500820 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: INFO nova.api.openstack.requestlog [None req-6232bdcb-7e71-4da7-8175-59656f387f3f tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] 10.222.0.49 "GET /compute/v2.1/servers/c8de7730-62f2-4a77-b1e9-cf6a74fa366d" status: 200 len: 1809 microversion: 2.20 time: 0.165156 Dec 14 13:01:38.501407 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: [pid: 116064|app: 0|req: 307/639] 10.222.0.49 () {60 vars in 1276 bytes} [Tue Dec 14 13:01:38 2021] GET /compute/v2.1/servers/c8de7730-62f2-4a77-b1e9-cf6a74fa366d => generated 1809 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 14 13:01:39.391183 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.api.openstack.wsgi [None req-2246030e-70a1-4e31-8aa2-cd2f9dbb70bf tempest-ServerRescueNegativeTestJSON-1573931620 tempest-ServerRescueNegativeTestJSON-1573931620-project] Calling method '>' {{(pid=116063) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 13:01:39.392178 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.compute.api [None req-2246030e-70a1-4e31-8aa2-cd2f9dbb70bf tempest-ServerRescueNegativeTestJSON-1573931620 tempest-ServerRescueNegativeTestJSON-1573931620-project] [instance: eb6e04a4-8901-47df-9b51-7c1664bd3f6c] Fetching instance by UUID {{(pid=116063) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 13:01:39.403575 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-2246030e-70a1-4e31-8aa2-cd2f9dbb70bf tempest-ServerRescueNegativeTestJSON-1573931620 tempest-ServerRescueNegativeTestJSON-1573931620-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 13:01:39.404344 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-2246030e-70a1-4e31-8aa2-cd2f9dbb70bf tempest-ServerRescueNegativeTestJSON-1573931620 tempest-ServerRescueNegativeTestJSON-1573931620-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 13:01:39.405650 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-2246030e-70a1-4e31-8aa2-cd2f9dbb70bf tempest-ServerRescueNegativeTestJSON-1573931620 tempest-ServerRescueNegativeTestJSON-1573931620-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 13:01:39.406080 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-2246030e-70a1-4e31-8aa2-cd2f9dbb70bf tempest-ServerRescueNegativeTestJSON-1573931620 tempest-ServerRescueNegativeTestJSON-1573931620-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 13:01:39.519341 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.api.openstack.wsgi [None req-77f4e3a2-aad7-43f5-9beb-f8739cde2bd2 tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] Calling method '>' {{(pid=116064) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 13:01:39.519890 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.compute.api [None req-77f4e3a2-aad7-43f5-9beb-f8739cde2bd2 tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] [instance: c8de7730-62f2-4a77-b1e9-cf6a74fa366d] Fetching instance by UUID {{(pid=116064) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 13:01:39.526465 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-77f4e3a2-aad7-43f5-9beb-f8739cde2bd2 tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 13:01:39.526909 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-77f4e3a2-aad7-43f5-9beb-f8739cde2bd2 tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 13:01:39.527690 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-77f4e3a2-aad7-43f5-9beb-f8739cde2bd2 tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 13:01:39.528121 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-77f4e3a2-aad7-43f5-9beb-f8739cde2bd2 tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 13:01:39.539208 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.policy [None req-2246030e-70a1-4e31-8aa2-cd2f9dbb70bf tempest-ServerRescueNegativeTestJSON-1573931620 tempest-ServerRescueNegativeTestJSON-1573931620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '731cbbfe17214ded8ac66299d66dfc45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '010919ea84eb4eb8b936c63153600eba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116063) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 13:01:39.547910 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: INFO nova.api.openstack.requestlog [None req-2246030e-70a1-4e31-8aa2-cd2f9dbb70bf tempest-ServerRescueNegativeTestJSON-1573931620 tempest-ServerRescueNegativeTestJSON-1573931620-project] 10.222.0.49 "GET /compute/v2.1/servers/eb6e04a4-8901-47df-9b51-7c1664bd3f6c" status: 200 len: 1557 microversion: 2.1 time: 0.162774 Dec 14 13:01:39.548463 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: [pid: 116063|app: 0|req: 333/640] 10.222.0.49 () {58 vars in 1235 bytes} [Tue Dec 14 13:01:39 2021] GET /compute/v2.1/servers/eb6e04a4-8901-47df-9b51-7c1664bd3f6c => generated 1557 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 14 13:01:39.665881 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.policy [None req-77f4e3a2-aad7-43f5-9beb-f8739cde2bd2 tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79d74a2ea1e541d28d085c15cec34032', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68a8770b8dbe489a8119016fbee64eb5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116064) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 13:01:39.674687 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.policy [None req-77f4e3a2-aad7-43f5-9beb-f8739cde2bd2 tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '79d74a2ea1e541d28d085c15cec34032', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68a8770b8dbe489a8119016fbee64eb5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116064) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 13:01:39.676189 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.policy [None req-77f4e3a2-aad7-43f5-9beb-f8739cde2bd2 tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '79d74a2ea1e541d28d085c15cec34032', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68a8770b8dbe489a8119016fbee64eb5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116064) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 13:01:39.677376 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: INFO nova.api.openstack.requestlog [None req-77f4e3a2-aad7-43f5-9beb-f8739cde2bd2 tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] 10.222.0.49 "GET /compute/v2.1/servers/c8de7730-62f2-4a77-b1e9-cf6a74fa366d" status: 200 len: 1809 microversion: 2.20 time: 0.161756 Dec 14 13:01:39.677904 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: [pid: 116064|app: 0|req: 308/641] 10.222.0.49 () {60 vars in 1276 bytes} [Tue Dec 14 13:01:39 2021] GET /compute/v2.1/servers/c8de7730-62f2-4a77-b1e9-cf6a74fa366d => generated 1809 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 14 13:01:40.565234 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.api.openstack.wsgi [None req-df54fc54-32c4-4d8b-9dc5-483a6c1a26f8 tempest-ServerRescueNegativeTestJSON-1573931620 tempest-ServerRescueNegativeTestJSON-1573931620-project] Calling method '>' {{(pid=116063) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 13:01:40.565957 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.compute.api [None req-df54fc54-32c4-4d8b-9dc5-483a6c1a26f8 tempest-ServerRescueNegativeTestJSON-1573931620 tempest-ServerRescueNegativeTestJSON-1573931620-project] [instance: eb6e04a4-8901-47df-9b51-7c1664bd3f6c] Fetching instance by UUID {{(pid=116063) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 13:01:40.572708 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-df54fc54-32c4-4d8b-9dc5-483a6c1a26f8 tempest-ServerRescueNegativeTestJSON-1573931620 tempest-ServerRescueNegativeTestJSON-1573931620-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 13:01:40.573206 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-df54fc54-32c4-4d8b-9dc5-483a6c1a26f8 tempest-ServerRescueNegativeTestJSON-1573931620 tempest-ServerRescueNegativeTestJSON-1573931620-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 13:01:40.573978 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-df54fc54-32c4-4d8b-9dc5-483a6c1a26f8 tempest-ServerRescueNegativeTestJSON-1573931620 tempest-ServerRescueNegativeTestJSON-1573931620-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 13:01:40.574406 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-df54fc54-32c4-4d8b-9dc5-483a6c1a26f8 tempest-ServerRescueNegativeTestJSON-1573931620 tempest-ServerRescueNegativeTestJSON-1573931620-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 13:01:40.695431 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.api.openstack.wsgi [None req-e1e946c2-0238-4564-b94b-3fd723fbd18b tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] Calling method '>' {{(pid=116064) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 13:01:40.696019 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.compute.api [None req-e1e946c2-0238-4564-b94b-3fd723fbd18b tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] [instance: c8de7730-62f2-4a77-b1e9-cf6a74fa366d] Fetching instance by UUID {{(pid=116064) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 13:01:40.702830 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-e1e946c2-0238-4564-b94b-3fd723fbd18b tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 13:01:40.703321 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-e1e946c2-0238-4564-b94b-3fd723fbd18b tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 13:01:40.704099 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-e1e946c2-0238-4564-b94b-3fd723fbd18b tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 13:01:40.704527 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-e1e946c2-0238-4564-b94b-3fd723fbd18b tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 13:01:40.707760 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.policy [None req-df54fc54-32c4-4d8b-9dc5-483a6c1a26f8 tempest-ServerRescueNegativeTestJSON-1573931620 tempest-ServerRescueNegativeTestJSON-1573931620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '731cbbfe17214ded8ac66299d66dfc45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '010919ea84eb4eb8b936c63153600eba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116063) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 13:01:40.716989 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: INFO nova.api.openstack.requestlog [None req-df54fc54-32c4-4d8b-9dc5-483a6c1a26f8 tempest-ServerRescueNegativeTestJSON-1573931620 tempest-ServerRescueNegativeTestJSON-1573931620-project] 10.222.0.49 "GET /compute/v2.1/servers/eb6e04a4-8901-47df-9b51-7c1664bd3f6c" status: 200 len: 1557 microversion: 2.1 time: 0.155468 Dec 14 13:01:40.717593 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: [pid: 116063|app: 0|req: 334/642] 10.222.0.49 () {58 vars in 1235 bytes} [Tue Dec 14 13:01:40 2021] GET /compute/v2.1/servers/eb6e04a4-8901-47df-9b51-7c1664bd3f6c => generated 1557 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 14 13:01:40.845345 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.policy [None req-e1e946c2-0238-4564-b94b-3fd723fbd18b tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79d74a2ea1e541d28d085c15cec34032', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68a8770b8dbe489a8119016fbee64eb5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116064) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 13:01:40.854060 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.policy [None req-e1e946c2-0238-4564-b94b-3fd723fbd18b tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '79d74a2ea1e541d28d085c15cec34032', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68a8770b8dbe489a8119016fbee64eb5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116064) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 13:01:40.855945 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.policy [None req-e1e946c2-0238-4564-b94b-3fd723fbd18b tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '79d74a2ea1e541d28d085c15cec34032', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68a8770b8dbe489a8119016fbee64eb5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116064) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 13:01:40.856722 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: INFO nova.api.openstack.requestlog [None req-e1e946c2-0238-4564-b94b-3fd723fbd18b tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] 10.222.0.49 "GET /compute/v2.1/servers/c8de7730-62f2-4a77-b1e9-cf6a74fa366d" status: 200 len: 1809 microversion: 2.20 time: 0.164928 Dec 14 13:01:40.857652 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: [pid: 116064|app: 0|req: 309/643] 10.222.0.49 () {60 vars in 1276 bytes} [Tue Dec 14 13:01:40 2021] GET /compute/v2.1/servers/c8de7730-62f2-4a77-b1e9-cf6a74fa366d => generated 1809 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 14 13:01:41.470490 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.api.openstack.wsgi [req-0cceee04-a9a4-4214-b966-0f1ac3a16949 req-00e8c2cf-f793-4338-9ab6-e2c7f0d5bcae service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c8de7730-62f2-4a77-b1e9-cf6a74fa366d", "name": "network-vif-plugged", "status": "completed", "tag": "45d34d58-1ff8-4ce3-a024-e2acb9451196"}]} {{(pid=116063) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 14 13:01:41.472095 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 14 13:01:41.472095 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: warnings.warn(msg) Dec 14 13:01:41.480416 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [req-0cceee04-a9a4-4214-b966-0f1ac3a16949 req-00e8c2cf-f793-4338-9ab6-e2c7f0d5bcae service nova] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 13:01:41.480939 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [req-0cceee04-a9a4-4214-b966-0f1ac3a16949 req-00e8c2cf-f793-4338-9ab6-e2c7f0d5bcae service nova] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 13:01:41.495661 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: INFO nova.api.openstack.compute.server_external_events [req-0cceee04-a9a4-4214-b966-0f1ac3a16949 req-00e8c2cf-f793-4338-9ab6-e2c7f0d5bcae service nova] Creating event network-vif-plugged:45d34d58-1ff8-4ce3-a024-e2acb9451196 for instance c8de7730-62f2-4a77-b1e9-cf6a74fa366d on hv-cinder-78447 Dec 14 13:01:41.501057 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: INFO nova.api.openstack.requestlog [req-0cceee04-a9a4-4214-b966-0f1ac3a16949 req-00e8c2cf-f793-4338-9ab6-e2c7f0d5bcae service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034389 Dec 14 13:01:41.501807 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: [pid: 116063|app: 0|req: 335/644] 10.222.0.49 () {64 vars in 1317 bytes} [Tue Dec 14 13:01:41 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 14 13:01:41.736332 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.api.openstack.wsgi [None req-ee0e1536-c783-4644-84e7-664c75cb87c2 tempest-ServerRescueNegativeTestJSON-1573931620 tempest-ServerRescueNegativeTestJSON-1573931620-project] Calling method '>' {{(pid=116064) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 13:01:41.736982 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.compute.api [None req-ee0e1536-c783-4644-84e7-664c75cb87c2 tempest-ServerRescueNegativeTestJSON-1573931620 tempest-ServerRescueNegativeTestJSON-1573931620-project] [instance: eb6e04a4-8901-47df-9b51-7c1664bd3f6c] Fetching instance by UUID {{(pid=116064) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 13:01:41.743785 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-ee0e1536-c783-4644-84e7-664c75cb87c2 tempest-ServerRescueNegativeTestJSON-1573931620 tempest-ServerRescueNegativeTestJSON-1573931620-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 13:01:41.744271 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-ee0e1536-c783-4644-84e7-664c75cb87c2 tempest-ServerRescueNegativeTestJSON-1573931620 tempest-ServerRescueNegativeTestJSON-1573931620-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 13:01:41.745088 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-ee0e1536-c783-4644-84e7-664c75cb87c2 tempest-ServerRescueNegativeTestJSON-1573931620 tempest-ServerRescueNegativeTestJSON-1573931620-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 13:01:41.745518 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-ee0e1536-c783-4644-84e7-664c75cb87c2 tempest-ServerRescueNegativeTestJSON-1573931620 tempest-ServerRescueNegativeTestJSON-1573931620-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 13:01:41.875673 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.api.openstack.wsgi [None req-fb153332-ff06-4871-aa01-7521ff6386c4 tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] Calling method '>' {{(pid=116063) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 13:01:41.876366 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.compute.api [None req-fb153332-ff06-4871-aa01-7521ff6386c4 tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] [instance: c8de7730-62f2-4a77-b1e9-cf6a74fa366d] Fetching instance by UUID {{(pid=116063) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 13:01:41.880783 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.policy [None req-ee0e1536-c783-4644-84e7-664c75cb87c2 tempest-ServerRescueNegativeTestJSON-1573931620 tempest-ServerRescueNegativeTestJSON-1573931620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '731cbbfe17214ded8ac66299d66dfc45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '010919ea84eb4eb8b936c63153600eba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116064) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 13:01:41.883213 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-fb153332-ff06-4871-aa01-7521ff6386c4 tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 13:01:41.883657 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-fb153332-ff06-4871-aa01-7521ff6386c4 tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 13:01:41.884450 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-fb153332-ff06-4871-aa01-7521ff6386c4 tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 13:01:41.884885 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-fb153332-ff06-4871-aa01-7521ff6386c4 tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 13:01:41.888672 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: INFO nova.api.openstack.requestlog [None req-ee0e1536-c783-4644-84e7-664c75cb87c2 tempest-ServerRescueNegativeTestJSON-1573931620 tempest-ServerRescueNegativeTestJSON-1573931620-project] 10.222.0.49 "GET /compute/v2.1/servers/eb6e04a4-8901-47df-9b51-7c1664bd3f6c" status: 200 len: 1557 microversion: 2.1 time: 0.156913 Dec 14 13:01:41.889267 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: [pid: 116064|app: 0|req: 310/645] 10.222.0.49 () {58 vars in 1235 bytes} [Tue Dec 14 13:01:41 2021] GET /compute/v2.1/servers/eb6e04a4-8901-47df-9b51-7c1664bd3f6c => generated 1557 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 14 13:01:42.022217 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.policy [None req-fb153332-ff06-4871-aa01-7521ff6386c4 tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79d74a2ea1e541d28d085c15cec34032', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68a8770b8dbe489a8119016fbee64eb5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116063) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 13:01:42.028784 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.policy [None req-fb153332-ff06-4871-aa01-7521ff6386c4 tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '79d74a2ea1e541d28d085c15cec34032', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68a8770b8dbe489a8119016fbee64eb5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116063) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 13:01:42.030392 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.policy [None req-fb153332-ff06-4871-aa01-7521ff6386c4 tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '79d74a2ea1e541d28d085c15cec34032', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68a8770b8dbe489a8119016fbee64eb5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116063) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 13:01:42.031526 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: INFO nova.api.openstack.requestlog [None req-fb153332-ff06-4871-aa01-7521ff6386c4 tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] 10.222.0.49 "GET /compute/v2.1/servers/c8de7730-62f2-4a77-b1e9-cf6a74fa366d" status: 200 len: 1809 microversion: 2.20 time: 0.160043 Dec 14 13:01:42.032069 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: [pid: 116063|app: 0|req: 336/646] 10.222.0.49 () {60 vars in 1276 bytes} [Tue Dec 14 13:01:41 2021] GET /compute/v2.1/servers/c8de7730-62f2-4a77-b1e9-cf6a74fa366d => generated 1809 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 14 13:01:42.905659 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.api.openstack.wsgi [None req-202c5b2e-01fa-4bbc-bb8d-53e64eb18ad4 tempest-ServerRescueNegativeTestJSON-1573931620 tempest-ServerRescueNegativeTestJSON-1573931620-project] Calling method '>' {{(pid=116064) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 13:01:42.906466 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.compute.api [None req-202c5b2e-01fa-4bbc-bb8d-53e64eb18ad4 tempest-ServerRescueNegativeTestJSON-1573931620 tempest-ServerRescueNegativeTestJSON-1573931620-project] [instance: eb6e04a4-8901-47df-9b51-7c1664bd3f6c] Fetching instance by UUID {{(pid=116064) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 13:01:42.915218 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-202c5b2e-01fa-4bbc-bb8d-53e64eb18ad4 tempest-ServerRescueNegativeTestJSON-1573931620 tempest-ServerRescueNegativeTestJSON-1573931620-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 13:01:42.915825 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-202c5b2e-01fa-4bbc-bb8d-53e64eb18ad4 tempest-ServerRescueNegativeTestJSON-1573931620 tempest-ServerRescueNegativeTestJSON-1573931620-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 13:01:42.916889 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-202c5b2e-01fa-4bbc-bb8d-53e64eb18ad4 tempest-ServerRescueNegativeTestJSON-1573931620 tempest-ServerRescueNegativeTestJSON-1573931620-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 13:01:42.917502 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-202c5b2e-01fa-4bbc-bb8d-53e64eb18ad4 tempest-ServerRescueNegativeTestJSON-1573931620 tempest-ServerRescueNegativeTestJSON-1573931620-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 13:01:43.049919 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.api.openstack.wsgi [None req-8576eed7-f4f5-42a2-8350-6014911a5d92 tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] Calling method '>' {{(pid=116063) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 13:01:43.051123 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.compute.api [None req-8576eed7-f4f5-42a2-8350-6014911a5d92 tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] [instance: c8de7730-62f2-4a77-b1e9-cf6a74fa366d] Fetching instance by UUID {{(pid=116063) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 13:01:43.057618 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-8576eed7-f4f5-42a2-8350-6014911a5d92 tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 13:01:43.058055 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-8576eed7-f4f5-42a2-8350-6014911a5d92 tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 13:01:43.058829 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-8576eed7-f4f5-42a2-8350-6014911a5d92 tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 13:01:43.059049 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.policy [None req-202c5b2e-01fa-4bbc-bb8d-53e64eb18ad4 tempest-ServerRescueNegativeTestJSON-1573931620 tempest-ServerRescueNegativeTestJSON-1573931620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '731cbbfe17214ded8ac66299d66dfc45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '010919ea84eb4eb8b936c63153600eba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116064) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 13:01:43.059235 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-8576eed7-f4f5-42a2-8350-6014911a5d92 tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 13:01:43.067235 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: INFO nova.api.openstack.requestlog [None req-202c5b2e-01fa-4bbc-bb8d-53e64eb18ad4 tempest-ServerRescueNegativeTestJSON-1573931620 tempest-ServerRescueNegativeTestJSON-1573931620-project] 10.222.0.49 "GET /compute/v2.1/servers/eb6e04a4-8901-47df-9b51-7c1664bd3f6c" status: 200 len: 1557 microversion: 2.1 time: 0.165483 Dec 14 13:01:43.077151 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: [pid: 116064|app: 0|req: 311/647] 10.222.0.49 () {58 vars in 1235 bytes} [Tue Dec 14 13:01:42 2021] GET /compute/v2.1/servers/eb6e04a4-8901-47df-9b51-7c1664bd3f6c => generated 1557 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 14 13:01:43.195872 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.policy [None req-8576eed7-f4f5-42a2-8350-6014911a5d92 tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79d74a2ea1e541d28d085c15cec34032', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68a8770b8dbe489a8119016fbee64eb5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116063) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 13:01:43.204943 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.policy [None req-8576eed7-f4f5-42a2-8350-6014911a5d92 tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '79d74a2ea1e541d28d085c15cec34032', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68a8770b8dbe489a8119016fbee64eb5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116063) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 13:01:43.206436 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.policy [None req-8576eed7-f4f5-42a2-8350-6014911a5d92 tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '79d74a2ea1e541d28d085c15cec34032', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68a8770b8dbe489a8119016fbee64eb5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116063) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 13:01:43.207594 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: INFO nova.api.openstack.requestlog [None req-8576eed7-f4f5-42a2-8350-6014911a5d92 tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] 10.222.0.49 "GET /compute/v2.1/servers/c8de7730-62f2-4a77-b1e9-cf6a74fa366d" status: 200 len: 1809 microversion: 2.20 time: 0.161380 Dec 14 13:01:43.208184 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: [pid: 116063|app: 0|req: 337/648] 10.222.0.49 () {60 vars in 1276 bytes} [Tue Dec 14 13:01:43 2021] GET /compute/v2.1/servers/c8de7730-62f2-4a77-b1e9-cf6a74fa366d => generated 1809 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Dec 14 13:01:44.088145 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.api.openstack.wsgi [None req-2412a29d-5038-4a97-80b8-a6583e12c39c tempest-ServerRescueNegativeTestJSON-1573931620 tempest-ServerRescueNegativeTestJSON-1573931620-project] Calling method '>' {{(pid=116064) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 13:01:44.089200 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.compute.api [None req-2412a29d-5038-4a97-80b8-a6583e12c39c tempest-ServerRescueNegativeTestJSON-1573931620 tempest-ServerRescueNegativeTestJSON-1573931620-project] [instance: eb6e04a4-8901-47df-9b51-7c1664bd3f6c] Fetching instance by UUID {{(pid=116064) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 13:01:44.099928 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-2412a29d-5038-4a97-80b8-a6583e12c39c tempest-ServerRescueNegativeTestJSON-1573931620 tempest-ServerRescueNegativeTestJSON-1573931620-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 13:01:44.100693 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-2412a29d-5038-4a97-80b8-a6583e12c39c tempest-ServerRescueNegativeTestJSON-1573931620 tempest-ServerRescueNegativeTestJSON-1573931620-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 13:01:44.102043 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-2412a29d-5038-4a97-80b8-a6583e12c39c tempest-ServerRescueNegativeTestJSON-1573931620 tempest-ServerRescueNegativeTestJSON-1573931620-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 13:01:44.102797 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-2412a29d-5038-4a97-80b8-a6583e12c39c tempest-ServerRescueNegativeTestJSON-1573931620 tempest-ServerRescueNegativeTestJSON-1573931620-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 13:01:44.227080 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.api.openstack.wsgi [None req-baa99f73-f7a2-4e5a-b176-86ffc21110d2 tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] Calling method '>' {{(pid=116063) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 13:01:44.228768 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.compute.api [None req-baa99f73-f7a2-4e5a-b176-86ffc21110d2 tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] [instance: c8de7730-62f2-4a77-b1e9-cf6a74fa366d] Fetching instance by UUID {{(pid=116063) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 13:01:44.237310 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-baa99f73-f7a2-4e5a-b176-86ffc21110d2 tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 13:01:44.238191 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-baa99f73-f7a2-4e5a-b176-86ffc21110d2 tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 13:01:44.239362 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-baa99f73-f7a2-4e5a-b176-86ffc21110d2 tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 13:01:44.240000 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-baa99f73-f7a2-4e5a-b176-86ffc21110d2 tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 13:01:44.243256 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.policy [None req-2412a29d-5038-4a97-80b8-a6583e12c39c tempest-ServerRescueNegativeTestJSON-1573931620 tempest-ServerRescueNegativeTestJSON-1573931620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '731cbbfe17214ded8ac66299d66dfc45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '010919ea84eb4eb8b936c63153600eba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116064) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 13:01:44.253883 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: INFO nova.api.openstack.requestlog [None req-2412a29d-5038-4a97-80b8-a6583e12c39c tempest-ServerRescueNegativeTestJSON-1573931620 tempest-ServerRescueNegativeTestJSON-1573931620-project] 10.222.0.49 "GET /compute/v2.1/servers/eb6e04a4-8901-47df-9b51-7c1664bd3f6c" status: 200 len: 1557 microversion: 2.1 time: 0.171876 Dec 14 13:01:44.254832 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: [pid: 116064|app: 0|req: 312/649] 10.222.0.49 () {58 vars in 1235 bytes} [Tue Dec 14 13:01:44 2021] GET /compute/v2.1/servers/eb6e04a4-8901-47df-9b51-7c1664bd3f6c => generated 1557 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 14 13:01:44.411144 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.policy [None req-baa99f73-f7a2-4e5a-b176-86ffc21110d2 tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79d74a2ea1e541d28d085c15cec34032', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68a8770b8dbe489a8119016fbee64eb5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116063) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 13:01:44.419682 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.policy [None req-baa99f73-f7a2-4e5a-b176-86ffc21110d2 tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '79d74a2ea1e541d28d085c15cec34032', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68a8770b8dbe489a8119016fbee64eb5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116063) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 13:01:44.421659 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.policy [None req-baa99f73-f7a2-4e5a-b176-86ffc21110d2 tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '79d74a2ea1e541d28d085c15cec34032', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68a8770b8dbe489a8119016fbee64eb5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116063) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 13:01:44.422861 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: INFO nova.api.openstack.requestlog [None req-baa99f73-f7a2-4e5a-b176-86ffc21110d2 tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] 10.222.0.49 "GET /compute/v2.1/servers/c8de7730-62f2-4a77-b1e9-cf6a74fa366d" status: 200 len: 1809 microversion: 2.20 time: 0.200266 Dec 14 13:01:44.433536 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: [pid: 116063|app: 0|req: 338/650] 10.222.0.49 () {60 vars in 1276 bytes} [Tue Dec 14 13:01:44 2021] GET /compute/v2.1/servers/c8de7730-62f2-4a77-b1e9-cf6a74fa366d => generated 1809 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 14 13:01:45.275581 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.api.openstack.wsgi [None req-7f021468-0e14-4437-a0b1-2a645dbf135d tempest-ServerRescueNegativeTestJSON-1573931620 tempest-ServerRescueNegativeTestJSON-1573931620-project] Calling method '>' {{(pid=116064) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 13:01:45.276473 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.compute.api [None req-7f021468-0e14-4437-a0b1-2a645dbf135d tempest-ServerRescueNegativeTestJSON-1573931620 tempest-ServerRescueNegativeTestJSON-1573931620-project] [instance: eb6e04a4-8901-47df-9b51-7c1664bd3f6c] Fetching instance by UUID {{(pid=116064) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 13:01:45.284496 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-7f021468-0e14-4437-a0b1-2a645dbf135d tempest-ServerRescueNegativeTestJSON-1573931620 tempest-ServerRescueNegativeTestJSON-1573931620-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 13:01:45.284988 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-7f021468-0e14-4437-a0b1-2a645dbf135d tempest-ServerRescueNegativeTestJSON-1573931620 tempest-ServerRescueNegativeTestJSON-1573931620-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 13:01:45.285771 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-7f021468-0e14-4437-a0b1-2a645dbf135d tempest-ServerRescueNegativeTestJSON-1573931620 tempest-ServerRescueNegativeTestJSON-1573931620-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 13:01:45.286207 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-7f021468-0e14-4437-a0b1-2a645dbf135d tempest-ServerRescueNegativeTestJSON-1573931620 tempest-ServerRescueNegativeTestJSON-1573931620-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 13:01:45.427816 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.policy [None req-7f021468-0e14-4437-a0b1-2a645dbf135d tempest-ServerRescueNegativeTestJSON-1573931620 tempest-ServerRescueNegativeTestJSON-1573931620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '731cbbfe17214ded8ac66299d66dfc45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '010919ea84eb4eb8b936c63153600eba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116064) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 13:01:45.435851 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: INFO nova.api.openstack.requestlog [None req-7f021468-0e14-4437-a0b1-2a645dbf135d tempest-ServerRescueNegativeTestJSON-1573931620 tempest-ServerRescueNegativeTestJSON-1573931620-project] 10.222.0.49 "GET /compute/v2.1/servers/eb6e04a4-8901-47df-9b51-7c1664bd3f6c" status: 200 len: 1557 microversion: 2.1 time: 0.166577 Dec 14 13:01:45.436415 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: [pid: 116064|app: 0|req: 313/651] 10.222.0.49 () {58 vars in 1235 bytes} [Tue Dec 14 13:01:45 2021] GET /compute/v2.1/servers/eb6e04a4-8901-47df-9b51-7c1664bd3f6c => generated 1557 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 14 13:01:45.440698 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.api.openstack.wsgi [None req-e0f4a0eb-2075-45e8-b3ff-f6498879e844 tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] Calling method '>' {{(pid=116063) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 13:01:45.441348 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.compute.api [None req-e0f4a0eb-2075-45e8-b3ff-f6498879e844 tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] [instance: c8de7730-62f2-4a77-b1e9-cf6a74fa366d] Fetching instance by UUID {{(pid=116063) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 13:01:45.447605 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-e0f4a0eb-2075-45e8-b3ff-f6498879e844 tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 13:01:45.448074 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-e0f4a0eb-2075-45e8-b3ff-f6498879e844 tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 13:01:45.448842 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-e0f4a0eb-2075-45e8-b3ff-f6498879e844 tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 13:01:45.449305 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-e0f4a0eb-2075-45e8-b3ff-f6498879e844 tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 13:01:45.586922 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.policy [None req-e0f4a0eb-2075-45e8-b3ff-f6498879e844 tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79d74a2ea1e541d28d085c15cec34032', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68a8770b8dbe489a8119016fbee64eb5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116063) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 13:01:45.599882 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.policy [None req-e0f4a0eb-2075-45e8-b3ff-f6498879e844 tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '79d74a2ea1e541d28d085c15cec34032', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68a8770b8dbe489a8119016fbee64eb5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116063) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 13:01:45.602134 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.policy [None req-e0f4a0eb-2075-45e8-b3ff-f6498879e844 tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '79d74a2ea1e541d28d085c15cec34032', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68a8770b8dbe489a8119016fbee64eb5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116063) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 13:01:45.603948 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: INFO nova.api.openstack.requestlog [None req-e0f4a0eb-2075-45e8-b3ff-f6498879e844 tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] 10.222.0.49 "GET /compute/v2.1/servers/c8de7730-62f2-4a77-b1e9-cf6a74fa366d" status: 200 len: 1809 microversion: 2.20 time: 0.166654 Dec 14 13:01:45.604452 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: [pid: 116063|app: 0|req: 339/652] 10.222.0.49 () {60 vars in 1276 bytes} [Tue Dec 14 13:01:45 2021] GET /compute/v2.1/servers/c8de7730-62f2-4a77-b1e9-cf6a74fa366d => generated 1809 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Dec 14 13:01:46.452556 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.api.openstack.wsgi [None req-850f81fd-ee78-4e69-b9a7-a833db040d1b tempest-ServerRescueNegativeTestJSON-1573931620 tempest-ServerRescueNegativeTestJSON-1573931620-project] Calling method '>' {{(pid=116064) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 13:01:46.453183 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.compute.api [None req-850f81fd-ee78-4e69-b9a7-a833db040d1b tempest-ServerRescueNegativeTestJSON-1573931620 tempest-ServerRescueNegativeTestJSON-1573931620-project] [instance: eb6e04a4-8901-47df-9b51-7c1664bd3f6c] Fetching instance by UUID {{(pid=116064) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 13:01:46.459767 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-850f81fd-ee78-4e69-b9a7-a833db040d1b tempest-ServerRescueNegativeTestJSON-1573931620 tempest-ServerRescueNegativeTestJSON-1573931620-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 13:01:46.460210 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-850f81fd-ee78-4e69-b9a7-a833db040d1b tempest-ServerRescueNegativeTestJSON-1573931620 tempest-ServerRescueNegativeTestJSON-1573931620-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 13:01:46.461013 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-850f81fd-ee78-4e69-b9a7-a833db040d1b tempest-ServerRescueNegativeTestJSON-1573931620 tempest-ServerRescueNegativeTestJSON-1573931620-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 13:01:46.461441 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-850f81fd-ee78-4e69-b9a7-a833db040d1b tempest-ServerRescueNegativeTestJSON-1573931620 tempest-ServerRescueNegativeTestJSON-1573931620-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 13:01:46.591345 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.policy [None req-850f81fd-ee78-4e69-b9a7-a833db040d1b tempest-ServerRescueNegativeTestJSON-1573931620 tempest-ServerRescueNegativeTestJSON-1573931620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '731cbbfe17214ded8ac66299d66dfc45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '010919ea84eb4eb8b936c63153600eba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116064) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 13:01:46.599407 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: INFO nova.api.openstack.requestlog [None req-850f81fd-ee78-4e69-b9a7-a833db040d1b tempest-ServerRescueNegativeTestJSON-1573931620 tempest-ServerRescueNegativeTestJSON-1573931620-project] 10.222.0.49 "GET /compute/v2.1/servers/eb6e04a4-8901-47df-9b51-7c1664bd3f6c" status: 200 len: 1557 microversion: 2.1 time: 0.150641 Dec 14 13:01:46.599962 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: [pid: 116064|app: 0|req: 314/653] 10.222.0.49 () {58 vars in 1235 bytes} [Tue Dec 14 13:01:46 2021] GET /compute/v2.1/servers/eb6e04a4-8901-47df-9b51-7c1664bd3f6c => generated 1557 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 14 13:01:46.623358 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.api.openstack.wsgi [None req-7c7eae1a-3d41-4760-a71a-35ae2e5eeeeb tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] Calling method '>' {{(pid=116063) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 13:01:46.624068 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.compute.api [None req-7c7eae1a-3d41-4760-a71a-35ae2e5eeeeb tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] [instance: c8de7730-62f2-4a77-b1e9-cf6a74fa366d] Fetching instance by UUID {{(pid=116063) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 13:01:46.630322 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-7c7eae1a-3d41-4760-a71a-35ae2e5eeeeb tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 13:01:46.630764 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-7c7eae1a-3d41-4760-a71a-35ae2e5eeeeb tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 13:01:46.631535 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-7c7eae1a-3d41-4760-a71a-35ae2e5eeeeb tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 13:01:46.631963 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-7c7eae1a-3d41-4760-a71a-35ae2e5eeeeb tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 13:01:46.765811 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.policy [None req-7c7eae1a-3d41-4760-a71a-35ae2e5eeeeb tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79d74a2ea1e541d28d085c15cec34032', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68a8770b8dbe489a8119016fbee64eb5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116063) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 13:01:46.774549 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.policy [None req-7c7eae1a-3d41-4760-a71a-35ae2e5eeeeb tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '79d74a2ea1e541d28d085c15cec34032', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68a8770b8dbe489a8119016fbee64eb5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116063) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 13:01:46.776050 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.policy [None req-7c7eae1a-3d41-4760-a71a-35ae2e5eeeeb tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '79d74a2ea1e541d28d085c15cec34032', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68a8770b8dbe489a8119016fbee64eb5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116063) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 13:01:46.777231 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: INFO nova.api.openstack.requestlog [None req-7c7eae1a-3d41-4760-a71a-35ae2e5eeeeb tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] 10.222.0.49 "GET /compute/v2.1/servers/c8de7730-62f2-4a77-b1e9-cf6a74fa366d" status: 200 len: 1809 microversion: 2.20 time: 0.157533 Dec 14 13:01:46.777788 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: [pid: 116063|app: 0|req: 340/654] 10.222.0.49 () {60 vars in 1276 bytes} [Tue Dec 14 13:01:46 2021] GET /compute/v2.1/servers/c8de7730-62f2-4a77-b1e9-cf6a74fa366d => generated 1809 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 14 13:01:47.622270 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.api.openstack.wsgi [None req-6237bb41-877f-4f70-887c-45180834cf60 tempest-ServerRescueNegativeTestJSON-1573931620 tempest-ServerRescueNegativeTestJSON-1573931620-project] Calling method '>' {{(pid=116064) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 13:01:47.623306 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.compute.api [None req-6237bb41-877f-4f70-887c-45180834cf60 tempest-ServerRescueNegativeTestJSON-1573931620 tempest-ServerRescueNegativeTestJSON-1573931620-project] [instance: eb6e04a4-8901-47df-9b51-7c1664bd3f6c] Fetching instance by UUID {{(pid=116064) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 13:01:47.630410 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-6237bb41-877f-4f70-887c-45180834cf60 tempest-ServerRescueNegativeTestJSON-1573931620 tempest-ServerRescueNegativeTestJSON-1573931620-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 13:01:47.630878 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-6237bb41-877f-4f70-887c-45180834cf60 tempest-ServerRescueNegativeTestJSON-1573931620 tempest-ServerRescueNegativeTestJSON-1573931620-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 13:01:47.631695 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-6237bb41-877f-4f70-887c-45180834cf60 tempest-ServerRescueNegativeTestJSON-1573931620 tempest-ServerRescueNegativeTestJSON-1573931620-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 13:01:47.632128 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-6237bb41-877f-4f70-887c-45180834cf60 tempest-ServerRescueNegativeTestJSON-1573931620 tempest-ServerRescueNegativeTestJSON-1573931620-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 13:01:47.765033 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.policy [None req-6237bb41-877f-4f70-887c-45180834cf60 tempest-ServerRescueNegativeTestJSON-1573931620 tempest-ServerRescueNegativeTestJSON-1573931620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '731cbbfe17214ded8ac66299d66dfc45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '010919ea84eb4eb8b936c63153600eba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116064) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 13:01:47.773023 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: INFO nova.api.openstack.requestlog [None req-6237bb41-877f-4f70-887c-45180834cf60 tempest-ServerRescueNegativeTestJSON-1573931620 tempest-ServerRescueNegativeTestJSON-1573931620-project] 10.222.0.49 "GET /compute/v2.1/servers/eb6e04a4-8901-47df-9b51-7c1664bd3f6c" status: 200 len: 1557 microversion: 2.1 time: 0.158831 Dec 14 13:01:47.773582 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: [pid: 116064|app: 0|req: 315/655] 10.222.0.49 () {58 vars in 1235 bytes} [Tue Dec 14 13:01:47 2021] GET /compute/v2.1/servers/eb6e04a4-8901-47df-9b51-7c1664bd3f6c => generated 1557 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 14 13:01:47.796059 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.api.openstack.wsgi [None req-b6350611-2b8c-44ea-978f-ee07f6a31acd tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] Calling method '>' {{(pid=116063) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 13:01:47.796648 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.compute.api [None req-b6350611-2b8c-44ea-978f-ee07f6a31acd tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] [instance: c8de7730-62f2-4a77-b1e9-cf6a74fa366d] Fetching instance by UUID {{(pid=116063) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 13:01:47.803137 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-b6350611-2b8c-44ea-978f-ee07f6a31acd tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 13:01:47.803587 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-b6350611-2b8c-44ea-978f-ee07f6a31acd tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 13:01:47.804363 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-b6350611-2b8c-44ea-978f-ee07f6a31acd tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 13:01:47.804799 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-b6350611-2b8c-44ea-978f-ee07f6a31acd tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 13:01:47.937459 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.policy [None req-b6350611-2b8c-44ea-978f-ee07f6a31acd tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79d74a2ea1e541d28d085c15cec34032', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68a8770b8dbe489a8119016fbee64eb5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116063) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 13:01:47.946087 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.policy [None req-b6350611-2b8c-44ea-978f-ee07f6a31acd tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '79d74a2ea1e541d28d085c15cec34032', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68a8770b8dbe489a8119016fbee64eb5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116063) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 13:01:47.947570 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.policy [None req-b6350611-2b8c-44ea-978f-ee07f6a31acd tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '79d74a2ea1e541d28d085c15cec34032', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68a8770b8dbe489a8119016fbee64eb5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116063) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 13:01:47.948723 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: INFO nova.api.openstack.requestlog [None req-b6350611-2b8c-44ea-978f-ee07f6a31acd tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] 10.222.0.49 "GET /compute/v2.1/servers/c8de7730-62f2-4a77-b1e9-cf6a74fa366d" status: 200 len: 1809 microversion: 2.20 time: 0.156908 Dec 14 13:01:47.949516 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: [pid: 116063|app: 0|req: 341/656] 10.222.0.49 () {60 vars in 1276 bytes} [Tue Dec 14 13:01:47 2021] GET /compute/v2.1/servers/c8de7730-62f2-4a77-b1e9-cf6a74fa366d => generated 1809 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 14 13:01:48.789592 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.api.openstack.wsgi [None req-a67aebd7-2ac5-402a-b424-2e04129cc681 tempest-ServerRescueNegativeTestJSON-1573931620 tempest-ServerRescueNegativeTestJSON-1573931620-project] Calling method '>' {{(pid=116064) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 13:01:48.790171 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.compute.api [None req-a67aebd7-2ac5-402a-b424-2e04129cc681 tempest-ServerRescueNegativeTestJSON-1573931620 tempest-ServerRescueNegativeTestJSON-1573931620-project] [instance: eb6e04a4-8901-47df-9b51-7c1664bd3f6c] Fetching instance by UUID {{(pid=116064) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 13:01:48.801396 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-a67aebd7-2ac5-402a-b424-2e04129cc681 tempest-ServerRescueNegativeTestJSON-1573931620 tempest-ServerRescueNegativeTestJSON-1573931620-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 13:01:48.801848 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-a67aebd7-2ac5-402a-b424-2e04129cc681 tempest-ServerRescueNegativeTestJSON-1573931620 tempest-ServerRescueNegativeTestJSON-1573931620-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 13:01:48.802642 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-a67aebd7-2ac5-402a-b424-2e04129cc681 tempest-ServerRescueNegativeTestJSON-1573931620 tempest-ServerRescueNegativeTestJSON-1573931620-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 13:01:48.803079 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-a67aebd7-2ac5-402a-b424-2e04129cc681 tempest-ServerRescueNegativeTestJSON-1573931620 tempest-ServerRescueNegativeTestJSON-1573931620-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 13:01:48.946979 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.policy [None req-a67aebd7-2ac5-402a-b424-2e04129cc681 tempest-ServerRescueNegativeTestJSON-1573931620 tempest-ServerRescueNegativeTestJSON-1573931620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '731cbbfe17214ded8ac66299d66dfc45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '010919ea84eb4eb8b936c63153600eba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116064) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 13:01:48.955363 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: INFO nova.api.openstack.requestlog [None req-a67aebd7-2ac5-402a-b424-2e04129cc681 tempest-ServerRescueNegativeTestJSON-1573931620 tempest-ServerRescueNegativeTestJSON-1573931620-project] 10.222.0.49 "GET /compute/v2.1/servers/eb6e04a4-8901-47df-9b51-7c1664bd3f6c" status: 200 len: 1563 microversion: 2.1 time: 0.169710 Dec 14 13:01:48.955932 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: [pid: 116064|app: 0|req: 316/657] 10.222.0.49 () {58 vars in 1235 bytes} [Tue Dec 14 13:01:48 2021] GET /compute/v2.1/servers/eb6e04a4-8901-47df-9b51-7c1664bd3f6c => generated 1563 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 14 13:01:48.966915 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.api.openstack.wsgi [None req-59c2bde0-be8d-43cf-9434-e3cb46a59f86 tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] Calling method '>' {{(pid=116063) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 13:01:48.967655 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.compute.api [None req-59c2bde0-be8d-43cf-9434-e3cb46a59f86 tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] [instance: c8de7730-62f2-4a77-b1e9-cf6a74fa366d] Fetching instance by UUID {{(pid=116063) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 13:01:48.974576 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-59c2bde0-be8d-43cf-9434-e3cb46a59f86 tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 13:01:48.975052 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-59c2bde0-be8d-43cf-9434-e3cb46a59f86 tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 13:01:48.975884 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-59c2bde0-be8d-43cf-9434-e3cb46a59f86 tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 13:01:48.976326 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-59c2bde0-be8d-43cf-9434-e3cb46a59f86 tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 13:01:49.024605 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.api.openstack.wsgi [None req-4594c36d-087e-4ffb-94bf-3d92eb616567 tempest-ServerRescueNegativeTestJSON-1573931620 tempest-ServerRescueNegativeTestJSON-1573931620-project] Calling method '>' {{(pid=116064) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 13:01:49.025140 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.compute.api [None req-4594c36d-087e-4ffb-94bf-3d92eb616567 tempest-ServerRescueNegativeTestJSON-1573931620 tempest-ServerRescueNegativeTestJSON-1573931620-project] [instance: eb6e04a4-8901-47df-9b51-7c1664bd3f6c] Fetching instance by UUID {{(pid=116064) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 13:01:49.031193 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-4594c36d-087e-4ffb-94bf-3d92eb616567 tempest-ServerRescueNegativeTestJSON-1573931620 tempest-ServerRescueNegativeTestJSON-1573931620-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 13:01:49.031643 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-4594c36d-087e-4ffb-94bf-3d92eb616567 tempest-ServerRescueNegativeTestJSON-1573931620 tempest-ServerRescueNegativeTestJSON-1573931620-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 13:01:49.032440 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-4594c36d-087e-4ffb-94bf-3d92eb616567 tempest-ServerRescueNegativeTestJSON-1573931620 tempest-ServerRescueNegativeTestJSON-1573931620-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 13:01:49.032886 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-4594c36d-087e-4ffb-94bf-3d92eb616567 tempest-ServerRescueNegativeTestJSON-1573931620 tempest-ServerRescueNegativeTestJSON-1573931620-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 13:01:49.115478 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.policy [None req-59c2bde0-be8d-43cf-9434-e3cb46a59f86 tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79d74a2ea1e541d28d085c15cec34032', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68a8770b8dbe489a8119016fbee64eb5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116063) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 13:01:49.123894 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.policy [None req-59c2bde0-be8d-43cf-9434-e3cb46a59f86 tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '79d74a2ea1e541d28d085c15cec34032', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68a8770b8dbe489a8119016fbee64eb5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116063) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 13:01:49.125607 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.policy [None req-59c2bde0-be8d-43cf-9434-e3cb46a59f86 tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '79d74a2ea1e541d28d085c15cec34032', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68a8770b8dbe489a8119016fbee64eb5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116063) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 13:01:49.127094 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: INFO nova.api.openstack.requestlog [None req-59c2bde0-be8d-43cf-9434-e3cb46a59f86 tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] 10.222.0.49 "GET /compute/v2.1/servers/c8de7730-62f2-4a77-b1e9-cf6a74fa366d" status: 200 len: 1796 microversion: 2.20 time: 0.163908 Dec 14 13:01:49.127650 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: [pid: 116063|app: 0|req: 342/658] 10.222.0.49 () {60 vars in 1276 bytes} [Tue Dec 14 13:01:48 2021] GET /compute/v2.1/servers/c8de7730-62f2-4a77-b1e9-cf6a74fa366d => generated 1796 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 14 13:01:49.156162 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.objects.instance [None req-4594c36d-087e-4ffb-94bf-3d92eb616567 tempest-ServerRescueNegativeTestJSON-1573931620 tempest-ServerRescueNegativeTestJSON-1573931620-project] Lazy-loading 'services' on Instance uuid eb6e04a4-8901-47df-9b51-7c1664bd3f6c {{(pid=116064) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Dec 14 13:01:49.267686 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: INFO nova.api.openstack.requestlog [None req-4594c36d-087e-4ffb-94bf-3d92eb616567 tempest-ServerRescueNegativeTestJSON-1573931620 tempest-ServerRescueNegativeTestJSON-1573931620-project] 10.222.0.49 "DELETE /compute/v2.1/servers/eb6e04a4-8901-47df-9b51-7c1664bd3f6c/os-volume_attachments/114b9795-4e4c-4e93-a120-0d2eafeb4b02" status: 202 len: 0 microversion: 2.1 time: 0.246650 Dec 14 13:01:49.268265 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: [pid: 116064|app: 0|req: 317/659] 10.222.0.49 () {58 vars in 1415 bytes} [Tue Dec 14 13:01:49 2021] DELETE /compute/v2.1/servers/eb6e04a4-8901-47df-9b51-7c1664bd3f6c/os-volume_attachments/114b9795-4e4c-4e93-a120-0d2eafeb4b02 => generated 0 bytes in 248 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Dec 14 13:01:49.276561 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.api.openstack.wsgi [None req-d8df3db8-757b-4155-818b-1b8e61c8ce0e tempest-ServerRescueNegativeTestJSON-1573931620 tempest-ServerRescueNegativeTestJSON-1573931620-project] Calling method '>' {{(pid=116063) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 13:01:49.277551 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.compute.api [None req-d8df3db8-757b-4155-818b-1b8e61c8ce0e tempest-ServerRescueNegativeTestJSON-1573931620 tempest-ServerRescueNegativeTestJSON-1573931620-project] [instance: eb6e04a4-8901-47df-9b51-7c1664bd3f6c] Fetching instance by UUID {{(pid=116063) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 13:01:49.283861 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-d8df3db8-757b-4155-818b-1b8e61c8ce0e tempest-ServerRescueNegativeTestJSON-1573931620 tempest-ServerRescueNegativeTestJSON-1573931620-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 13:01:49.284313 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-d8df3db8-757b-4155-818b-1b8e61c8ce0e tempest-ServerRescueNegativeTestJSON-1573931620 tempest-ServerRescueNegativeTestJSON-1573931620-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 13:01:49.285121 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-d8df3db8-757b-4155-818b-1b8e61c8ce0e tempest-ServerRescueNegativeTestJSON-1573931620 tempest-ServerRescueNegativeTestJSON-1573931620-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 13:01:49.285555 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-d8df3db8-757b-4155-818b-1b8e61c8ce0e tempest-ServerRescueNegativeTestJSON-1573931620 tempest-ServerRescueNegativeTestJSON-1573931620-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 13:01:49.315404 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: INFO nova.api.openstack.requestlog [None req-d8df3db8-757b-4155-818b-1b8e61c8ce0e tempest-ServerRescueNegativeTestJSON-1573931620 tempest-ServerRescueNegativeTestJSON-1573931620-project] 10.222.0.49 "GET /compute/v2.1/servers/eb6e04a4-8901-47df-9b51-7c1664bd3f6c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042461 Dec 14 13:01:49.315874 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: [pid: 116063|app: 0|req: 343/660] 10.222.0.49 () {58 vars in 1301 bytes} [Tue Dec 14 13:01:49 2021] GET /compute/v2.1/servers/eb6e04a4-8901-47df-9b51-7c1664bd3f6c/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 14 13:01:50.327701 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.api.openstack.wsgi [None req-9bb25079-f81d-433c-aca0-8266cac8d979 tempest-ServerRescueNegativeTestJSON-1573931620 tempest-ServerRescueNegativeTestJSON-1573931620-project] Calling method '>' {{(pid=116064) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 13:01:50.328873 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.compute.api [None req-9bb25079-f81d-433c-aca0-8266cac8d979 tempest-ServerRescueNegativeTestJSON-1573931620 tempest-ServerRescueNegativeTestJSON-1573931620-project] [instance: eb6e04a4-8901-47df-9b51-7c1664bd3f6c] Fetching instance by UUID {{(pid=116064) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 13:01:50.339469 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-9bb25079-f81d-433c-aca0-8266cac8d979 tempest-ServerRescueNegativeTestJSON-1573931620 tempest-ServerRescueNegativeTestJSON-1573931620-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 13:01:50.339917 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-9bb25079-f81d-433c-aca0-8266cac8d979 tempest-ServerRescueNegativeTestJSON-1573931620 tempest-ServerRescueNegativeTestJSON-1573931620-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 13:01:50.340731 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-9bb25079-f81d-433c-aca0-8266cac8d979 tempest-ServerRescueNegativeTestJSON-1573931620 tempest-ServerRescueNegativeTestJSON-1573931620-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 13:01:50.341231 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-9bb25079-f81d-433c-aca0-8266cac8d979 tempest-ServerRescueNegativeTestJSON-1573931620 tempest-ServerRescueNegativeTestJSON-1573931620-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 13:01:50.370581 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: INFO nova.api.openstack.requestlog [None req-9bb25079-f81d-433c-aca0-8266cac8d979 tempest-ServerRescueNegativeTestJSON-1573931620 tempest-ServerRescueNegativeTestJSON-1573931620-project] 10.222.0.49 "GET /compute/v2.1/servers/eb6e04a4-8901-47df-9b51-7c1664bd3f6c/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.047562 Dec 14 13:01:50.371339 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: [pid: 116064|app: 0|req: 318/661] 10.222.0.49 () {58 vars in 1301 bytes} [Tue Dec 14 13:01:50 2021] GET /compute/v2.1/servers/eb6e04a4-8901-47df-9b51-7c1664bd3f6c/os-volume_attachments => generated 25 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Dec 14 13:01:51.844535 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.api.openstack.wsgi [None req-1a4c78d6-92a2-44b0-9181-f51aad917d75 tempest-VolumesSnapshotTestJSON-1649574085 tempest-VolumesSnapshotTestJSON-1649574085-project] Calling method '>' {{(pid=116063) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 13:01:51.845131 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.compute.api [None req-1a4c78d6-92a2-44b0-9181-f51aad917d75 tempest-VolumesSnapshotTestJSON-1649574085 tempest-VolumesSnapshotTestJSON-1649574085-project] [instance: 02c92efa-769b-4b6a-94a9-5d059de29e2c] Fetching instance by UUID {{(pid=116063) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 13:01:51.851776 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-1a4c78d6-92a2-44b0-9181-f51aad917d75 tempest-VolumesSnapshotTestJSON-1649574085 tempest-VolumesSnapshotTestJSON-1649574085-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 13:01:51.852355 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-1a4c78d6-92a2-44b0-9181-f51aad917d75 tempest-VolumesSnapshotTestJSON-1649574085 tempest-VolumesSnapshotTestJSON-1649574085-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 13:01:51.853193 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-1a4c78d6-92a2-44b0-9181-f51aad917d75 tempest-VolumesSnapshotTestJSON-1649574085 tempest-VolumesSnapshotTestJSON-1649574085-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 13:01:51.853618 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-1a4c78d6-92a2-44b0-9181-f51aad917d75 tempest-VolumesSnapshotTestJSON-1649574085 tempest-VolumesSnapshotTestJSON-1649574085-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 13:01:51.932713 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.objects.instance [None req-1a4c78d6-92a2-44b0-9181-f51aad917d75 tempest-VolumesSnapshotTestJSON-1649574085 tempest-VolumesSnapshotTestJSON-1649574085-project] Lazy-loading 'services' on Instance uuid 02c92efa-769b-4b6a-94a9-5d059de29e2c {{(pid=116063) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Dec 14 13:01:52.019812 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: INFO nova.api.openstack.requestlog [None req-1a4c78d6-92a2-44b0-9181-f51aad917d75 tempest-VolumesSnapshotTestJSON-1649574085 tempest-VolumesSnapshotTestJSON-1649574085-project] 10.222.0.49 "DELETE /compute/v2.1/servers/02c92efa-769b-4b6a-94a9-5d059de29e2c/os-volume_attachments/ab53e720-77c3-4722-8470-7a6cc92b136a" status: 202 len: 0 microversion: 2.1 time: 0.179003 Dec 14 13:01:52.020587 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: [pid: 116063|app: 0|req: 344/662] 10.222.0.49 () {58 vars in 1415 bytes} [Tue Dec 14 13:01:51 2021] DELETE /compute/v2.1/servers/02c92efa-769b-4b6a-94a9-5d059de29e2c/os-volume_attachments/ab53e720-77c3-4722-8470-7a6cc92b136a => generated 0 bytes in 180 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Dec 14 13:01:52.802776 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.api.openstack.wsgi [None req-430d94a5-10d5-449d-b23f-17ca9c9dcea9 tempest-ServerRescueNegativeTestJSON-1573931620 tempest-ServerRescueNegativeTestJSON-1573931620-project] Calling method '>' {{(pid=116064) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 13:01:52.803293 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.compute.api [None req-430d94a5-10d5-449d-b23f-17ca9c9dcea9 tempest-ServerRescueNegativeTestJSON-1573931620 tempest-ServerRescueNegativeTestJSON-1573931620-project] [instance: 60694e1e-d0cb-41c8-adf5-bdda49804385] Fetching instance by UUID {{(pid=116064) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 13:01:52.812130 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-430d94a5-10d5-449d-b23f-17ca9c9dcea9 tempest-ServerRescueNegativeTestJSON-1573931620 tempest-ServerRescueNegativeTestJSON-1573931620-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 13:01:52.812988 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-430d94a5-10d5-449d-b23f-17ca9c9dcea9 tempest-ServerRescueNegativeTestJSON-1573931620 tempest-ServerRescueNegativeTestJSON-1573931620-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 13:01:52.814187 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-430d94a5-10d5-449d-b23f-17ca9c9dcea9 tempest-ServerRescueNegativeTestJSON-1573931620 tempest-ServerRescueNegativeTestJSON-1573931620-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 13:01:52.814842 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-430d94a5-10d5-449d-b23f-17ca9c9dcea9 tempest-ServerRescueNegativeTestJSON-1573931620 tempest-ServerRescueNegativeTestJSON-1573931620-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 13:01:52.849292 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.compute.api [None req-430d94a5-10d5-449d-b23f-17ca9c9dcea9 tempest-ServerRescueNegativeTestJSON-1573931620 tempest-ServerRescueNegativeTestJSON-1573931620-project] [instance: 60694e1e-d0cb-41c8-adf5-bdda49804385] Going to try to terminate instance {{(pid=116064) delete /opt/stack/nova/nova/compute/api.py:2614}} Dec 14 13:01:52.940001 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: INFO nova.api.openstack.requestlog [None req-430d94a5-10d5-449d-b23f-17ca9c9dcea9 tempest-ServerRescueNegativeTestJSON-1573931620 tempest-ServerRescueNegativeTestJSON-1573931620-project] 10.222.0.49 "DELETE /compute/v2.1/servers/60694e1e-d0cb-41c8-adf5-bdda49804385" status: 204 len: 0 microversion: 2.1 time: 0.141076 Dec 14 13:01:52.940577 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: [pid: 116064|app: 0|req: 319/663] 10.222.0.49 () {58 vars in 1238 bytes} [Tue Dec 14 13:01:52 2021] DELETE /compute/v2.1/servers/60694e1e-d0cb-41c8-adf5-bdda49804385 => generated 0 bytes in 143 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Dec 14 13:01:52.949796 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.api.openstack.wsgi [None req-3877ed68-ef49-4bf5-85cb-b8e54352ee64 tempest-ServerRescueNegativeTestJSON-1573931620 tempest-ServerRescueNegativeTestJSON-1573931620-project] Calling method '>' {{(pid=116063) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 13:01:52.950503 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.compute.api [None req-3877ed68-ef49-4bf5-85cb-b8e54352ee64 tempest-ServerRescueNegativeTestJSON-1573931620 tempest-ServerRescueNegativeTestJSON-1573931620-project] [instance: 60694e1e-d0cb-41c8-adf5-bdda49804385] Fetching instance by UUID {{(pid=116063) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 13:01:52.957164 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-3877ed68-ef49-4bf5-85cb-b8e54352ee64 tempest-ServerRescueNegativeTestJSON-1573931620 tempest-ServerRescueNegativeTestJSON-1573931620-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 13:01:52.957639 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-3877ed68-ef49-4bf5-85cb-b8e54352ee64 tempest-ServerRescueNegativeTestJSON-1573931620 tempest-ServerRescueNegativeTestJSON-1573931620-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 13:01:52.958423 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-3877ed68-ef49-4bf5-85cb-b8e54352ee64 tempest-ServerRescueNegativeTestJSON-1573931620 tempest-ServerRescueNegativeTestJSON-1573931620-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 13:01:52.958858 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-3877ed68-ef49-4bf5-85cb-b8e54352ee64 tempest-ServerRescueNegativeTestJSON-1573931620 tempest-ServerRescueNegativeTestJSON-1573931620-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 13:01:53.101483 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.policy [None req-3877ed68-ef49-4bf5-85cb-b8e54352ee64 tempest-ServerRescueNegativeTestJSON-1573931620 tempest-ServerRescueNegativeTestJSON-1573931620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '731cbbfe17214ded8ac66299d66dfc45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '010919ea84eb4eb8b936c63153600eba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116063) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 13:01:53.112123 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: INFO nova.api.openstack.requestlog [None req-3877ed68-ef49-4bf5-85cb-b8e54352ee64 tempest-ServerRescueNegativeTestJSON-1573931620 tempest-ServerRescueNegativeTestJSON-1573931620-project] 10.222.0.49 "GET /compute/v2.1/servers/60694e1e-d0cb-41c8-adf5-bdda49804385" status: 200 len: 1509 microversion: 2.1 time: 0.166473 Dec 14 13:01:53.112784 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: [pid: 116063|app: 0|req: 345/664] 10.222.0.49 () {58 vars in 1235 bytes} [Tue Dec 14 13:01:52 2021] GET /compute/v2.1/servers/60694e1e-d0cb-41c8-adf5-bdda49804385 => generated 1509 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 14 13:01:53.131128 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.api.openstack.wsgi [None req-e176ea61-b0a6-40dd-bfd2-e05ed6467aab tempest-VolumesSnapshotTestJSON-1649574085 tempest-VolumesSnapshotTestJSON-1649574085-project] Calling method '>' {{(pid=116064) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 13:01:53.131721 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.compute.api [None req-e176ea61-b0a6-40dd-bfd2-e05ed6467aab tempest-VolumesSnapshotTestJSON-1649574085 tempest-VolumesSnapshotTestJSON-1649574085-project] [instance: 02c92efa-769b-4b6a-94a9-5d059de29e2c] Fetching instance by UUID {{(pid=116064) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 13:01:53.137750 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-e176ea61-b0a6-40dd-bfd2-e05ed6467aab tempest-VolumesSnapshotTestJSON-1649574085 tempest-VolumesSnapshotTestJSON-1649574085-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 13:01:53.138202 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-e176ea61-b0a6-40dd-bfd2-e05ed6467aab tempest-VolumesSnapshotTestJSON-1649574085 tempest-VolumesSnapshotTestJSON-1649574085-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 13:01:53.138989 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-e176ea61-b0a6-40dd-bfd2-e05ed6467aab tempest-VolumesSnapshotTestJSON-1649574085 tempest-VolumesSnapshotTestJSON-1649574085-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 13:01:53.139425 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-e176ea61-b0a6-40dd-bfd2-e05ed6467aab tempest-VolumesSnapshotTestJSON-1649574085 tempest-VolumesSnapshotTestJSON-1649574085-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 13:01:53.163852 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.compute.api [None req-e176ea61-b0a6-40dd-bfd2-e05ed6467aab tempest-VolumesSnapshotTestJSON-1649574085 tempest-VolumesSnapshotTestJSON-1649574085-project] [instance: 02c92efa-769b-4b6a-94a9-5d059de29e2c] Going to try to terminate instance {{(pid=116064) delete /opt/stack/nova/nova/compute/api.py:2614}} Dec 14 13:01:53.246163 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: INFO nova.api.openstack.requestlog [None req-e176ea61-b0a6-40dd-bfd2-e05ed6467aab tempest-VolumesSnapshotTestJSON-1649574085 tempest-VolumesSnapshotTestJSON-1649574085-project] 10.222.0.49 "DELETE /compute/v2.1/servers/02c92efa-769b-4b6a-94a9-5d059de29e2c" status: 204 len: 0 microversion: 2.1 time: 0.118917 Dec 14 13:01:53.246766 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: [pid: 116064|app: 0|req: 320/665] 10.222.0.49 () {58 vars in 1238 bytes} [Tue Dec 14 13:01:53 2021] DELETE /compute/v2.1/servers/02c92efa-769b-4b6a-94a9-5d059de29e2c => generated 0 bytes in 121 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Dec 14 13:01:53.256946 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.api.openstack.wsgi [None req-2eefd5c6-c7ca-49f8-ad2f-b3795c38de7b tempest-VolumesSnapshotTestJSON-1649574085 tempest-VolumesSnapshotTestJSON-1649574085-project] Calling method '>' {{(pid=116063) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 13:01:53.257975 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.compute.api [None req-2eefd5c6-c7ca-49f8-ad2f-b3795c38de7b tempest-VolumesSnapshotTestJSON-1649574085 tempest-VolumesSnapshotTestJSON-1649574085-project] [instance: 02c92efa-769b-4b6a-94a9-5d059de29e2c] Fetching instance by UUID {{(pid=116063) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 13:01:53.265397 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-2eefd5c6-c7ca-49f8-ad2f-b3795c38de7b tempest-VolumesSnapshotTestJSON-1649574085 tempest-VolumesSnapshotTestJSON-1649574085-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 13:01:53.266127 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-2eefd5c6-c7ca-49f8-ad2f-b3795c38de7b tempest-VolumesSnapshotTestJSON-1649574085 tempest-VolumesSnapshotTestJSON-1649574085-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 13:01:53.267416 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-2eefd5c6-c7ca-49f8-ad2f-b3795c38de7b tempest-VolumesSnapshotTestJSON-1649574085 tempest-VolumesSnapshotTestJSON-1649574085-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 13:01:53.268086 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-2eefd5c6-c7ca-49f8-ad2f-b3795c38de7b tempest-VolumesSnapshotTestJSON-1649574085 tempest-VolumesSnapshotTestJSON-1649574085-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 13:01:53.412015 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.policy [None req-2eefd5c6-c7ca-49f8-ad2f-b3795c38de7b tempest-VolumesSnapshotTestJSON-1649574085 tempest-VolumesSnapshotTestJSON-1649574085-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e18311fd2704616a778d36332f199ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1bf776f341b4721b28eb9a5c84ba866', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116063) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 13:01:53.423812 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: INFO nova.api.openstack.requestlog [None req-2eefd5c6-c7ca-49f8-ad2f-b3795c38de7b tempest-VolumesSnapshotTestJSON-1649574085 tempest-VolumesSnapshotTestJSON-1649574085-project] 10.222.0.49 "GET /compute/v2.1/servers/02c92efa-769b-4b6a-94a9-5d059de29e2c" status: 200 len: 1514 microversion: 2.1 time: 0.171347 Dec 14 13:01:53.424597 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: [pid: 116063|app: 0|req: 346/666] 10.222.0.49 () {58 vars in 1235 bytes} [Tue Dec 14 13:01:53 2021] GET /compute/v2.1/servers/02c92efa-769b-4b6a-94a9-5d059de29e2c => generated 1514 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 14 13:01:54.130240 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.api.openstack.wsgi [None req-e2d03cf8-4153-4a0a-a026-8dfe2a2760e2 tempest-ServerRescueNegativeTestJSON-1573931620 tempest-ServerRescueNegativeTestJSON-1573931620-project] Calling method '>' {{(pid=116064) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 13:01:54.130938 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.compute.api [None req-e2d03cf8-4153-4a0a-a026-8dfe2a2760e2 tempest-ServerRescueNegativeTestJSON-1573931620 tempest-ServerRescueNegativeTestJSON-1573931620-project] [instance: 60694e1e-d0cb-41c8-adf5-bdda49804385] Fetching instance by UUID {{(pid=116064) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 13:01:54.137655 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-e2d03cf8-4153-4a0a-a026-8dfe2a2760e2 tempest-ServerRescueNegativeTestJSON-1573931620 tempest-ServerRescueNegativeTestJSON-1573931620-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 13:01:54.138141 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-e2d03cf8-4153-4a0a-a026-8dfe2a2760e2 tempest-ServerRescueNegativeTestJSON-1573931620 tempest-ServerRescueNegativeTestJSON-1573931620-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 13:01:54.138996 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-e2d03cf8-4153-4a0a-a026-8dfe2a2760e2 tempest-ServerRescueNegativeTestJSON-1573931620 tempest-ServerRescueNegativeTestJSON-1573931620-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 13:01:54.139421 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-e2d03cf8-4153-4a0a-a026-8dfe2a2760e2 tempest-ServerRescueNegativeTestJSON-1573931620 tempest-ServerRescueNegativeTestJSON-1573931620-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 13:01:54.295617 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.policy [None req-e2d03cf8-4153-4a0a-a026-8dfe2a2760e2 tempest-ServerRescueNegativeTestJSON-1573931620 tempest-ServerRescueNegativeTestJSON-1573931620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '731cbbfe17214ded8ac66299d66dfc45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '010919ea84eb4eb8b936c63153600eba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116064) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 13:01:54.304661 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: INFO nova.api.openstack.requestlog [None req-e2d03cf8-4153-4a0a-a026-8dfe2a2760e2 tempest-ServerRescueNegativeTestJSON-1573931620 tempest-ServerRescueNegativeTestJSON-1573931620-project] 10.222.0.49 "GET /compute/v2.1/servers/60694e1e-d0cb-41c8-adf5-bdda49804385" status: 200 len: 1509 microversion: 2.1 time: 0.178624 Dec 14 13:01:54.305265 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: [pid: 116064|app: 0|req: 321/667] 10.222.0.49 () {58 vars in 1235 bytes} [Tue Dec 14 13:01:54 2021] GET /compute/v2.1/servers/60694e1e-d0cb-41c8-adf5-bdda49804385 => generated 1509 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 14 13:01:54.441323 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.api.openstack.wsgi [None req-d06cc380-fcfb-4cdf-bcc5-d230e23cc6a8 tempest-VolumesSnapshotTestJSON-1649574085 tempest-VolumesSnapshotTestJSON-1649574085-project] Calling method '>' {{(pid=116063) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 13:01:54.441920 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.compute.api [None req-d06cc380-fcfb-4cdf-bcc5-d230e23cc6a8 tempest-VolumesSnapshotTestJSON-1649574085 tempest-VolumesSnapshotTestJSON-1649574085-project] [instance: 02c92efa-769b-4b6a-94a9-5d059de29e2c] Fetching instance by UUID {{(pid=116063) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 13:01:54.448582 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-d06cc380-fcfb-4cdf-bcc5-d230e23cc6a8 tempest-VolumesSnapshotTestJSON-1649574085 tempest-VolumesSnapshotTestJSON-1649574085-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 13:01:54.449056 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-d06cc380-fcfb-4cdf-bcc5-d230e23cc6a8 tempest-VolumesSnapshotTestJSON-1649574085 tempest-VolumesSnapshotTestJSON-1649574085-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 13:01:54.449829 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-d06cc380-fcfb-4cdf-bcc5-d230e23cc6a8 tempest-VolumesSnapshotTestJSON-1649574085 tempest-VolumesSnapshotTestJSON-1649574085-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 13:01:54.450259 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-d06cc380-fcfb-4cdf-bcc5-d230e23cc6a8 tempest-VolumesSnapshotTestJSON-1649574085 tempest-VolumesSnapshotTestJSON-1649574085-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 13:01:54.587070 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.policy [None req-d06cc380-fcfb-4cdf-bcc5-d230e23cc6a8 tempest-VolumesSnapshotTestJSON-1649574085 tempest-VolumesSnapshotTestJSON-1649574085-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e18311fd2704616a778d36332f199ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1bf776f341b4721b28eb9a5c84ba866', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116063) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 13:01:54.594883 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: INFO nova.api.openstack.requestlog [None req-d06cc380-fcfb-4cdf-bcc5-d230e23cc6a8 tempest-VolumesSnapshotTestJSON-1649574085 tempest-VolumesSnapshotTestJSON-1649574085-project] 10.222.0.49 "GET /compute/v2.1/servers/02c92efa-769b-4b6a-94a9-5d059de29e2c" status: 200 len: 1514 microversion: 2.1 time: 0.157378 Dec 14 13:01:54.595458 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: [pid: 116063|app: 0|req: 347/668] 10.222.0.49 () {58 vars in 1235 bytes} [Tue Dec 14 13:01:54 2021] GET /compute/v2.1/servers/02c92efa-769b-4b6a-94a9-5d059de29e2c => generated 1514 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 14 13:01:55.321544 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.api.openstack.wsgi [None req-50e66bf4-f55b-49c9-a0ef-ce999f6698d2 tempest-ServerRescueNegativeTestJSON-1573931620 tempest-ServerRescueNegativeTestJSON-1573931620-project] Calling method '>' {{(pid=116064) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 13:01:55.322163 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.compute.api [None req-50e66bf4-f55b-49c9-a0ef-ce999f6698d2 tempest-ServerRescueNegativeTestJSON-1573931620 tempest-ServerRescueNegativeTestJSON-1573931620-project] [instance: 60694e1e-d0cb-41c8-adf5-bdda49804385] Fetching instance by UUID {{(pid=116064) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 13:01:55.329872 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-50e66bf4-f55b-49c9-a0ef-ce999f6698d2 tempest-ServerRescueNegativeTestJSON-1573931620 tempest-ServerRescueNegativeTestJSON-1573931620-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 13:01:55.330334 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-50e66bf4-f55b-49c9-a0ef-ce999f6698d2 tempest-ServerRescueNegativeTestJSON-1573931620 tempest-ServerRescueNegativeTestJSON-1573931620-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 13:01:55.331099 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-50e66bf4-f55b-49c9-a0ef-ce999f6698d2 tempest-ServerRescueNegativeTestJSON-1573931620 tempest-ServerRescueNegativeTestJSON-1573931620-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 13:01:55.331784 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-50e66bf4-f55b-49c9-a0ef-ce999f6698d2 tempest-ServerRescueNegativeTestJSON-1573931620 tempest-ServerRescueNegativeTestJSON-1573931620-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 13:01:55.509285 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.policy [None req-50e66bf4-f55b-49c9-a0ef-ce999f6698d2 tempest-ServerRescueNegativeTestJSON-1573931620 tempest-ServerRescueNegativeTestJSON-1573931620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '731cbbfe17214ded8ac66299d66dfc45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '010919ea84eb4eb8b936c63153600eba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116064) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 13:01:55.519736 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: INFO nova.api.openstack.requestlog [None req-50e66bf4-f55b-49c9-a0ef-ce999f6698d2 tempest-ServerRescueNegativeTestJSON-1573931620 tempest-ServerRescueNegativeTestJSON-1573931620-project] 10.222.0.49 "GET /compute/v2.1/servers/60694e1e-d0cb-41c8-adf5-bdda49804385" status: 200 len: 1509 microversion: 2.1 time: 0.202136 Dec 14 13:01:55.520625 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: [pid: 116064|app: 0|req: 322/669] 10.222.0.49 () {58 vars in 1235 bytes} [Tue Dec 14 13:01:55 2021] GET /compute/v2.1/servers/60694e1e-d0cb-41c8-adf5-bdda49804385 => generated 1509 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 14 13:01:55.612056 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.api.openstack.wsgi [None req-468a1b50-4ff4-4486-8a8c-52e3f15493a7 tempest-VolumesSnapshotTestJSON-1649574085 tempest-VolumesSnapshotTestJSON-1649574085-project] Calling method '>' {{(pid=116063) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 13:01:55.612774 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.compute.api [None req-468a1b50-4ff4-4486-8a8c-52e3f15493a7 tempest-VolumesSnapshotTestJSON-1649574085 tempest-VolumesSnapshotTestJSON-1649574085-project] [instance: 02c92efa-769b-4b6a-94a9-5d059de29e2c] Fetching instance by UUID {{(pid=116063) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 13:01:55.620955 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-468a1b50-4ff4-4486-8a8c-52e3f15493a7 tempest-VolumesSnapshotTestJSON-1649574085 tempest-VolumesSnapshotTestJSON-1649574085-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 13:01:55.621518 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-468a1b50-4ff4-4486-8a8c-52e3f15493a7 tempest-VolumesSnapshotTestJSON-1649574085 tempest-VolumesSnapshotTestJSON-1649574085-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 13:01:55.622888 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-468a1b50-4ff4-4486-8a8c-52e3f15493a7 tempest-VolumesSnapshotTestJSON-1649574085 tempest-VolumesSnapshotTestJSON-1649574085-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 13:01:55.623289 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-468a1b50-4ff4-4486-8a8c-52e3f15493a7 tempest-VolumesSnapshotTestJSON-1649574085 tempest-VolumesSnapshotTestJSON-1649574085-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 13:01:55.787480 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.policy [None req-468a1b50-4ff4-4486-8a8c-52e3f15493a7 tempest-VolumesSnapshotTestJSON-1649574085 tempest-VolumesSnapshotTestJSON-1649574085-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e18311fd2704616a778d36332f199ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1bf776f341b4721b28eb9a5c84ba866', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116063) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 13:01:55.795498 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: INFO nova.api.openstack.requestlog [None req-468a1b50-4ff4-4486-8a8c-52e3f15493a7 tempest-VolumesSnapshotTestJSON-1649574085 tempest-VolumesSnapshotTestJSON-1649574085-project] 10.222.0.49 "GET /compute/v2.1/servers/02c92efa-769b-4b6a-94a9-5d059de29e2c" status: 200 len: 1514 microversion: 2.1 time: 0.187057 Dec 14 13:01:55.800015 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: [pid: 116063|app: 0|req: 348/670] 10.222.0.49 () {58 vars in 1235 bytes} [Tue Dec 14 13:01:55 2021] GET /compute/v2.1/servers/02c92efa-769b-4b6a-94a9-5d059de29e2c => generated 1514 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 14 13:01:55.846387 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.api.openstack.wsgi [req-b6dc751e-997d-4409-8701-60da59e82980 req-9d63ef76-4a2e-462a-9808-84aefc5c4f3e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "02c92efa-769b-4b6a-94a9-5d059de29e2c", "name": "network-vif-deleted", "tag": "9de9803b-e8e8-4441-a8ab-11f10fdbe375"}]} {{(pid=116064) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 14 13:01:55.848315 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 14 13:01:55.848315 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: warnings.warn(msg) Dec 14 13:01:55.856746 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [req-b6dc751e-997d-4409-8701-60da59e82980 req-9d63ef76-4a2e-462a-9808-84aefc5c4f3e service nova] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 13:01:55.858099 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [req-b6dc751e-997d-4409-8701-60da59e82980 req-9d63ef76-4a2e-462a-9808-84aefc5c4f3e service nova] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 13:01:55.881101 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: INFO nova.api.openstack.compute.server_external_events [req-b6dc751e-997d-4409-8701-60da59e82980 req-9d63ef76-4a2e-462a-9808-84aefc5c4f3e service nova] Creating event network-vif-deleted:9de9803b-e8e8-4441-a8ab-11f10fdbe375 for instance 02c92efa-769b-4b6a-94a9-5d059de29e2c on hv-cinder-78447 Dec 14 13:01:55.887039 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: INFO nova.api.openstack.requestlog [req-b6dc751e-997d-4409-8701-60da59e82980 req-9d63ef76-4a2e-462a-9808-84aefc5c4f3e service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044575 Dec 14 13:01:55.887934 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: [pid: 116064|app: 0|req: 323/671] 10.222.0.49 () {64 vars in 1317 bytes} [Tue Dec 14 13:01:55 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 14 13:01:56.538963 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.api.openstack.wsgi [None req-f66cd466-49a3-42de-8270-0bcd1b269180 tempest-ServerRescueNegativeTestJSON-1573931620 tempest-ServerRescueNegativeTestJSON-1573931620-project] Calling method '>' {{(pid=116063) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 13:01:56.538963 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.compute.api [None req-f66cd466-49a3-42de-8270-0bcd1b269180 tempest-ServerRescueNegativeTestJSON-1573931620 tempest-ServerRescueNegativeTestJSON-1573931620-project] [instance: 60694e1e-d0cb-41c8-adf5-bdda49804385] Fetching instance by UUID {{(pid=116063) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 13:01:56.545536 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-f66cd466-49a3-42de-8270-0bcd1b269180 tempest-ServerRescueNegativeTestJSON-1573931620 tempest-ServerRescueNegativeTestJSON-1573931620-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 13:01:56.545971 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-f66cd466-49a3-42de-8270-0bcd1b269180 tempest-ServerRescueNegativeTestJSON-1573931620 tempest-ServerRescueNegativeTestJSON-1573931620-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 13:01:56.546739 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-f66cd466-49a3-42de-8270-0bcd1b269180 tempest-ServerRescueNegativeTestJSON-1573931620 tempest-ServerRescueNegativeTestJSON-1573931620-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 13:01:56.547157 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-f66cd466-49a3-42de-8270-0bcd1b269180 tempest-ServerRescueNegativeTestJSON-1573931620 tempest-ServerRescueNegativeTestJSON-1573931620-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 13:01:56.578772 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-f66cd466-49a3-42de-8270-0bcd1b269180 tempest-ServerRescueNegativeTestJSON-1573931620 tempest-ServerRescueNegativeTestJSON-1573931620-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 13:01:56.579315 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-f66cd466-49a3-42de-8270-0bcd1b269180 tempest-ServerRescueNegativeTestJSON-1573931620 tempest-ServerRescueNegativeTestJSON-1573931620-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 13:01:56.579782 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.objects.instance [None req-f66cd466-49a3-42de-8270-0bcd1b269180 tempest-ServerRescueNegativeTestJSON-1573931620 tempest-ServerRescueNegativeTestJSON-1573931620-project] Lazy-loading 'fault' on Instance uuid 60694e1e-d0cb-41c8-adf5-bdda49804385 {{(pid=116063) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Dec 14 13:01:56.619906 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.policy [None req-f66cd466-49a3-42de-8270-0bcd1b269180 tempest-ServerRescueNegativeTestJSON-1573931620 tempest-ServerRescueNegativeTestJSON-1573931620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '731cbbfe17214ded8ac66299d66dfc45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '010919ea84eb4eb8b936c63153600eba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116063) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 13:01:56.627596 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: INFO nova.api.openstack.requestlog [None req-f66cd466-49a3-42de-8270-0bcd1b269180 tempest-ServerRescueNegativeTestJSON-1573931620 tempest-ServerRescueNegativeTestJSON-1573931620-project] 10.222.0.49 "GET /compute/v2.1/servers/60694e1e-d0cb-41c8-adf5-bdda49804385" status: 200 len: 1312 microversion: 2.1 time: 0.094084 Dec 14 13:01:56.628179 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: [pid: 116063|app: 0|req: 349/672] 10.222.0.49 () {58 vars in 1235 bytes} [Tue Dec 14 13:01:56 2021] GET /compute/v2.1/servers/60694e1e-d0cb-41c8-adf5-bdda49804385 => generated 1312 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 14 13:01:56.813380 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.api.openstack.wsgi [None req-eee4571b-d616-4fc8-958a-0ba800e9fa16 tempest-VolumesSnapshotTestJSON-1649574085 tempest-VolumesSnapshotTestJSON-1649574085-project] Calling method '>' {{(pid=116064) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 13:01:56.814057 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.compute.api [None req-eee4571b-d616-4fc8-958a-0ba800e9fa16 tempest-VolumesSnapshotTestJSON-1649574085 tempest-VolumesSnapshotTestJSON-1649574085-project] [instance: 02c92efa-769b-4b6a-94a9-5d059de29e2c] Fetching instance by UUID {{(pid=116064) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 13:01:56.820582 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-eee4571b-d616-4fc8-958a-0ba800e9fa16 tempest-VolumesSnapshotTestJSON-1649574085 tempest-VolumesSnapshotTestJSON-1649574085-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 13:01:56.821075 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-eee4571b-d616-4fc8-958a-0ba800e9fa16 tempest-VolumesSnapshotTestJSON-1649574085 tempest-VolumesSnapshotTestJSON-1649574085-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 13:01:56.821865 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-eee4571b-d616-4fc8-958a-0ba800e9fa16 tempest-VolumesSnapshotTestJSON-1649574085 tempest-VolumesSnapshotTestJSON-1649574085-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 13:01:56.822302 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-eee4571b-d616-4fc8-958a-0ba800e9fa16 tempest-VolumesSnapshotTestJSON-1649574085 tempest-VolumesSnapshotTestJSON-1649574085-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 13:01:56.835262 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: INFO nova.api.openstack.wsgi [None req-eee4571b-d616-4fc8-958a-0ba800e9fa16 tempest-VolumesSnapshotTestJSON-1649574085 tempest-VolumesSnapshotTestJSON-1649574085-project] HTTP exception thrown: Instance 02c92efa-769b-4b6a-94a9-5d059de29e2c could not be found. Dec 14 13:01:56.835850 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.api.openstack.wsgi [None req-eee4571b-d616-4fc8-958a-0ba800e9fa16 tempest-VolumesSnapshotTestJSON-1649574085 tempest-VolumesSnapshotTestJSON-1649574085-project] Returning 404 to user: Instance 02c92efa-769b-4b6a-94a9-5d059de29e2c could not be found. {{(pid=116064) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 14 13:01:56.836674 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: INFO nova.api.openstack.requestlog [None req-eee4571b-d616-4fc8-958a-0ba800e9fa16 tempest-VolumesSnapshotTestJSON-1649574085 tempest-VolumesSnapshotTestJSON-1649574085-project] 10.222.0.49 "GET /compute/v2.1/servers/02c92efa-769b-4b6a-94a9-5d059de29e2c" status: 404 len: 111 microversion: 2.1 time: 0.028093 Dec 14 13:01:56.837224 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: [pid: 116064|app: 0|req: 324/673] 10.222.0.49 () {58 vars in 1235 bytes} [Tue Dec 14 13:01:56 2021] GET /compute/v2.1/servers/02c92efa-769b-4b6a-94a9-5d059de29e2c => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Dec 14 13:01:57.644380 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.api.openstack.wsgi [None req-fdd30985-c02f-41d2-8673-b4ea3f8dbe3e tempest-ServerRescueNegativeTestJSON-1573931620 tempest-ServerRescueNegativeTestJSON-1573931620-project] Calling method '>' {{(pid=116063) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 13:01:57.645007 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.compute.api [None req-fdd30985-c02f-41d2-8673-b4ea3f8dbe3e tempest-ServerRescueNegativeTestJSON-1573931620 tempest-ServerRescueNegativeTestJSON-1573931620-project] [instance: 60694e1e-d0cb-41c8-adf5-bdda49804385] Fetching instance by UUID {{(pid=116063) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 13:01:57.653051 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-fdd30985-c02f-41d2-8673-b4ea3f8dbe3e tempest-ServerRescueNegativeTestJSON-1573931620 tempest-ServerRescueNegativeTestJSON-1573931620-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 13:01:57.653677 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-fdd30985-c02f-41d2-8673-b4ea3f8dbe3e tempest-ServerRescueNegativeTestJSON-1573931620 tempest-ServerRescueNegativeTestJSON-1573931620-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 13:01:57.654802 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-fdd30985-c02f-41d2-8673-b4ea3f8dbe3e tempest-ServerRescueNegativeTestJSON-1573931620 tempest-ServerRescueNegativeTestJSON-1573931620-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 13:01:57.655363 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-fdd30985-c02f-41d2-8673-b4ea3f8dbe3e tempest-ServerRescueNegativeTestJSON-1573931620 tempest-ServerRescueNegativeTestJSON-1573931620-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 13:01:57.670297 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: INFO nova.api.openstack.wsgi [None req-fdd30985-c02f-41d2-8673-b4ea3f8dbe3e tempest-ServerRescueNegativeTestJSON-1573931620 tempest-ServerRescueNegativeTestJSON-1573931620-project] HTTP exception thrown: Instance 60694e1e-d0cb-41c8-adf5-bdda49804385 could not be found. Dec 14 13:01:57.670887 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.api.openstack.wsgi [None req-fdd30985-c02f-41d2-8673-b4ea3f8dbe3e tempest-ServerRescueNegativeTestJSON-1573931620 tempest-ServerRescueNegativeTestJSON-1573931620-project] Returning 404 to user: Instance 60694e1e-d0cb-41c8-adf5-bdda49804385 could not be found. {{(pid=116063) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 14 13:01:57.671720 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: INFO nova.api.openstack.requestlog [None req-fdd30985-c02f-41d2-8673-b4ea3f8dbe3e tempest-ServerRescueNegativeTestJSON-1573931620 tempest-ServerRescueNegativeTestJSON-1573931620-project] 10.222.0.49 "GET /compute/v2.1/servers/60694e1e-d0cb-41c8-adf5-bdda49804385" status: 404 len: 111 microversion: 2.1 time: 0.031042 Dec 14 13:01:57.672253 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: [pid: 116063|app: 0|req: 350/674] 10.222.0.49 () {58 vars in 1235 bytes} [Tue Dec 14 13:01:57 2021] GET /compute/v2.1/servers/60694e1e-d0cb-41c8-adf5-bdda49804385 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Dec 14 13:01:57.680229 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.api.openstack.wsgi [None req-3fc81cc1-992f-4ad0-9f68-49aa17454c4d tempest-ServerRescueNegativeTestJSON-1573931620 tempest-ServerRescueNegativeTestJSON-1573931620-project] Calling method '>' {{(pid=116064) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 13:01:57.680729 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.compute.api [None req-3fc81cc1-992f-4ad0-9f68-49aa17454c4d tempest-ServerRescueNegativeTestJSON-1573931620 tempest-ServerRescueNegativeTestJSON-1573931620-project] [instance: eb6e04a4-8901-47df-9b51-7c1664bd3f6c] Fetching instance by UUID {{(pid=116064) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 13:01:57.686617 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-3fc81cc1-992f-4ad0-9f68-49aa17454c4d tempest-ServerRescueNegativeTestJSON-1573931620 tempest-ServerRescueNegativeTestJSON-1573931620-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 13:01:57.687072 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-3fc81cc1-992f-4ad0-9f68-49aa17454c4d tempest-ServerRescueNegativeTestJSON-1573931620 tempest-ServerRescueNegativeTestJSON-1573931620-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 13:01:57.687845 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-3fc81cc1-992f-4ad0-9f68-49aa17454c4d tempest-ServerRescueNegativeTestJSON-1573931620 tempest-ServerRescueNegativeTestJSON-1573931620-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 13:01:57.688274 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-3fc81cc1-992f-4ad0-9f68-49aa17454c4d tempest-ServerRescueNegativeTestJSON-1573931620 tempest-ServerRescueNegativeTestJSON-1573931620-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 13:01:57.717571 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.compute.api [None req-3fc81cc1-992f-4ad0-9f68-49aa17454c4d tempest-ServerRescueNegativeTestJSON-1573931620 tempest-ServerRescueNegativeTestJSON-1573931620-project] [instance: eb6e04a4-8901-47df-9b51-7c1664bd3f6c] Going to try to terminate instance {{(pid=116064) delete /opt/stack/nova/nova/compute/api.py:2614}} Dec 14 13:01:57.795526 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: INFO nova.api.openstack.requestlog [None req-3fc81cc1-992f-4ad0-9f68-49aa17454c4d tempest-ServerRescueNegativeTestJSON-1573931620 tempest-ServerRescueNegativeTestJSON-1573931620-project] 10.222.0.49 "DELETE /compute/v2.1/servers/eb6e04a4-8901-47df-9b51-7c1664bd3f6c" status: 204 len: 0 microversion: 2.1 time: 0.118258 Dec 14 13:01:57.796100 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: [pid: 116064|app: 0|req: 325/675] 10.222.0.49 () {58 vars in 1238 bytes} [Tue Dec 14 13:01:57 2021] DELETE /compute/v2.1/servers/eb6e04a4-8901-47df-9b51-7c1664bd3f6c => generated 0 bytes in 120 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Dec 14 13:01:57.804498 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.api.openstack.wsgi [None req-d7984c37-b689-4a58-922a-5d4a770c03ca tempest-ServerRescueNegativeTestJSON-1573931620 tempest-ServerRescueNegativeTestJSON-1573931620-project] Calling method '>' {{(pid=116063) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 13:01:57.805138 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.compute.api [None req-d7984c37-b689-4a58-922a-5d4a770c03ca tempest-ServerRescueNegativeTestJSON-1573931620 tempest-ServerRescueNegativeTestJSON-1573931620-project] [instance: eb6e04a4-8901-47df-9b51-7c1664bd3f6c] Fetching instance by UUID {{(pid=116063) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 13:01:57.811504 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-d7984c37-b689-4a58-922a-5d4a770c03ca tempest-ServerRescueNegativeTestJSON-1573931620 tempest-ServerRescueNegativeTestJSON-1573931620-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 13:01:57.811956 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-d7984c37-b689-4a58-922a-5d4a770c03ca tempest-ServerRescueNegativeTestJSON-1573931620 tempest-ServerRescueNegativeTestJSON-1573931620-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 13:01:57.812722 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-d7984c37-b689-4a58-922a-5d4a770c03ca tempest-ServerRescueNegativeTestJSON-1573931620 tempest-ServerRescueNegativeTestJSON-1573931620-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 13:01:57.813211 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-d7984c37-b689-4a58-922a-5d4a770c03ca tempest-ServerRescueNegativeTestJSON-1573931620 tempest-ServerRescueNegativeTestJSON-1573931620-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 13:01:57.903037 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.api.openstack.wsgi [req-2ed37c95-f8b3-44dc-a2e0-cf129220ad29 req-e429137f-e66d-4f01-91ed-fd86d80853b7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "60694e1e-d0cb-41c8-adf5-bdda49804385", "name": "network-vif-deleted", "tag": "dc3fb812-3df8-4cc0-9829-c46ef1394592"}]} {{(pid=116064) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 14 13:01:57.904674 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 14 13:01:57.904674 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: warnings.warn(msg) Dec 14 13:01:57.912233 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [req-2ed37c95-f8b3-44dc-a2e0-cf129220ad29 req-e429137f-e66d-4f01-91ed-fd86d80853b7 service nova] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 13:01:57.912672 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [req-2ed37c95-f8b3-44dc-a2e0-cf129220ad29 req-e429137f-e66d-4f01-91ed-fd86d80853b7 service nova] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 13:01:57.924439 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: INFO nova.api.openstack.compute.server_external_events [req-2ed37c95-f8b3-44dc-a2e0-cf129220ad29 req-e429137f-e66d-4f01-91ed-fd86d80853b7 service nova] Creating event network-vif-deleted:dc3fb812-3df8-4cc0-9829-c46ef1394592 for instance 60694e1e-d0cb-41c8-adf5-bdda49804385 on hv-cinder-78447 Dec 14 13:01:57.929420 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: INFO nova.api.openstack.requestlog [req-2ed37c95-f8b3-44dc-a2e0-cf129220ad29 req-e429137f-e66d-4f01-91ed-fd86d80853b7 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030363 Dec 14 13:01:57.929989 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: [pid: 116064|app: 0|req: 326/676] 10.222.0.49 () {64 vars in 1317 bytes} [Tue Dec 14 13:01:57 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 14 13:01:57.945943 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.policy [None req-d7984c37-b689-4a58-922a-5d4a770c03ca tempest-ServerRescueNegativeTestJSON-1573931620 tempest-ServerRescueNegativeTestJSON-1573931620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '731cbbfe17214ded8ac66299d66dfc45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '010919ea84eb4eb8b936c63153600eba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116063) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 13:01:57.953925 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: INFO nova.api.openstack.requestlog [None req-d7984c37-b689-4a58-922a-5d4a770c03ca tempest-ServerRescueNegativeTestJSON-1573931620 tempest-ServerRescueNegativeTestJSON-1573931620-project] 10.222.0.49 "GET /compute/v2.1/servers/eb6e04a4-8901-47df-9b51-7c1664bd3f6c" status: 200 len: 1523 microversion: 2.1 time: 0.153300 Dec 14 13:01:57.954487 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: [pid: 116063|app: 0|req: 351/677] 10.222.0.49 () {58 vars in 1235 bytes} [Tue Dec 14 13:01:57 2021] GET /compute/v2.1/servers/eb6e04a4-8901-47df-9b51-7c1664bd3f6c => generated 1523 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 14 13:01:58.977050 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.api.openstack.wsgi [None req-ffb4b95c-cad5-4993-aa42-1344fff282fa tempest-ServerRescueNegativeTestJSON-1573931620 tempest-ServerRescueNegativeTestJSON-1573931620-project] Calling method '>' {{(pid=116064) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 13:01:58.978200 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.compute.api [None req-ffb4b95c-cad5-4993-aa42-1344fff282fa tempest-ServerRescueNegativeTestJSON-1573931620 tempest-ServerRescueNegativeTestJSON-1573931620-project] [instance: eb6e04a4-8901-47df-9b51-7c1664bd3f6c] Fetching instance by UUID {{(pid=116064) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 13:01:58.988659 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-ffb4b95c-cad5-4993-aa42-1344fff282fa tempest-ServerRescueNegativeTestJSON-1573931620 tempest-ServerRescueNegativeTestJSON-1573931620-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 13:01:58.989471 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-ffb4b95c-cad5-4993-aa42-1344fff282fa tempest-ServerRescueNegativeTestJSON-1573931620 tempest-ServerRescueNegativeTestJSON-1573931620-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 13:01:58.990772 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-ffb4b95c-cad5-4993-aa42-1344fff282fa tempest-ServerRescueNegativeTestJSON-1573931620 tempest-ServerRescueNegativeTestJSON-1573931620-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 13:01:58.991495 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-ffb4b95c-cad5-4993-aa42-1344fff282fa tempest-ServerRescueNegativeTestJSON-1573931620 tempest-ServerRescueNegativeTestJSON-1573931620-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 13:01:59.136130 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.policy [None req-ffb4b95c-cad5-4993-aa42-1344fff282fa tempest-ServerRescueNegativeTestJSON-1573931620 tempest-ServerRescueNegativeTestJSON-1573931620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '731cbbfe17214ded8ac66299d66dfc45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '010919ea84eb4eb8b936c63153600eba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116064) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 13:01:59.147345 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: INFO nova.api.openstack.requestlog [None req-ffb4b95c-cad5-4993-aa42-1344fff282fa tempest-ServerRescueNegativeTestJSON-1573931620 tempest-ServerRescueNegativeTestJSON-1573931620-project] 10.222.0.49 "GET /compute/v2.1/servers/eb6e04a4-8901-47df-9b51-7c1664bd3f6c" status: 200 len: 1523 microversion: 2.1 time: 0.177839 Dec 14 13:01:59.148057 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: [pid: 116064|app: 0|req: 327/678] 10.222.0.49 () {58 vars in 1235 bytes} [Tue Dec 14 13:01:58 2021] GET /compute/v2.1/servers/eb6e04a4-8901-47df-9b51-7c1664bd3f6c => generated 1523 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 14 13:02:00.167616 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.api.openstack.wsgi [None req-608510c4-9ee2-4e12-8e13-bdfdf5e59a90 tempest-ServerRescueNegativeTestJSON-1573931620 tempest-ServerRescueNegativeTestJSON-1573931620-project] Calling method '>' {{(pid=116063) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 13:02:00.168330 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.compute.api [None req-608510c4-9ee2-4e12-8e13-bdfdf5e59a90 tempest-ServerRescueNegativeTestJSON-1573931620 tempest-ServerRescueNegativeTestJSON-1573931620-project] [instance: eb6e04a4-8901-47df-9b51-7c1664bd3f6c] Fetching instance by UUID {{(pid=116063) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 13:02:00.175757 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-608510c4-9ee2-4e12-8e13-bdfdf5e59a90 tempest-ServerRescueNegativeTestJSON-1573931620 tempest-ServerRescueNegativeTestJSON-1573931620-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 13:02:00.176221 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-608510c4-9ee2-4e12-8e13-bdfdf5e59a90 tempest-ServerRescueNegativeTestJSON-1573931620 tempest-ServerRescueNegativeTestJSON-1573931620-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 13:02:00.177038 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-608510c4-9ee2-4e12-8e13-bdfdf5e59a90 tempest-ServerRescueNegativeTestJSON-1573931620 tempest-ServerRescueNegativeTestJSON-1573931620-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 13:02:00.177467 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-608510c4-9ee2-4e12-8e13-bdfdf5e59a90 tempest-ServerRescueNegativeTestJSON-1573931620 tempest-ServerRescueNegativeTestJSON-1573931620-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 13:02:00.309025 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.policy [None req-608510c4-9ee2-4e12-8e13-bdfdf5e59a90 tempest-ServerRescueNegativeTestJSON-1573931620 tempest-ServerRescueNegativeTestJSON-1573931620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '731cbbfe17214ded8ac66299d66dfc45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '010919ea84eb4eb8b936c63153600eba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116063) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 13:02:00.316692 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: INFO nova.api.openstack.requestlog [None req-608510c4-9ee2-4e12-8e13-bdfdf5e59a90 tempest-ServerRescueNegativeTestJSON-1573931620 tempest-ServerRescueNegativeTestJSON-1573931620-project] 10.222.0.49 "GET /compute/v2.1/servers/eb6e04a4-8901-47df-9b51-7c1664bd3f6c" status: 200 len: 1523 microversion: 2.1 time: 0.152885 Dec 14 13:02:00.317275 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: [pid: 116063|app: 0|req: 352/679] 10.222.0.49 () {58 vars in 1235 bytes} [Tue Dec 14 13:02:00 2021] GET /compute/v2.1/servers/eb6e04a4-8901-47df-9b51-7c1664bd3f6c => generated 1523 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 14 13:02:01.337835 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.api.openstack.wsgi [None req-fcb4639a-e017-42d3-b83f-ae739de41543 tempest-ServerRescueNegativeTestJSON-1573931620 tempest-ServerRescueNegativeTestJSON-1573931620-project] Calling method '>' {{(pid=116064) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 13:02:01.338733 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.compute.api [None req-fcb4639a-e017-42d3-b83f-ae739de41543 tempest-ServerRescueNegativeTestJSON-1573931620 tempest-ServerRescueNegativeTestJSON-1573931620-project] [instance: eb6e04a4-8901-47df-9b51-7c1664bd3f6c] Fetching instance by UUID {{(pid=116064) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 13:02:01.348302 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-fcb4639a-e017-42d3-b83f-ae739de41543 tempest-ServerRescueNegativeTestJSON-1573931620 tempest-ServerRescueNegativeTestJSON-1573931620-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 13:02:01.348753 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-fcb4639a-e017-42d3-b83f-ae739de41543 tempest-ServerRescueNegativeTestJSON-1573931620 tempest-ServerRescueNegativeTestJSON-1573931620-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 13:02:01.349569 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-fcb4639a-e017-42d3-b83f-ae739de41543 tempest-ServerRescueNegativeTestJSON-1573931620 tempest-ServerRescueNegativeTestJSON-1573931620-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 13:02:01.350005 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-fcb4639a-e017-42d3-b83f-ae739de41543 tempest-ServerRescueNegativeTestJSON-1573931620 tempest-ServerRescueNegativeTestJSON-1573931620-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 13:02:01.487201 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.policy [None req-fcb4639a-e017-42d3-b83f-ae739de41543 tempest-ServerRescueNegativeTestJSON-1573931620 tempest-ServerRescueNegativeTestJSON-1573931620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '731cbbfe17214ded8ac66299d66dfc45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '010919ea84eb4eb8b936c63153600eba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116064) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 13:02:01.494916 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: INFO nova.api.openstack.requestlog [None req-fcb4639a-e017-42d3-b83f-ae739de41543 tempest-ServerRescueNegativeTestJSON-1573931620 tempest-ServerRescueNegativeTestJSON-1573931620-project] 10.222.0.49 "GET /compute/v2.1/servers/eb6e04a4-8901-47df-9b51-7c1664bd3f6c" status: 200 len: 1523 microversion: 2.1 time: 0.162891 Dec 14 13:02:01.495464 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: [pid: 116064|app: 0|req: 328/680] 10.222.0.49 () {58 vars in 1235 bytes} [Tue Dec 14 13:02:01 2021] GET /compute/v2.1/servers/eb6e04a4-8901-47df-9b51-7c1664bd3f6c => generated 1523 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 14 13:02:02.512082 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.api.openstack.wsgi [None req-5ae9b45f-9663-46d9-96b9-e57baec6a473 tempest-ServerRescueNegativeTestJSON-1573931620 tempest-ServerRescueNegativeTestJSON-1573931620-project] Calling method '>' {{(pid=116063) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 13:02:02.512635 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.compute.api [None req-5ae9b45f-9663-46d9-96b9-e57baec6a473 tempest-ServerRescueNegativeTestJSON-1573931620 tempest-ServerRescueNegativeTestJSON-1573931620-project] [instance: eb6e04a4-8901-47df-9b51-7c1664bd3f6c] Fetching instance by UUID {{(pid=116063) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 13:02:02.519382 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-5ae9b45f-9663-46d9-96b9-e57baec6a473 tempest-ServerRescueNegativeTestJSON-1573931620 tempest-ServerRescueNegativeTestJSON-1573931620-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 13:02:02.519843 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-5ae9b45f-9663-46d9-96b9-e57baec6a473 tempest-ServerRescueNegativeTestJSON-1573931620 tempest-ServerRescueNegativeTestJSON-1573931620-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 13:02:02.520619 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-5ae9b45f-9663-46d9-96b9-e57baec6a473 tempest-ServerRescueNegativeTestJSON-1573931620 tempest-ServerRescueNegativeTestJSON-1573931620-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 13:02:02.521081 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-5ae9b45f-9663-46d9-96b9-e57baec6a473 tempest-ServerRescueNegativeTestJSON-1573931620 tempest-ServerRescueNegativeTestJSON-1573931620-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 13:02:02.650927 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.policy [None req-5ae9b45f-9663-46d9-96b9-e57baec6a473 tempest-ServerRescueNegativeTestJSON-1573931620 tempest-ServerRescueNegativeTestJSON-1573931620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '731cbbfe17214ded8ac66299d66dfc45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '010919ea84eb4eb8b936c63153600eba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116063) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 13:02:02.658586 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: INFO nova.api.openstack.requestlog [None req-5ae9b45f-9663-46d9-96b9-e57baec6a473 tempest-ServerRescueNegativeTestJSON-1573931620 tempest-ServerRescueNegativeTestJSON-1573931620-project] 10.222.0.49 "GET /compute/v2.1/servers/eb6e04a4-8901-47df-9b51-7c1664bd3f6c" status: 200 len: 1523 microversion: 2.1 time: 0.150291 Dec 14 13:02:02.659133 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: [pid: 116063|app: 0|req: 353/681] 10.222.0.49 () {58 vars in 1235 bytes} [Tue Dec 14 13:02:02 2021] GET /compute/v2.1/servers/eb6e04a4-8901-47df-9b51-7c1664bd3f6c => generated 1523 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 14 13:02:03.678421 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.api.openstack.wsgi [None req-a603406f-1a9e-43f8-8d2e-845aaad991aa tempest-ServerRescueNegativeTestJSON-1573931620 tempest-ServerRescueNegativeTestJSON-1573931620-project] Calling method '>' {{(pid=116064) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 13:02:03.679044 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.compute.api [None req-a603406f-1a9e-43f8-8d2e-845aaad991aa tempest-ServerRescueNegativeTestJSON-1573931620 tempest-ServerRescueNegativeTestJSON-1573931620-project] [instance: eb6e04a4-8901-47df-9b51-7c1664bd3f6c] Fetching instance by UUID {{(pid=116064) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 13:02:03.685913 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-a603406f-1a9e-43f8-8d2e-845aaad991aa tempest-ServerRescueNegativeTestJSON-1573931620 tempest-ServerRescueNegativeTestJSON-1573931620-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 13:02:03.686362 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-a603406f-1a9e-43f8-8d2e-845aaad991aa tempest-ServerRescueNegativeTestJSON-1573931620 tempest-ServerRescueNegativeTestJSON-1573931620-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 13:02:03.687144 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-a603406f-1a9e-43f8-8d2e-845aaad991aa tempest-ServerRescueNegativeTestJSON-1573931620 tempest-ServerRescueNegativeTestJSON-1573931620-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 13:02:03.687577 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-a603406f-1a9e-43f8-8d2e-845aaad991aa tempest-ServerRescueNegativeTestJSON-1573931620 tempest-ServerRescueNegativeTestJSON-1573931620-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 13:02:03.821736 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.policy [None req-a603406f-1a9e-43f8-8d2e-845aaad991aa tempest-ServerRescueNegativeTestJSON-1573931620 tempest-ServerRescueNegativeTestJSON-1573931620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '731cbbfe17214ded8ac66299d66dfc45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '010919ea84eb4eb8b936c63153600eba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116064) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 13:02:03.829309 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: INFO nova.api.openstack.requestlog [None req-a603406f-1a9e-43f8-8d2e-845aaad991aa tempest-ServerRescueNegativeTestJSON-1573931620 tempest-ServerRescueNegativeTestJSON-1573931620-project] 10.222.0.49 "GET /compute/v2.1/servers/eb6e04a4-8901-47df-9b51-7c1664bd3f6c" status: 200 len: 1523 microversion: 2.1 time: 0.155692 Dec 14 13:02:03.829900 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: [pid: 116064|app: 0|req: 329/682] 10.222.0.49 () {58 vars in 1235 bytes} [Tue Dec 14 13:02:03 2021] GET /compute/v2.1/servers/eb6e04a4-8901-47df-9b51-7c1664bd3f6c => generated 1523 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 14 13:02:04.846337 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.api.openstack.wsgi [None req-4f17eee6-5568-485d-a532-acfd628ef7fe tempest-ServerRescueNegativeTestJSON-1573931620 tempest-ServerRescueNegativeTestJSON-1573931620-project] Calling method '>' {{(pid=116063) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 13:02:04.846944 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.compute.api [None req-4f17eee6-5568-485d-a532-acfd628ef7fe tempest-ServerRescueNegativeTestJSON-1573931620 tempest-ServerRescueNegativeTestJSON-1573931620-project] [instance: eb6e04a4-8901-47df-9b51-7c1664bd3f6c] Fetching instance by UUID {{(pid=116063) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 13:02:04.853763 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-4f17eee6-5568-485d-a532-acfd628ef7fe tempest-ServerRescueNegativeTestJSON-1573931620 tempest-ServerRescueNegativeTestJSON-1573931620-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 13:02:04.854212 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-4f17eee6-5568-485d-a532-acfd628ef7fe tempest-ServerRescueNegativeTestJSON-1573931620 tempest-ServerRescueNegativeTestJSON-1573931620-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 13:02:04.854993 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-4f17eee6-5568-485d-a532-acfd628ef7fe tempest-ServerRescueNegativeTestJSON-1573931620 tempest-ServerRescueNegativeTestJSON-1573931620-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 13:02:04.855430 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-4f17eee6-5568-485d-a532-acfd628ef7fe tempest-ServerRescueNegativeTestJSON-1573931620 tempest-ServerRescueNegativeTestJSON-1573931620-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 13:02:04.987159 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.policy [None req-4f17eee6-5568-485d-a532-acfd628ef7fe tempest-ServerRescueNegativeTestJSON-1573931620 tempest-ServerRescueNegativeTestJSON-1573931620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '731cbbfe17214ded8ac66299d66dfc45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '010919ea84eb4eb8b936c63153600eba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116063) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 13:02:04.995089 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: INFO nova.api.openstack.requestlog [None req-4f17eee6-5568-485d-a532-acfd628ef7fe tempest-ServerRescueNegativeTestJSON-1573931620 tempest-ServerRescueNegativeTestJSON-1573931620-project] 10.222.0.49 "GET /compute/v2.1/servers/eb6e04a4-8901-47df-9b51-7c1664bd3f6c" status: 200 len: 1523 microversion: 2.1 time: 0.152501 Dec 14 13:02:04.995696 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: [pid: 116063|app: 0|req: 354/683] 10.222.0.49 () {58 vars in 1235 bytes} [Tue Dec 14 13:02:04 2021] GET /compute/v2.1/servers/eb6e04a4-8901-47df-9b51-7c1664bd3f6c => generated 1523 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 14 13:02:06.011709 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.api.openstack.wsgi [None req-78e50928-101a-41a6-b2b1-6bb873f7ba03 tempest-ServerRescueNegativeTestJSON-1573931620 tempest-ServerRescueNegativeTestJSON-1573931620-project] Calling method '>' {{(pid=116064) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 13:02:06.012297 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.compute.api [None req-78e50928-101a-41a6-b2b1-6bb873f7ba03 tempest-ServerRescueNegativeTestJSON-1573931620 tempest-ServerRescueNegativeTestJSON-1573931620-project] [instance: eb6e04a4-8901-47df-9b51-7c1664bd3f6c] Fetching instance by UUID {{(pid=116064) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 13:02:06.019210 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-78e50928-101a-41a6-b2b1-6bb873f7ba03 tempest-ServerRescueNegativeTestJSON-1573931620 tempest-ServerRescueNegativeTestJSON-1573931620-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 13:02:06.019667 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-78e50928-101a-41a6-b2b1-6bb873f7ba03 tempest-ServerRescueNegativeTestJSON-1573931620 tempest-ServerRescueNegativeTestJSON-1573931620-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 13:02:06.020445 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-78e50928-101a-41a6-b2b1-6bb873f7ba03 tempest-ServerRescueNegativeTestJSON-1573931620 tempest-ServerRescueNegativeTestJSON-1573931620-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 13:02:06.021066 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-78e50928-101a-41a6-b2b1-6bb873f7ba03 tempest-ServerRescueNegativeTestJSON-1573931620 tempest-ServerRescueNegativeTestJSON-1573931620-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 13:02:06.152014 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.policy [None req-78e50928-101a-41a6-b2b1-6bb873f7ba03 tempest-ServerRescueNegativeTestJSON-1573931620 tempest-ServerRescueNegativeTestJSON-1573931620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '731cbbfe17214ded8ac66299d66dfc45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '010919ea84eb4eb8b936c63153600eba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116064) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 13:02:06.159428 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: INFO nova.api.openstack.requestlog [None req-78e50928-101a-41a6-b2b1-6bb873f7ba03 tempest-ServerRescueNegativeTestJSON-1573931620 tempest-ServerRescueNegativeTestJSON-1573931620-project] 10.222.0.49 "GET /compute/v2.1/servers/eb6e04a4-8901-47df-9b51-7c1664bd3f6c" status: 200 len: 1523 microversion: 2.1 time: 0.151618 Dec 14 13:02:06.160004 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: [pid: 116064|app: 0|req: 330/684] 10.222.0.49 () {58 vars in 1235 bytes} [Tue Dec 14 13:02:06 2021] GET /compute/v2.1/servers/eb6e04a4-8901-47df-9b51-7c1664bd3f6c => generated 1523 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 14 13:02:06.270195 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.api.openstack.wsgi [req-db914419-2906-4c3c-8355-cd2c4242f05c req-ec59dce1-2da3-405e-baff-8db6cef59e48 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "eb6e04a4-8901-47df-9b51-7c1664bd3f6c", "name": "network-vif-deleted", "tag": "97df3dc5-b4a4-4c81-9f39-f292ced202fb"}]} {{(pid=116063) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 14 13:02:06.272402 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 14 13:02:06.272402 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: warnings.warn(msg) Dec 14 13:02:06.281825 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [req-db914419-2906-4c3c-8355-cd2c4242f05c req-ec59dce1-2da3-405e-baff-8db6cef59e48 service nova] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 13:02:06.287899 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [req-db914419-2906-4c3c-8355-cd2c4242f05c req-ec59dce1-2da3-405e-baff-8db6cef59e48 service nova] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 13:02:06.293965 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: INFO nova.api.openstack.compute.server_external_events [req-db914419-2906-4c3c-8355-cd2c4242f05c req-ec59dce1-2da3-405e-baff-8db6cef59e48 service nova] Creating event network-vif-deleted:97df3dc5-b4a4-4c81-9f39-f292ced202fb for instance eb6e04a4-8901-47df-9b51-7c1664bd3f6c on hv-cinder-78447 Dec 14 13:02:06.299258 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: INFO nova.api.openstack.requestlog [req-db914419-2906-4c3c-8355-cd2c4242f05c req-ec59dce1-2da3-405e-baff-8db6cef59e48 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034508 Dec 14 13:02:06.299854 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: [pid: 116063|app: 0|req: 355/685] 10.222.0.49 () {64 vars in 1317 bytes} [Tue Dec 14 13:02:06 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 14 13:02:07.179993 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.api.openstack.wsgi [None req-fd8d19bc-6e10-4ad2-8afc-f90b970f56fa tempest-ServerRescueNegativeTestJSON-1573931620 tempest-ServerRescueNegativeTestJSON-1573931620-project] Calling method '>' {{(pid=116064) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 13:02:07.180829 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.compute.api [None req-fd8d19bc-6e10-4ad2-8afc-f90b970f56fa tempest-ServerRescueNegativeTestJSON-1573931620 tempest-ServerRescueNegativeTestJSON-1573931620-project] [instance: eb6e04a4-8901-47df-9b51-7c1664bd3f6c] Fetching instance by UUID {{(pid=116064) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 13:02:07.191621 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-fd8d19bc-6e10-4ad2-8afc-f90b970f56fa tempest-ServerRescueNegativeTestJSON-1573931620 tempest-ServerRescueNegativeTestJSON-1573931620-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 13:02:07.192364 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-fd8d19bc-6e10-4ad2-8afc-f90b970f56fa tempest-ServerRescueNegativeTestJSON-1573931620 tempest-ServerRescueNegativeTestJSON-1573931620-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 13:02:07.193570 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-fd8d19bc-6e10-4ad2-8afc-f90b970f56fa tempest-ServerRescueNegativeTestJSON-1573931620 tempest-ServerRescueNegativeTestJSON-1573931620-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 13:02:07.193997 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-fd8d19bc-6e10-4ad2-8afc-f90b970f56fa tempest-ServerRescueNegativeTestJSON-1573931620 tempest-ServerRescueNegativeTestJSON-1573931620-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 13:02:07.255861 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.policy [None req-fd8d19bc-6e10-4ad2-8afc-f90b970f56fa tempest-ServerRescueNegativeTestJSON-1573931620 tempest-ServerRescueNegativeTestJSON-1573931620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '731cbbfe17214ded8ac66299d66dfc45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '010919ea84eb4eb8b936c63153600eba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116064) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 13:02:07.263871 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: INFO nova.api.openstack.requestlog [None req-fd8d19bc-6e10-4ad2-8afc-f90b970f56fa tempest-ServerRescueNegativeTestJSON-1573931620 tempest-ServerRescueNegativeTestJSON-1573931620-project] 10.222.0.49 "GET /compute/v2.1/servers/eb6e04a4-8901-47df-9b51-7c1664bd3f6c" status: 200 len: 1307 microversion: 2.1 time: 0.090252 Dec 14 13:02:07.264441 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: [pid: 116064|app: 0|req: 331/686] 10.222.0.49 () {58 vars in 1235 bytes} [Tue Dec 14 13:02:07 2021] GET /compute/v2.1/servers/eb6e04a4-8901-47df-9b51-7c1664bd3f6c => generated 1307 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 14 13:02:08.282591 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.api.openstack.wsgi [None req-85ec5923-4490-46a6-89f0-26fd15a88662 tempest-ServerRescueNegativeTestJSON-1573931620 tempest-ServerRescueNegativeTestJSON-1573931620-project] Calling method '>' {{(pid=116063) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 13:02:08.283335 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.compute.api [None req-85ec5923-4490-46a6-89f0-26fd15a88662 tempest-ServerRescueNegativeTestJSON-1573931620 tempest-ServerRescueNegativeTestJSON-1573931620-project] [instance: eb6e04a4-8901-47df-9b51-7c1664bd3f6c] Fetching instance by UUID {{(pid=116063) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 13:02:08.291086 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-85ec5923-4490-46a6-89f0-26fd15a88662 tempest-ServerRescueNegativeTestJSON-1573931620 tempest-ServerRescueNegativeTestJSON-1573931620-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 13:02:08.291545 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-85ec5923-4490-46a6-89f0-26fd15a88662 tempest-ServerRescueNegativeTestJSON-1573931620 tempest-ServerRescueNegativeTestJSON-1573931620-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 13:02:08.292642 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-85ec5923-4490-46a6-89f0-26fd15a88662 tempest-ServerRescueNegativeTestJSON-1573931620 tempest-ServerRescueNegativeTestJSON-1573931620-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 13:02:08.293158 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-85ec5923-4490-46a6-89f0-26fd15a88662 tempest-ServerRescueNegativeTestJSON-1573931620 tempest-ServerRescueNegativeTestJSON-1573931620-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 13:02:08.307878 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: INFO nova.api.openstack.wsgi [None req-85ec5923-4490-46a6-89f0-26fd15a88662 tempest-ServerRescueNegativeTestJSON-1573931620 tempest-ServerRescueNegativeTestJSON-1573931620-project] HTTP exception thrown: Instance eb6e04a4-8901-47df-9b51-7c1664bd3f6c could not be found. Dec 14 13:02:08.308470 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.api.openstack.wsgi [None req-85ec5923-4490-46a6-89f0-26fd15a88662 tempest-ServerRescueNegativeTestJSON-1573931620 tempest-ServerRescueNegativeTestJSON-1573931620-project] Returning 404 to user: Instance eb6e04a4-8901-47df-9b51-7c1664bd3f6c could not be found. {{(pid=116063) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 14 13:02:08.309344 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: INFO nova.api.openstack.requestlog [None req-85ec5923-4490-46a6-89f0-26fd15a88662 tempest-ServerRescueNegativeTestJSON-1573931620 tempest-ServerRescueNegativeTestJSON-1573931620-project] 10.222.0.49 "GET /compute/v2.1/servers/eb6e04a4-8901-47df-9b51-7c1664bd3f6c" status: 404 len: 111 microversion: 2.1 time: 0.031597 Dec 14 13:02:08.309883 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: [pid: 116063|app: 0|req: 356/687] 10.222.0.49 () {58 vars in 1235 bytes} [Tue Dec 14 13:02:08 2021] GET /compute/v2.1/servers/eb6e04a4-8901-47df-9b51-7c1664bd3f6c => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Dec 14 13:02:17.046095 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.api.openstack.wsgi [None req-35da472a-c08a-4980-8585-daf4cf3d2dd9 tempest-AttachVolumeTestJSON-709357402 tempest-AttachVolumeTestJSON-709357402-project] Action: 'create', calling method: .version_select at 0x7f2ace3aac10>, body: {"keypair": {"name": "tempest-keypair-1366229700"}} {{(pid=116064) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 14 13:02:17.064880 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.quota [None req-35da472a-c08a-4980-8585-daf4cf3d2dd9 tempest-AttachVolumeTestJSON-709357402 tempest-AttachVolumeTestJSON-709357402-project] Getting quotas for project 8b1a390d20a54f4d9529d286ab7764a5. Resources: {'key_pairs'} {{(pid=116064) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 14 13:02:17.068824 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.quota [None req-35da472a-c08a-4980-8585-daf4cf3d2dd9 tempest-AttachVolumeTestJSON-709357402 tempest-AttachVolumeTestJSON-709357402-project] Getting quotas for user 083128ec42474a3e82a2b0fc8c278f4d and project 8b1a390d20a54f4d9529d286ab7764a5. Resources: {'key_pairs'} {{(pid=116064) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 14 13:02:17.221153 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.quota [None req-35da472a-c08a-4980-8585-daf4cf3d2dd9 tempest-AttachVolumeTestJSON-709357402 tempest-AttachVolumeTestJSON-709357402-project] Getting quotas for project 8b1a390d20a54f4d9529d286ab7764a5. Resources: {'key_pairs'} {{(pid=116064) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 14 13:02:17.225057 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.quota [None req-35da472a-c08a-4980-8585-daf4cf3d2dd9 tempest-AttachVolumeTestJSON-709357402 tempest-AttachVolumeTestJSON-709357402-project] Getting quotas for user 083128ec42474a3e82a2b0fc8c278f4d and project 8b1a390d20a54f4d9529d286ab7764a5. Resources: {'key_pairs'} {{(pid=116064) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 14 13:02:17.239338 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: INFO nova.api.openstack.requestlog [None req-35da472a-c08a-4980-8585-daf4cf3d2dd9 tempest-AttachVolumeTestJSON-709357402 tempest-AttachVolumeTestJSON-709357402-project] 10.222.0.49 "POST /compute/v2.1/os-keypairs" status: 200 len: 2305 microversion: 2.1 time: 0.347138 Dec 14 13:02:17.239882 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: [pid: 116064|app: 0|req: 332/688] 10.222.0.49 () {60 vars in 1157 bytes} [Tue Dec 14 13:02:16 2021] POST /compute/v2.1/os-keypairs => generated 2305 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 14 13:02:18.568292 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.api.openstack.wsgi [None req-2b5e727b-fb29-4750-a625-0b617acd85cb tempest-AttachVolumeTestJSON-709357402 tempest-AttachVolumeTestJSON-709357402-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-487373301", "imageRef": "1733dcd4-5ded-44e1-8b8d-392adb05c67a", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "bd1c5b8e-76aa-4f4c-95ad-0b8348f823dc"}], "security_groups": [{"name": "tempest-securitygroup--2051723768"}], "key_name": "tempest-keypair-1366229700", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=116063) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 14 13:02:18.674265 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.network.neutron [None req-2b5e727b-fb29-4750-a625-0b617acd85cb tempest-AttachVolumeTestJSON-709357402 tempest-AttachVolumeTestJSON-709357402-project] validate_networks() for [('bd1c5b8e-76aa-4f4c-95ad-0b8348f823dc', None, None, None, None, None)] {{(pid=116063) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Dec 14 13:02:19.043100 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.virt.hardware [None req-2b5e727b-fb29-4750-a625-0b617acd85cb tempest-AttachVolumeTestJSON-709357402 tempest-AttachVolumeTestJSON-709357402-project] Flavor limits 0:0:0 {{(pid=116063) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Dec 14 13:02:19.043518 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.virt.hardware [None req-2b5e727b-fb29-4750-a625-0b617acd85cb tempest-AttachVolumeTestJSON-709357402 tempest-AttachVolumeTestJSON-709357402-project] Image limits 0:0:0 {{(pid=116063) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Dec 14 13:02:19.043984 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.virt.hardware [None req-2b5e727b-fb29-4750-a625-0b617acd85cb tempest-AttachVolumeTestJSON-709357402 tempest-AttachVolumeTestJSON-709357402-project] Flavor pref 0:0:0 {{(pid=116063) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Dec 14 13:02:19.044781 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.virt.hardware [None req-2b5e727b-fb29-4750-a625-0b617acd85cb tempest-AttachVolumeTestJSON-709357402 tempest-AttachVolumeTestJSON-709357402-project] Image pref 0:0:0 {{(pid=116063) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Dec 14 13:02:19.045207 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.virt.hardware [None req-2b5e727b-fb29-4750-a625-0b617acd85cb tempest-AttachVolumeTestJSON-709357402 tempest-AttachVolumeTestJSON-709357402-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=116063) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Dec 14 13:02:19.054353 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-2b5e727b-fb29-4750-a625-0b617acd85cb tempest-AttachVolumeTestJSON-709357402 tempest-AttachVolumeTestJSON-709357402-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 13:02:19.054799 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-2b5e727b-fb29-4750-a625-0b617acd85cb tempest-AttachVolumeTestJSON-709357402 tempest-AttachVolumeTestJSON-709357402-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 13:02:19.055598 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-2b5e727b-fb29-4750-a625-0b617acd85cb tempest-AttachVolumeTestJSON-709357402 tempest-AttachVolumeTestJSON-709357402-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 13:02:19.056024 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-2b5e727b-fb29-4750-a625-0b617acd85cb tempest-AttachVolumeTestJSON-709357402 tempest-AttachVolumeTestJSON-709357402-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 13:02:19.073747 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.quota [None req-2b5e727b-fb29-4750-a625-0b617acd85cb tempest-AttachVolumeTestJSON-709357402 tempest-AttachVolumeTestJSON-709357402-project] Getting quotas for project 8b1a390d20a54f4d9529d286ab7764a5. Resources: {'cores', 'instances', 'ram'} {{(pid=116063) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 14 13:02:19.077985 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.quota [None req-2b5e727b-fb29-4750-a625-0b617acd85cb tempest-AttachVolumeTestJSON-709357402 tempest-AttachVolumeTestJSON-709357402-project] Getting quotas for user 083128ec42474a3e82a2b0fc8c278f4d and project 8b1a390d20a54f4d9529d286ab7764a5. Resources: {'cores', 'instances', 'ram'} {{(pid=116063) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 14 13:02:19.090170 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.compute.api [None req-2b5e727b-fb29-4750-a625-0b617acd85cb tempest-AttachVolumeTestJSON-709357402 tempest-AttachVolumeTestJSON-709357402-project] Going to run 1 instances... {{(pid=116063) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Dec 14 13:02:19.092646 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.compute.api [None req-2b5e727b-fb29-4750-a625-0b617acd85cb tempest-AttachVolumeTestJSON-709357402 tempest-AttachVolumeTestJSON-709357402-project] [instance: 1b8e1f2f-c109-4413-9d56-33ef0b651f85] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='1733dcd4-5ded-44e1-8b8d-392adb05c67a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=116063) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Dec 14 13:02:19.142941 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: INFO nova.api.openstack.requestlog [None req-2b5e727b-fb29-4750-a625-0b617acd85cb tempest-AttachVolumeTestJSON-709357402 tempest-AttachVolumeTestJSON-709357402-project] 10.222.0.49 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.578726 Dec 14 13:02:19.143556 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: [pid: 116063|app: 0|req: 357/689] 10.222.0.49 () {60 vars in 1146 bytes} [Tue Dec 14 13:02:18 2021] POST /compute/v2.1/servers => generated 402 bytes in 580 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Dec 14 13:02:19.153685 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.api.openstack.wsgi [None req-83ad2ab6-331e-4f15-9c37-4cfe3c0bdb10 tempest-AttachVolumeTestJSON-709357402 tempest-AttachVolumeTestJSON-709357402-project] Calling method '>' {{(pid=116064) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 13:02:19.154329 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.compute.api [None req-83ad2ab6-331e-4f15-9c37-4cfe3c0bdb10 tempest-AttachVolumeTestJSON-709357402 tempest-AttachVolumeTestJSON-709357402-project] [instance: 1b8e1f2f-c109-4413-9d56-33ef0b651f85] Fetching instance by UUID {{(pid=116064) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 13:02:19.213839 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.policy [None req-83ad2ab6-331e-4f15-9c37-4cfe3c0bdb10 tempest-AttachVolumeTestJSON-709357402 tempest-AttachVolumeTestJSON-709357402-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '083128ec42474a3e82a2b0fc8c278f4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b1a390d20a54f4d9529d286ab7764a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116064) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 13:02:19.235530 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: INFO nova.api.openstack.requestlog [None req-83ad2ab6-331e-4f15-9c37-4cfe3c0bdb10 tempest-AttachVolumeTestJSON-709357402 tempest-AttachVolumeTestJSON-709357402-project] 10.222.0.49 "GET /compute/v2.1/servers/1b8e1f2f-c109-4413-9d56-33ef0b651f85" status: 200 len: 1237 microversion: 2.1 time: 0.084476 Dec 14 13:02:19.236530 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: [pid: 116064|app: 0|req: 333/690] 10.222.0.49 () {58 vars in 1235 bytes} [Tue Dec 14 13:02:19 2021] GET /compute/v2.1/servers/1b8e1f2f-c109-4413-9d56-33ef0b651f85 => generated 1237 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 14 13:02:20.253883 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.api.openstack.wsgi [None req-c441b82f-ce08-4772-b36a-c9e847c5a922 tempest-AttachVolumeTestJSON-709357402 tempest-AttachVolumeTestJSON-709357402-project] Calling method '>' {{(pid=116063) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 13:02:20.255240 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.compute.api [None req-c441b82f-ce08-4772-b36a-c9e847c5a922 tempest-AttachVolumeTestJSON-709357402 tempest-AttachVolumeTestJSON-709357402-project] [instance: 1b8e1f2f-c109-4413-9d56-33ef0b651f85] Fetching instance by UUID {{(pid=116063) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 13:02:20.261792 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-c441b82f-ce08-4772-b36a-c9e847c5a922 tempest-AttachVolumeTestJSON-709357402 tempest-AttachVolumeTestJSON-709357402-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 13:02:20.262569 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-c441b82f-ce08-4772-b36a-c9e847c5a922 tempest-AttachVolumeTestJSON-709357402 tempest-AttachVolumeTestJSON-709357402-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 13:02:20.263745 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-c441b82f-ce08-4772-b36a-c9e847c5a922 tempest-AttachVolumeTestJSON-709357402 tempest-AttachVolumeTestJSON-709357402-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 13:02:20.264403 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-c441b82f-ce08-4772-b36a-c9e847c5a922 tempest-AttachVolumeTestJSON-709357402 tempest-AttachVolumeTestJSON-709357402-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 13:02:20.337331 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.policy [None req-c441b82f-ce08-4772-b36a-c9e847c5a922 tempest-AttachVolumeTestJSON-709357402 tempest-AttachVolumeTestJSON-709357402-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '083128ec42474a3e82a2b0fc8c278f4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b1a390d20a54f4d9529d286ab7764a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116063) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 13:02:20.345473 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: INFO nova.api.openstack.requestlog [None req-c441b82f-ce08-4772-b36a-c9e847c5a922 tempest-AttachVolumeTestJSON-709357402 tempest-AttachVolumeTestJSON-709357402-project] 10.222.0.49 "GET /compute/v2.1/servers/1b8e1f2f-c109-4413-9d56-33ef0b651f85" status: 200 len: 1307 microversion: 2.1 time: 0.095920 Dec 14 13:02:20.346747 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: [pid: 116063|app: 0|req: 358/691] 10.222.0.49 () {58 vars in 1235 bytes} [Tue Dec 14 13:02:20 2021] GET /compute/v2.1/servers/1b8e1f2f-c109-4413-9d56-33ef0b651f85 => generated 1307 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 14 13:02:21.362411 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.api.openstack.wsgi [None req-7dbc9334-b45e-4e7e-94a6-55090623c6a4 tempest-AttachVolumeTestJSON-709357402 tempest-AttachVolumeTestJSON-709357402-project] Calling method '>' {{(pid=116064) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 13:02:21.363741 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.compute.api [None req-7dbc9334-b45e-4e7e-94a6-55090623c6a4 tempest-AttachVolumeTestJSON-709357402 tempest-AttachVolumeTestJSON-709357402-project] [instance: 1b8e1f2f-c109-4413-9d56-33ef0b651f85] Fetching instance by UUID {{(pid=116064) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 13:02:21.370142 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-7dbc9334-b45e-4e7e-94a6-55090623c6a4 tempest-AttachVolumeTestJSON-709357402 tempest-AttachVolumeTestJSON-709357402-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 13:02:21.370851 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-7dbc9334-b45e-4e7e-94a6-55090623c6a4 tempest-AttachVolumeTestJSON-709357402 tempest-AttachVolumeTestJSON-709357402-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 13:02:21.371702 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-7dbc9334-b45e-4e7e-94a6-55090623c6a4 tempest-AttachVolumeTestJSON-709357402 tempest-AttachVolumeTestJSON-709357402-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 13:02:21.372349 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-7dbc9334-b45e-4e7e-94a6-55090623c6a4 tempest-AttachVolumeTestJSON-709357402 tempest-AttachVolumeTestJSON-709357402-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 13:02:21.509349 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.policy [None req-7dbc9334-b45e-4e7e-94a6-55090623c6a4 tempest-AttachVolumeTestJSON-709357402 tempest-AttachVolumeTestJSON-709357402-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '083128ec42474a3e82a2b0fc8c278f4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b1a390d20a54f4d9529d286ab7764a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116064) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 13:02:21.516903 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: INFO nova.api.openstack.requestlog [None req-7dbc9334-b45e-4e7e-94a6-55090623c6a4 tempest-AttachVolumeTestJSON-709357402 tempest-AttachVolumeTestJSON-709357402-project] 10.222.0.49 "GET /compute/v2.1/servers/1b8e1f2f-c109-4413-9d56-33ef0b651f85" status: 200 len: 1363 microversion: 2.1 time: 0.158204 Dec 14 13:02:21.517505 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: [pid: 116064|app: 0|req: 334/692] 10.222.0.49 () {58 vars in 1235 bytes} [Tue Dec 14 13:02:21 2021] GET /compute/v2.1/servers/1b8e1f2f-c109-4413-9d56-33ef0b651f85 => generated 1363 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 14 13:02:21.817422 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.api.openstack.wsgi [req-c24b69fb-cafa-4f80-a4d7-6c54b4c76f0f req-661acf36-6db4-4197-b7ef-06959a4f5c03 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1b8e1f2f-c109-4413-9d56-33ef0b651f85", "tag": "a2ba138b-4125-4b6b-ab4d-99c16d8b8a80"}]} {{(pid=116063) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 14 13:02:21.819869 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 14 13:02:21.819869 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: warnings.warn(msg) Dec 14 13:02:21.833674 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [req-c24b69fb-cafa-4f80-a4d7-6c54b4c76f0f req-661acf36-6db4-4197-b7ef-06959a4f5c03 service nova] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 13:02:21.833674 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [req-c24b69fb-cafa-4f80-a4d7-6c54b4c76f0f req-661acf36-6db4-4197-b7ef-06959a4f5c03 service nova] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 13:02:21.846632 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: INFO nova.api.openstack.compute.server_external_events [req-c24b69fb-cafa-4f80-a4d7-6c54b4c76f0f req-661acf36-6db4-4197-b7ef-06959a4f5c03 service nova] Creating event network-changed:a2ba138b-4125-4b6b-ab4d-99c16d8b8a80 for instance 1b8e1f2f-c109-4413-9d56-33ef0b651f85 on hv-cinder-78447 Dec 14 13:02:21.852814 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: INFO nova.api.openstack.requestlog [req-c24b69fb-cafa-4f80-a4d7-6c54b4c76f0f req-661acf36-6db4-4197-b7ef-06959a4f5c03 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039061 Dec 14 13:02:21.856243 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: [pid: 116063|app: 0|req: 359/693] 10.222.0.49 () {64 vars in 1317 bytes} [Tue Dec 14 13:02:21 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 14 13:02:22.533864 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.api.openstack.wsgi [None req-98d558c3-27e5-4a48-a2f4-fc1f9818026d tempest-AttachVolumeTestJSON-709357402 tempest-AttachVolumeTestJSON-709357402-project] Calling method '>' {{(pid=116064) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 13:02:22.534567 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.compute.api [None req-98d558c3-27e5-4a48-a2f4-fc1f9818026d tempest-AttachVolumeTestJSON-709357402 tempest-AttachVolumeTestJSON-709357402-project] [instance: 1b8e1f2f-c109-4413-9d56-33ef0b651f85] Fetching instance by UUID {{(pid=116064) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 13:02:22.541546 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-98d558c3-27e5-4a48-a2f4-fc1f9818026d tempest-AttachVolumeTestJSON-709357402 tempest-AttachVolumeTestJSON-709357402-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 13:02:22.541994 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-98d558c3-27e5-4a48-a2f4-fc1f9818026d tempest-AttachVolumeTestJSON-709357402 tempest-AttachVolumeTestJSON-709357402-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 13:02:22.542759 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-98d558c3-27e5-4a48-a2f4-fc1f9818026d tempest-AttachVolumeTestJSON-709357402 tempest-AttachVolumeTestJSON-709357402-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 13:02:22.543185 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-98d558c3-27e5-4a48-a2f4-fc1f9818026d tempest-AttachVolumeTestJSON-709357402 tempest-AttachVolumeTestJSON-709357402-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 13:02:22.677754 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.policy [None req-98d558c3-27e5-4a48-a2f4-fc1f9818026d tempest-AttachVolumeTestJSON-709357402 tempest-AttachVolumeTestJSON-709357402-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '083128ec42474a3e82a2b0fc8c278f4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b1a390d20a54f4d9529d286ab7764a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116064) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 13:02:22.685307 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: INFO nova.api.openstack.requestlog [None req-98d558c3-27e5-4a48-a2f4-fc1f9818026d tempest-AttachVolumeTestJSON-709357402 tempest-AttachVolumeTestJSON-709357402-project] 10.222.0.49 "GET /compute/v2.1/servers/1b8e1f2f-c109-4413-9d56-33ef0b651f85" status: 200 len: 1363 microversion: 2.1 time: 0.155082 Dec 14 13:02:22.685925 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: [pid: 116064|app: 0|req: 335/694] 10.222.0.49 () {58 vars in 1235 bytes} [Tue Dec 14 13:02:22 2021] GET /compute/v2.1/servers/1b8e1f2f-c109-4413-9d56-33ef0b651f85 => generated 1363 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 14 13:02:23.703196 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.api.openstack.wsgi [None req-165b354d-22ec-4344-b7ed-59e416d8f78b tempest-AttachVolumeTestJSON-709357402 tempest-AttachVolumeTestJSON-709357402-project] Calling method '>' {{(pid=116063) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 13:02:23.703799 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.compute.api [None req-165b354d-22ec-4344-b7ed-59e416d8f78b tempest-AttachVolumeTestJSON-709357402 tempest-AttachVolumeTestJSON-709357402-project] [instance: 1b8e1f2f-c109-4413-9d56-33ef0b651f85] Fetching instance by UUID {{(pid=116063) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 13:02:23.710092 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-165b354d-22ec-4344-b7ed-59e416d8f78b tempest-AttachVolumeTestJSON-709357402 tempest-AttachVolumeTestJSON-709357402-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 13:02:23.710536 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-165b354d-22ec-4344-b7ed-59e416d8f78b tempest-AttachVolumeTestJSON-709357402 tempest-AttachVolumeTestJSON-709357402-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 13:02:23.711318 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-165b354d-22ec-4344-b7ed-59e416d8f78b tempest-AttachVolumeTestJSON-709357402 tempest-AttachVolumeTestJSON-709357402-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 13:02:23.711739 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-165b354d-22ec-4344-b7ed-59e416d8f78b tempest-AttachVolumeTestJSON-709357402 tempest-AttachVolumeTestJSON-709357402-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 13:02:23.868426 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.policy [None req-165b354d-22ec-4344-b7ed-59e416d8f78b tempest-AttachVolumeTestJSON-709357402 tempest-AttachVolumeTestJSON-709357402-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '083128ec42474a3e82a2b0fc8c278f4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b1a390d20a54f4d9529d286ab7764a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116063) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 13:02:23.876830 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: INFO nova.api.openstack.requestlog [None req-165b354d-22ec-4344-b7ed-59e416d8f78b tempest-AttachVolumeTestJSON-709357402 tempest-AttachVolumeTestJSON-709357402-project] 10.222.0.49 "GET /compute/v2.1/servers/1b8e1f2f-c109-4413-9d56-33ef0b651f85" status: 200 len: 1363 microversion: 2.1 time: 0.178196 Dec 14 13:02:23.877719 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: [pid: 116063|app: 0|req: 360/695] 10.222.0.49 () {58 vars in 1235 bytes} [Tue Dec 14 13:02:23 2021] GET /compute/v2.1/servers/1b8e1f2f-c109-4413-9d56-33ef0b651f85 => generated 1363 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 14 13:02:24.894275 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.api.openstack.wsgi [None req-ec8136a9-ab22-4cbc-8203-64f58d5c2fc4 tempest-AttachVolumeTestJSON-709357402 tempest-AttachVolumeTestJSON-709357402-project] Calling method '>' {{(pid=116064) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 13:02:24.894833 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.compute.api [None req-ec8136a9-ab22-4cbc-8203-64f58d5c2fc4 tempest-AttachVolumeTestJSON-709357402 tempest-AttachVolumeTestJSON-709357402-project] [instance: 1b8e1f2f-c109-4413-9d56-33ef0b651f85] Fetching instance by UUID {{(pid=116064) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 13:02:24.901282 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-ec8136a9-ab22-4cbc-8203-64f58d5c2fc4 tempest-AttachVolumeTestJSON-709357402 tempest-AttachVolumeTestJSON-709357402-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 13:02:24.901713 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-ec8136a9-ab22-4cbc-8203-64f58d5c2fc4 tempest-AttachVolumeTestJSON-709357402 tempest-AttachVolumeTestJSON-709357402-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 13:02:24.902494 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-ec8136a9-ab22-4cbc-8203-64f58d5c2fc4 tempest-AttachVolumeTestJSON-709357402 tempest-AttachVolumeTestJSON-709357402-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 13:02:24.902926 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-ec8136a9-ab22-4cbc-8203-64f58d5c2fc4 tempest-AttachVolumeTestJSON-709357402 tempest-AttachVolumeTestJSON-709357402-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 13:02:25.039928 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.policy [None req-ec8136a9-ab22-4cbc-8203-64f58d5c2fc4 tempest-AttachVolumeTestJSON-709357402 tempest-AttachVolumeTestJSON-709357402-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '083128ec42474a3e82a2b0fc8c278f4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b1a390d20a54f4d9529d286ab7764a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116064) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 13:02:25.047837 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: INFO nova.api.openstack.requestlog [None req-ec8136a9-ab22-4cbc-8203-64f58d5c2fc4 tempest-AttachVolumeTestJSON-709357402 tempest-AttachVolumeTestJSON-709357402-project] 10.222.0.49 "GET /compute/v2.1/servers/1b8e1f2f-c109-4413-9d56-33ef0b651f85" status: 200 len: 1363 microversion: 2.1 time: 0.157294 Dec 14 13:02:25.048523 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: [pid: 116064|app: 0|req: 336/696] 10.222.0.49 () {58 vars in 1235 bytes} [Tue Dec 14 13:02:24 2021] GET /compute/v2.1/servers/1b8e1f2f-c109-4413-9d56-33ef0b651f85 => generated 1363 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 14 13:02:26.065473 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.api.openstack.wsgi [None req-e03b36d3-3c95-4a2b-a870-9c4a180c8fd1 tempest-AttachVolumeTestJSON-709357402 tempest-AttachVolumeTestJSON-709357402-project] Calling method '>' {{(pid=116063) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 13:02:26.066079 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.compute.api [None req-e03b36d3-3c95-4a2b-a870-9c4a180c8fd1 tempest-AttachVolumeTestJSON-709357402 tempest-AttachVolumeTestJSON-709357402-project] [instance: 1b8e1f2f-c109-4413-9d56-33ef0b651f85] Fetching instance by UUID {{(pid=116063) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 13:02:26.072882 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-e03b36d3-3c95-4a2b-a870-9c4a180c8fd1 tempest-AttachVolumeTestJSON-709357402 tempest-AttachVolumeTestJSON-709357402-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 13:02:26.073391 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-e03b36d3-3c95-4a2b-a870-9c4a180c8fd1 tempest-AttachVolumeTestJSON-709357402 tempest-AttachVolumeTestJSON-709357402-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 13:02:26.074158 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-e03b36d3-3c95-4a2b-a870-9c4a180c8fd1 tempest-AttachVolumeTestJSON-709357402 tempest-AttachVolumeTestJSON-709357402-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 13:02:26.074554 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-e03b36d3-3c95-4a2b-a870-9c4a180c8fd1 tempest-AttachVolumeTestJSON-709357402 tempest-AttachVolumeTestJSON-709357402-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 13:02:26.212985 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.policy [None req-e03b36d3-3c95-4a2b-a870-9c4a180c8fd1 tempest-AttachVolumeTestJSON-709357402 tempest-AttachVolumeTestJSON-709357402-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '083128ec42474a3e82a2b0fc8c278f4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b1a390d20a54f4d9529d286ab7764a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116063) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 13:02:26.220561 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: INFO nova.api.openstack.requestlog [None req-e03b36d3-3c95-4a2b-a870-9c4a180c8fd1 tempest-AttachVolumeTestJSON-709357402 tempest-AttachVolumeTestJSON-709357402-project] 10.222.0.49 "GET /compute/v2.1/servers/1b8e1f2f-c109-4413-9d56-33ef0b651f85" status: 200 len: 1363 microversion: 2.1 time: 0.158642 Dec 14 13:02:26.221163 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: [pid: 116063|app: 0|req: 361/697] 10.222.0.49 () {58 vars in 1235 bytes} [Tue Dec 14 13:02:26 2021] GET /compute/v2.1/servers/1b8e1f2f-c109-4413-9d56-33ef0b651f85 => generated 1363 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 14 13:02:27.237614 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.api.openstack.wsgi [None req-a9483bd9-97d1-4c78-bc6a-ee9031b35d0c tempest-AttachVolumeTestJSON-709357402 tempest-AttachVolumeTestJSON-709357402-project] Calling method '>' {{(pid=116064) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 13:02:27.238217 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.compute.api [None req-a9483bd9-97d1-4c78-bc6a-ee9031b35d0c tempest-AttachVolumeTestJSON-709357402 tempest-AttachVolumeTestJSON-709357402-project] [instance: 1b8e1f2f-c109-4413-9d56-33ef0b651f85] Fetching instance by UUID {{(pid=116064) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 13:02:27.245616 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-a9483bd9-97d1-4c78-bc6a-ee9031b35d0c tempest-AttachVolumeTestJSON-709357402 tempest-AttachVolumeTestJSON-709357402-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 13:02:27.246063 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-a9483bd9-97d1-4c78-bc6a-ee9031b35d0c tempest-AttachVolumeTestJSON-709357402 tempest-AttachVolumeTestJSON-709357402-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 13:02:27.246842 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-a9483bd9-97d1-4c78-bc6a-ee9031b35d0c tempest-AttachVolumeTestJSON-709357402 tempest-AttachVolumeTestJSON-709357402-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 13:02:27.247272 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-a9483bd9-97d1-4c78-bc6a-ee9031b35d0c tempest-AttachVolumeTestJSON-709357402 tempest-AttachVolumeTestJSON-709357402-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 13:02:27.437496 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.api.openstack.wsgi [req-0acab4bf-ea4e-4422-b36f-544dc89d6303 req-46aaba3a-01ac-4420-b63a-9bf69c207948 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1b8e1f2f-c109-4413-9d56-33ef0b651f85", "name": "network-vif-plugged", "status": "completed", "tag": "a2ba138b-4125-4b6b-ab4d-99c16d8b8a80"}]} {{(pid=116063) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 14 13:02:27.439350 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 14 13:02:27.439350 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: warnings.warn(msg) Dec 14 13:02:27.447498 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [req-0acab4bf-ea4e-4422-b36f-544dc89d6303 req-46aaba3a-01ac-4420-b63a-9bf69c207948 service nova] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 13:02:27.448065 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [req-0acab4bf-ea4e-4422-b36f-544dc89d6303 req-46aaba3a-01ac-4420-b63a-9bf69c207948 service nova] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 13:02:27.460880 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: INFO nova.api.openstack.compute.server_external_events [req-0acab4bf-ea4e-4422-b36f-544dc89d6303 req-46aaba3a-01ac-4420-b63a-9bf69c207948 service nova] Creating event network-vif-plugged:a2ba138b-4125-4b6b-ab4d-99c16d8b8a80 for instance 1b8e1f2f-c109-4413-9d56-33ef0b651f85 on hv-cinder-78447 Dec 14 13:02:27.466198 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: INFO nova.api.openstack.requestlog [req-0acab4bf-ea4e-4422-b36f-544dc89d6303 req-46aaba3a-01ac-4420-b63a-9bf69c207948 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034203 Dec 14 13:02:27.466350 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.policy [None req-a9483bd9-97d1-4c78-bc6a-ee9031b35d0c tempest-AttachVolumeTestJSON-709357402 tempest-AttachVolumeTestJSON-709357402-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '083128ec42474a3e82a2b0fc8c278f4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b1a390d20a54f4d9529d286ab7764a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116064) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 13:02:27.467165 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: [pid: 116063|app: 0|req: 362/698] 10.222.0.49 () {64 vars in 1317 bytes} [Tue Dec 14 13:02:27 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Dec 14 13:02:27.476794 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: INFO nova.api.openstack.requestlog [None req-a9483bd9-97d1-4c78-bc6a-ee9031b35d0c tempest-AttachVolumeTestJSON-709357402 tempest-AttachVolumeTestJSON-709357402-project] 10.222.0.49 "GET /compute/v2.1/servers/1b8e1f2f-c109-4413-9d56-33ef0b651f85" status: 200 len: 1363 microversion: 2.1 time: 0.243170 Dec 14 13:02:27.477691 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: [pid: 116064|app: 0|req: 337/699] 10.222.0.49 () {58 vars in 1235 bytes} [Tue Dec 14 13:02:27 2021] GET /compute/v2.1/servers/1b8e1f2f-c109-4413-9d56-33ef0b651f85 => generated 1363 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 14 13:02:28.494932 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.api.openstack.wsgi [None req-084b7483-e258-45b5-a0d0-389f82536c5e tempest-AttachVolumeTestJSON-709357402 tempest-AttachVolumeTestJSON-709357402-project] Calling method '>' {{(pid=116063) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 13:02:28.495633 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.compute.api [None req-084b7483-e258-45b5-a0d0-389f82536c5e tempest-AttachVolumeTestJSON-709357402 tempest-AttachVolumeTestJSON-709357402-project] [instance: 1b8e1f2f-c109-4413-9d56-33ef0b651f85] Fetching instance by UUID {{(pid=116063) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 13:02:28.501934 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-084b7483-e258-45b5-a0d0-389f82536c5e tempest-AttachVolumeTestJSON-709357402 tempest-AttachVolumeTestJSON-709357402-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 13:02:28.502412 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-084b7483-e258-45b5-a0d0-389f82536c5e tempest-AttachVolumeTestJSON-709357402 tempest-AttachVolumeTestJSON-709357402-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 13:02:28.503154 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-084b7483-e258-45b5-a0d0-389f82536c5e tempest-AttachVolumeTestJSON-709357402 tempest-AttachVolumeTestJSON-709357402-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 13:02:28.503585 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-084b7483-e258-45b5-a0d0-389f82536c5e tempest-AttachVolumeTestJSON-709357402 tempest-AttachVolumeTestJSON-709357402-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 13:02:28.642865 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.policy [None req-084b7483-e258-45b5-a0d0-389f82536c5e tempest-AttachVolumeTestJSON-709357402 tempest-AttachVolumeTestJSON-709357402-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '083128ec42474a3e82a2b0fc8c278f4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b1a390d20a54f4d9529d286ab7764a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116063) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 13:02:28.650686 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: INFO nova.api.openstack.requestlog [None req-084b7483-e258-45b5-a0d0-389f82536c5e tempest-AttachVolumeTestJSON-709357402 tempest-AttachVolumeTestJSON-709357402-project] 10.222.0.49 "GET /compute/v2.1/servers/1b8e1f2f-c109-4413-9d56-33ef0b651f85" status: 200 len: 1363 microversion: 2.1 time: 0.160223 Dec 14 13:02:28.651275 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: [pid: 116063|app: 0|req: 363/700] 10.222.0.49 () {58 vars in 1235 bytes} [Tue Dec 14 13:02:28 2021] GET /compute/v2.1/servers/1b8e1f2f-c109-4413-9d56-33ef0b651f85 => generated 1363 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 14 13:02:29.667490 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.api.openstack.wsgi [None req-c3c2d084-43e1-44b6-be3a-98f54bc98320 tempest-AttachVolumeTestJSON-709357402 tempest-AttachVolumeTestJSON-709357402-project] Calling method '>' {{(pid=116064) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 13:02:29.668342 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.compute.api [None req-c3c2d084-43e1-44b6-be3a-98f54bc98320 tempest-AttachVolumeTestJSON-709357402 tempest-AttachVolumeTestJSON-709357402-project] [instance: 1b8e1f2f-c109-4413-9d56-33ef0b651f85] Fetching instance by UUID {{(pid=116064) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 13:02:29.675152 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-c3c2d084-43e1-44b6-be3a-98f54bc98320 tempest-AttachVolumeTestJSON-709357402 tempest-AttachVolumeTestJSON-709357402-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 13:02:29.675624 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-c3c2d084-43e1-44b6-be3a-98f54bc98320 tempest-AttachVolumeTestJSON-709357402 tempest-AttachVolumeTestJSON-709357402-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 13:02:29.676405 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-c3c2d084-43e1-44b6-be3a-98f54bc98320 tempest-AttachVolumeTestJSON-709357402 tempest-AttachVolumeTestJSON-709357402-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 13:02:29.676872 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-c3c2d084-43e1-44b6-be3a-98f54bc98320 tempest-AttachVolumeTestJSON-709357402 tempest-AttachVolumeTestJSON-709357402-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 13:02:29.825132 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.policy [None req-c3c2d084-43e1-44b6-be3a-98f54bc98320 tempest-AttachVolumeTestJSON-709357402 tempest-AttachVolumeTestJSON-709357402-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '083128ec42474a3e82a2b0fc8c278f4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b1a390d20a54f4d9529d286ab7764a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116064) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 13:02:29.833236 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: INFO nova.api.openstack.requestlog [None req-c3c2d084-43e1-44b6-be3a-98f54bc98320 tempest-AttachVolumeTestJSON-709357402 tempest-AttachVolumeTestJSON-709357402-project] 10.222.0.49 "GET /compute/v2.1/servers/1b8e1f2f-c109-4413-9d56-33ef0b651f85" status: 200 len: 1548 microversion: 2.1 time: 0.169423 Dec 14 13:02:29.833783 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: [pid: 116064|app: 0|req: 338/701] 10.222.0.49 () {58 vars in 1235 bytes} [Tue Dec 14 13:02:29 2021] GET /compute/v2.1/servers/1b8e1f2f-c109-4413-9d56-33ef0b651f85 => generated 1548 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 14 13:02:29.849656 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.api.openstack.wsgi [None req-2865d3b7-cd1e-4244-873b-b4a8b5090635 tempest-AttachVolumeTestJSON-709357402 tempest-AttachVolumeTestJSON-709357402-project] Calling method '>' {{(pid=116063) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 13:02:29.850369 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.compute.api [None req-2865d3b7-cd1e-4244-873b-b4a8b5090635 tempest-AttachVolumeTestJSON-709357402 tempest-AttachVolumeTestJSON-709357402-project] [instance: 1b8e1f2f-c109-4413-9d56-33ef0b651f85] Fetching instance by UUID {{(pid=116063) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 13:02:29.856840 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-2865d3b7-cd1e-4244-873b-b4a8b5090635 tempest-AttachVolumeTestJSON-709357402 tempest-AttachVolumeTestJSON-709357402-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 13:02:29.857304 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-2865d3b7-cd1e-4244-873b-b4a8b5090635 tempest-AttachVolumeTestJSON-709357402 tempest-AttachVolumeTestJSON-709357402-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 13:02:29.859171 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-2865d3b7-cd1e-4244-873b-b4a8b5090635 tempest-AttachVolumeTestJSON-709357402 tempest-AttachVolumeTestJSON-709357402-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 13:02:29.859621 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-2865d3b7-cd1e-4244-873b-b4a8b5090635 tempest-AttachVolumeTestJSON-709357402 tempest-AttachVolumeTestJSON-709357402-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 13:02:29.940202 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: INFO nova.api.openstack.requestlog [None req-2865d3b7-cd1e-4244-873b-b4a8b5090635 tempest-AttachVolumeTestJSON-709357402 tempest-AttachVolumeTestJSON-709357402-project] 10.222.0.49 "GET /compute/v2.1/servers/1b8e1f2f-c109-4413-9d56-33ef0b651f85/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.094210 Dec 14 13:02:29.940799 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: [pid: 116063|app: 0|req: 364/702] 10.222.0.49 () {58 vars in 1274 bytes} [Tue Dec 14 13:02:29 2021] GET /compute/v2.1/servers/1b8e1f2f-c109-4413-9d56-33ef0b651f85/os-interface => generated 284 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 14 13:02:30.936198 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.api.openstack.wsgi [None req-b2100a10-8069-462b-a1fb-c5ef3d23fc3b tempest-AttachVolumeTestJSON-709357402 tempest-AttachVolumeTestJSON-709357402-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116064) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 14 13:02:30.937395 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.compute.api [None req-b2100a10-8069-462b-a1fb-c5ef3d23fc3b tempest-AttachVolumeTestJSON-709357402 tempest-AttachVolumeTestJSON-709357402-project] [instance: 1b8e1f2f-c109-4413-9d56-33ef0b651f85] Fetching instance by UUID {{(pid=116064) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 13:02:30.938493 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.api.openstack.wsgi [req-8776b8f7-5f73-417f-b8c3-4da63da3d88a req-6490b7fc-17d2-4049-93ee-066ee4968b49 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1b8e1f2f-c109-4413-9d56-33ef0b651f85", "tag": "a2ba138b-4125-4b6b-ab4d-99c16d8b8a80"}]} {{(pid=116063) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 14 13:02:30.940148 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 14 13:02:30.940148 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: warnings.warn(msg) Dec 14 13:02:30.945247 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-b2100a10-8069-462b-a1fb-c5ef3d23fc3b tempest-AttachVolumeTestJSON-709357402 tempest-AttachVolumeTestJSON-709357402-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 13:02:30.945925 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-b2100a10-8069-462b-a1fb-c5ef3d23fc3b tempest-AttachVolumeTestJSON-709357402 tempest-AttachVolumeTestJSON-709357402-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 13:02:30.946782 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-b2100a10-8069-462b-a1fb-c5ef3d23fc3b tempest-AttachVolumeTestJSON-709357402 tempest-AttachVolumeTestJSON-709357402-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 13:02:30.947144 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [req-8776b8f7-5f73-417f-b8c3-4da63da3d88a req-6490b7fc-17d2-4049-93ee-066ee4968b49 service nova] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 13:02:30.947455 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-b2100a10-8069-462b-a1fb-c5ef3d23fc3b tempest-AttachVolumeTestJSON-709357402 tempest-AttachVolumeTestJSON-709357402-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 13:02:30.947581 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [req-8776b8f7-5f73-417f-b8c3-4da63da3d88a req-6490b7fc-17d2-4049-93ee-066ee4968b49 service nova] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 13:02:30.958956 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: INFO nova.api.openstack.compute.server_external_events [req-8776b8f7-5f73-417f-b8c3-4da63da3d88a req-6490b7fc-17d2-4049-93ee-066ee4968b49 service nova] Creating event network-changed:a2ba138b-4125-4b6b-ab4d-99c16d8b8a80 for instance 1b8e1f2f-c109-4413-9d56-33ef0b651f85 on hv-cinder-78447 Dec 14 13:02:30.964076 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: INFO nova.api.openstack.requestlog [req-8776b8f7-5f73-417f-b8c3-4da63da3d88a req-6490b7fc-17d2-4049-93ee-066ee4968b49 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.029817 Dec 14 13:02:30.970798 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: [pid: 116063|app: 0|req: 365/703] 10.222.0.49 () {64 vars in 1317 bytes} [Tue Dec 14 13:02:30 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 14 13:02:31.010204 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: INFO nova.api.openstack.requestlog [None req-b2100a10-8069-462b-a1fb-c5ef3d23fc3b tempest-AttachVolumeTestJSON-709357402 tempest-AttachVolumeTestJSON-709357402-project] 10.222.0.49 "POST /compute/v2.1/servers/1b8e1f2f-c109-4413-9d56-33ef0b651f85/action" status: 200 len: 14 microversion: 2.1 time: 0.078104 Dec 14 13:02:31.010853 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: [pid: 116064|app: 0|req: 339/704] 10.222.0.49 () {60 vars in 1277 bytes} [Tue Dec 14 13:02:30 2021] POST /compute/v2.1/servers/1b8e1f2f-c109-4413-9d56-33ef0b651f85/action => generated 14 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Dec 14 13:02:31.086881 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.api.openstack.wsgi [None req-43c9943c-e159-46f2-a112-7e0c019e0e7d tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] Calling method '>' {{(pid=116063) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 13:02:31.087347 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.compute.api [None req-43c9943c-e159-46f2-a112-7e0c019e0e7d tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] [instance: c8de7730-62f2-4a77-b1e9-cf6a74fa366d] Fetching instance by UUID {{(pid=116063) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 13:02:31.093749 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-43c9943c-e159-46f2-a112-7e0c019e0e7d tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 13:02:31.094378 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-43c9943c-e159-46f2-a112-7e0c019e0e7d tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 13:02:31.095319 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-43c9943c-e159-46f2-a112-7e0c019e0e7d tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 13:02:31.095908 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-43c9943c-e159-46f2-a112-7e0c019e0e7d tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 13:02:31.125330 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: INFO nova.api.openstack.requestlog [None req-43c9943c-e159-46f2-a112-7e0c019e0e7d tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] 10.222.0.49 "GET /compute/v2.1/servers/c8de7730-62f2-4a77-b1e9-cf6a74fa366d/os-volume_attachments/1953b13d-3968-4f69-986c-5bb69c65f2c2" status: 200 len: 194 microversion: 2.20 time: 0.042833 Dec 14 13:02:31.125927 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: [pid: 116063|app: 0|req: 366/705] 10.222.0.49 () {60 vars in 1453 bytes} [Tue Dec 14 13:02:31 2021] GET /compute/v2.1/servers/c8de7730-62f2-4a77-b1e9-cf6a74fa366d/os-volume_attachments/1953b13d-3968-4f69-986c-5bb69c65f2c2 => generated 194 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 14 13:02:31.190595 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.api.openstack.wsgi [None req-6cf5f63d-b0e3-4394-8717-593db97d27a1 tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] Calling method '>' {{(pid=116064) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 13:02:31.191191 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.compute.api [None req-6cf5f63d-b0e3-4394-8717-593db97d27a1 tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] [instance: c8de7730-62f2-4a77-b1e9-cf6a74fa366d] Fetching instance by UUID {{(pid=116064) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 13:02:31.198372 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-6cf5f63d-b0e3-4394-8717-593db97d27a1 tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 13:02:31.199108 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-6cf5f63d-b0e3-4394-8717-593db97d27a1 tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 13:02:31.200239 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-6cf5f63d-b0e3-4394-8717-593db97d27a1 tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 13:02:31.200675 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-6cf5f63d-b0e3-4394-8717-593db97d27a1 tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 13:02:31.288266 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.objects.instance [None req-6cf5f63d-b0e3-4394-8717-593db97d27a1 tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] Lazy-loading 'services' on Instance uuid c8de7730-62f2-4a77-b1e9-cf6a74fa366d {{(pid=116064) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Dec 14 13:02:31.361163 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: INFO nova.api.openstack.requestlog [None req-6cf5f63d-b0e3-4394-8717-593db97d27a1 tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] 10.222.0.49 "DELETE /compute/v2.1/servers/c8de7730-62f2-4a77-b1e9-cf6a74fa366d/os-volume_attachments/1953b13d-3968-4f69-986c-5bb69c65f2c2" status: 202 len: 0 microversion: 2.20 time: 0.174503 Dec 14 13:02:31.361936 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: [pid: 116064|app: 0|req: 340/706] 10.222.0.49 () {60 vars in 1456 bytes} [Tue Dec 14 13:02:31 2021] DELETE /compute/v2.1/servers/c8de7730-62f2-4a77-b1e9-cf6a74fa366d/os-volume_attachments/1953b13d-3968-4f69-986c-5bb69c65f2c2 => generated 0 bytes in 176 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Dec 14 13:02:31.372057 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.api.openstack.wsgi [None req-3c7c1d8b-975d-43b2-8171-6e2f720c0877 tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] Calling method '>' {{(pid=116063) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 13:02:31.373556 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.compute.api [None req-3c7c1d8b-975d-43b2-8171-6e2f720c0877 tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] [instance: c8de7730-62f2-4a77-b1e9-cf6a74fa366d] Fetching instance by UUID {{(pid=116063) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 13:02:31.381976 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-3c7c1d8b-975d-43b2-8171-6e2f720c0877 tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 13:02:31.382796 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-3c7c1d8b-975d-43b2-8171-6e2f720c0877 tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 13:02:31.383940 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-3c7c1d8b-975d-43b2-8171-6e2f720c0877 tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 13:02:31.384564 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-3c7c1d8b-975d-43b2-8171-6e2f720c0877 tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 13:02:31.416656 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: INFO nova.api.openstack.requestlog [None req-3c7c1d8b-975d-43b2-8171-6e2f720c0877 tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] 10.222.0.49 "GET /compute/v2.1/servers/c8de7730-62f2-4a77-b1e9-cf6a74fa366d/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.049764 Dec 14 13:02:31.417294 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: [pid: 116063|app: 0|req: 367/707] 10.222.0.49 () {60 vars in 1342 bytes} [Tue Dec 14 13:02:31 2021] GET /compute/v2.1/servers/c8de7730-62f2-4a77-b1e9-cf6a74fa366d/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 14 13:02:32.021983 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.api.openstack.wsgi [None req-1831c2db-6502-46ad-a1b1-ca84a281eb0a tempest-AttachVolumeTestJSON-709357402 tempest-AttachVolumeTestJSON-709357402-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116064) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 14 13:02:32.023598 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.compute.api [None req-1831c2db-6502-46ad-a1b1-ca84a281eb0a tempest-AttachVolumeTestJSON-709357402 tempest-AttachVolumeTestJSON-709357402-project] [instance: 1b8e1f2f-c109-4413-9d56-33ef0b651f85] Fetching instance by UUID {{(pid=116064) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 13:02:32.031884 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-1831c2db-6502-46ad-a1b1-ca84a281eb0a tempest-AttachVolumeTestJSON-709357402 tempest-AttachVolumeTestJSON-709357402-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 13:02:32.045666 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-1831c2db-6502-46ad-a1b1-ca84a281eb0a tempest-AttachVolumeTestJSON-709357402 tempest-AttachVolumeTestJSON-709357402-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 13:02:32.048114 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-1831c2db-6502-46ad-a1b1-ca84a281eb0a tempest-AttachVolumeTestJSON-709357402 tempest-AttachVolumeTestJSON-709357402-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 13:02:32.048573 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-1831c2db-6502-46ad-a1b1-ca84a281eb0a tempest-AttachVolumeTestJSON-709357402 tempest-AttachVolumeTestJSON-709357402-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 13:02:32.121452 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: INFO nova.api.openstack.requestlog [None req-1831c2db-6502-46ad-a1b1-ca84a281eb0a tempest-AttachVolumeTestJSON-709357402 tempest-AttachVolumeTestJSON-709357402-project] 10.222.0.49 "POST /compute/v2.1/servers/1b8e1f2f-c109-4413-9d56-33ef0b651f85/action" status: 200 len: 14 microversion: 2.1 time: 0.103469 Dec 14 13:02:32.122072 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: [pid: 116064|app: 0|req: 341/708] 10.222.0.49 () {60 vars in 1277 bytes} [Tue Dec 14 13:02:32 2021] POST /compute/v2.1/servers/1b8e1f2f-c109-4413-9d56-33ef0b651f85/action => generated 14 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Dec 14 13:02:32.428503 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.api.openstack.wsgi [None req-916f9376-1deb-4bd7-85f6-62dedeff08c6 tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] Calling method '>' {{(pid=116063) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 13:02:32.429548 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.compute.api [None req-916f9376-1deb-4bd7-85f6-62dedeff08c6 tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] [instance: c8de7730-62f2-4a77-b1e9-cf6a74fa366d] Fetching instance by UUID {{(pid=116063) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 13:02:32.436274 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-916f9376-1deb-4bd7-85f6-62dedeff08c6 tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 13:02:32.436719 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-916f9376-1deb-4bd7-85f6-62dedeff08c6 tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 13:02:32.437538 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-916f9376-1deb-4bd7-85f6-62dedeff08c6 tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 13:02:32.437970 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-916f9376-1deb-4bd7-85f6-62dedeff08c6 tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 13:02:32.467314 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: INFO nova.api.openstack.requestlog [None req-916f9376-1deb-4bd7-85f6-62dedeff08c6 tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] 10.222.0.49 "GET /compute/v2.1/servers/c8de7730-62f2-4a77-b1e9-cf6a74fa366d/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.042654 Dec 14 13:02:32.467985 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: [pid: 116063|app: 0|req: 368/709] 10.222.0.49 () {60 vars in 1342 bytes} [Tue Dec 14 13:02:32 2021] GET /compute/v2.1/servers/c8de7730-62f2-4a77-b1e9-cf6a74fa366d/os-volume_attachments => generated 25 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 14 13:02:32.523363 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.api.openstack.wsgi [None req-da0e8d19-948b-4cc1-92f9-29bd18b6170e tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] Calling method '>' {{(pid=116064) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 13:02:32.523951 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.compute.api [None req-da0e8d19-948b-4cc1-92f9-29bd18b6170e tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] [instance: c8de7730-62f2-4a77-b1e9-cf6a74fa366d] Fetching instance by UUID {{(pid=116064) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 13:02:32.531207 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-da0e8d19-948b-4cc1-92f9-29bd18b6170e tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 13:02:32.531876 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-da0e8d19-948b-4cc1-92f9-29bd18b6170e tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 13:02:32.532697 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-da0e8d19-948b-4cc1-92f9-29bd18b6170e tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 13:02:32.533655 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-da0e8d19-948b-4cc1-92f9-29bd18b6170e tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 13:02:32.560020 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.compute.api [None req-da0e8d19-948b-4cc1-92f9-29bd18b6170e tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] [instance: c8de7730-62f2-4a77-b1e9-cf6a74fa366d] Going to try to terminate instance {{(pid=116064) delete /opt/stack/nova/nova/compute/api.py:2614}} Dec 14 13:02:32.637857 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: INFO nova.api.openstack.requestlog [None req-da0e8d19-948b-4cc1-92f9-29bd18b6170e tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] 10.222.0.49 "DELETE /compute/v2.1/servers/c8de7730-62f2-4a77-b1e9-cf6a74fa366d" status: 204 len: 0 microversion: 2.20 time: 0.118283 Dec 14 13:02:32.638450 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: [pid: 116064|app: 0|req: 342/710] 10.222.0.49 () {60 vars in 1279 bytes} [Tue Dec 14 13:02:32 2021] DELETE /compute/v2.1/servers/c8de7730-62f2-4a77-b1e9-cf6a74fa366d => generated 0 bytes in 120 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Dec 14 13:02:32.646899 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.api.openstack.wsgi [None req-c5648294-23b7-4e19-b383-a6c1ffefea97 tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] Calling method '>' {{(pid=116063) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 13:02:32.647497 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.compute.api [None req-c5648294-23b7-4e19-b383-a6c1ffefea97 tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] [instance: c8de7730-62f2-4a77-b1e9-cf6a74fa366d] Fetching instance by UUID {{(pid=116063) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 13:02:32.653820 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-c5648294-23b7-4e19-b383-a6c1ffefea97 tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 13:02:32.654200 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-c5648294-23b7-4e19-b383-a6c1ffefea97 tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 13:02:32.654993 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-c5648294-23b7-4e19-b383-a6c1ffefea97 tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 13:02:32.655449 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-c5648294-23b7-4e19-b383-a6c1ffefea97 tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 13:02:32.798409 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.policy [None req-c5648294-23b7-4e19-b383-a6c1ffefea97 tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79d74a2ea1e541d28d085c15cec34032', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68a8770b8dbe489a8119016fbee64eb5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116063) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 13:02:32.806260 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.policy [None req-c5648294-23b7-4e19-b383-a6c1ffefea97 tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '79d74a2ea1e541d28d085c15cec34032', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68a8770b8dbe489a8119016fbee64eb5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116063) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 13:02:32.807823 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.policy [None req-c5648294-23b7-4e19-b383-a6c1ffefea97 tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '79d74a2ea1e541d28d085c15cec34032', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68a8770b8dbe489a8119016fbee64eb5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116063) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 13:02:32.809096 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: INFO nova.api.openstack.requestlog [None req-c5648294-23b7-4e19-b383-a6c1ffefea97 tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] 10.222.0.49 "GET /compute/v2.1/servers/c8de7730-62f2-4a77-b1e9-cf6a74fa366d" status: 200 len: 1724 microversion: 2.20 time: 0.166003 Dec 14 13:02:32.809647 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: [pid: 116063|app: 0|req: 369/711] 10.222.0.49 () {60 vars in 1276 bytes} [Tue Dec 14 13:02:32 2021] GET /compute/v2.1/servers/c8de7730-62f2-4a77-b1e9-cf6a74fa366d => generated 1724 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 14 13:02:33.132587 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.api.openstack.wsgi [None req-2662e820-06b6-4ae9-875a-04183510f3cf tempest-AttachVolumeTestJSON-709357402 tempest-AttachVolumeTestJSON-709357402-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116064) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 14 13:02:33.133667 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.compute.api [None req-2662e820-06b6-4ae9-875a-04183510f3cf tempest-AttachVolumeTestJSON-709357402 tempest-AttachVolumeTestJSON-709357402-project] [instance: 1b8e1f2f-c109-4413-9d56-33ef0b651f85] Fetching instance by UUID {{(pid=116064) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 13:02:33.141216 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-2662e820-06b6-4ae9-875a-04183510f3cf tempest-AttachVolumeTestJSON-709357402 tempest-AttachVolumeTestJSON-709357402-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 13:02:33.141668 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-2662e820-06b6-4ae9-875a-04183510f3cf tempest-AttachVolumeTestJSON-709357402 tempest-AttachVolumeTestJSON-709357402-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 13:02:33.142423 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-2662e820-06b6-4ae9-875a-04183510f3cf tempest-AttachVolumeTestJSON-709357402 tempest-AttachVolumeTestJSON-709357402-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 13:02:33.143025 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-2662e820-06b6-4ae9-875a-04183510f3cf tempest-AttachVolumeTestJSON-709357402 tempest-AttachVolumeTestJSON-709357402-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 13:02:33.209941 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: INFO nova.api.openstack.requestlog [None req-2662e820-06b6-4ae9-875a-04183510f3cf tempest-AttachVolumeTestJSON-709357402 tempest-AttachVolumeTestJSON-709357402-project] 10.222.0.49 "POST /compute/v2.1/servers/1b8e1f2f-c109-4413-9d56-33ef0b651f85/action" status: 200 len: 14 microversion: 2.1 time: 0.081242 Dec 14 13:02:33.210611 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: [pid: 116064|app: 0|req: 343/712] 10.222.0.49 () {60 vars in 1277 bytes} [Tue Dec 14 13:02:33 2021] POST /compute/v2.1/servers/1b8e1f2f-c109-4413-9d56-33ef0b651f85/action => generated 14 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Dec 14 13:02:33.827353 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.api.openstack.wsgi [None req-29483d02-1f99-4e82-8be1-fdde6934b844 tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] Calling method '>' {{(pid=116063) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 13:02:33.827946 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.compute.api [None req-29483d02-1f99-4e82-8be1-fdde6934b844 tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] [instance: c8de7730-62f2-4a77-b1e9-cf6a74fa366d] Fetching instance by UUID {{(pid=116063) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 13:02:33.834337 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-29483d02-1f99-4e82-8be1-fdde6934b844 tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 13:02:33.834817 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-29483d02-1f99-4e82-8be1-fdde6934b844 tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 13:02:33.835596 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-29483d02-1f99-4e82-8be1-fdde6934b844 tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 13:02:33.836033 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-29483d02-1f99-4e82-8be1-fdde6934b844 tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 13:02:33.974498 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.policy [None req-29483d02-1f99-4e82-8be1-fdde6934b844 tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79d74a2ea1e541d28d085c15cec34032', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68a8770b8dbe489a8119016fbee64eb5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116063) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 13:02:33.982459 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.policy [None req-29483d02-1f99-4e82-8be1-fdde6934b844 tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '79d74a2ea1e541d28d085c15cec34032', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68a8770b8dbe489a8119016fbee64eb5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116063) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 13:02:33.983931 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.policy [None req-29483d02-1f99-4e82-8be1-fdde6934b844 tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '79d74a2ea1e541d28d085c15cec34032', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68a8770b8dbe489a8119016fbee64eb5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116063) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 13:02:33.985135 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: INFO nova.api.openstack.requestlog [None req-29483d02-1f99-4e82-8be1-fdde6934b844 tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] 10.222.0.49 "GET /compute/v2.1/servers/c8de7730-62f2-4a77-b1e9-cf6a74fa366d" status: 200 len: 1724 microversion: 2.20 time: 0.161487 Dec 14 13:02:33.985708 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: [pid: 116063|app: 0|req: 370/713] 10.222.0.49 () {60 vars in 1276 bytes} [Tue Dec 14 13:02:33 2021] GET /compute/v2.1/servers/c8de7730-62f2-4a77-b1e9-cf6a74fa366d => generated 1724 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 14 13:02:34.227727 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.api.openstack.wsgi [None req-db986da4-f733-4d68-ae73-111174cbc4c8 tempest-AttachVolumeTestJSON-709357402 tempest-AttachVolumeTestJSON-709357402-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116064) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 14 13:02:34.228803 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.compute.api [None req-db986da4-f733-4d68-ae73-111174cbc4c8 tempest-AttachVolumeTestJSON-709357402 tempest-AttachVolumeTestJSON-709357402-project] [instance: 1b8e1f2f-c109-4413-9d56-33ef0b651f85] Fetching instance by UUID {{(pid=116064) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 13:02:34.237748 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-db986da4-f733-4d68-ae73-111174cbc4c8 tempest-AttachVolumeTestJSON-709357402 tempest-AttachVolumeTestJSON-709357402-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 13:02:34.237748 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-db986da4-f733-4d68-ae73-111174cbc4c8 tempest-AttachVolumeTestJSON-709357402 tempest-AttachVolumeTestJSON-709357402-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 13:02:34.237748 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-db986da4-f733-4d68-ae73-111174cbc4c8 tempest-AttachVolumeTestJSON-709357402 tempest-AttachVolumeTestJSON-709357402-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 13:02:34.238220 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-db986da4-f733-4d68-ae73-111174cbc4c8 tempest-AttachVolumeTestJSON-709357402 tempest-AttachVolumeTestJSON-709357402-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 13:02:34.299292 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: INFO nova.api.openstack.requestlog [None req-db986da4-f733-4d68-ae73-111174cbc4c8 tempest-AttachVolumeTestJSON-709357402 tempest-AttachVolumeTestJSON-709357402-project] 10.222.0.49 "POST /compute/v2.1/servers/1b8e1f2f-c109-4413-9d56-33ef0b651f85/action" status: 200 len: 14 microversion: 2.1 time: 0.081379 Dec 14 13:02:34.302723 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: [pid: 116064|app: 0|req: 344/714] 10.222.0.49 () {60 vars in 1277 bytes} [Tue Dec 14 13:02:34 2021] POST /compute/v2.1/servers/1b8e1f2f-c109-4413-9d56-33ef0b651f85/action => generated 14 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Dec 14 13:02:35.003684 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.api.openstack.wsgi [None req-f559667f-5a39-435d-b105-c5aea7576d22 tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] Calling method '>' {{(pid=116063) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 13:02:35.004376 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.compute.api [None req-f559667f-5a39-435d-b105-c5aea7576d22 tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] [instance: c8de7730-62f2-4a77-b1e9-cf6a74fa366d] Fetching instance by UUID {{(pid=116063) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 13:02:35.010804 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-f559667f-5a39-435d-b105-c5aea7576d22 tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 13:02:35.011254 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-f559667f-5a39-435d-b105-c5aea7576d22 tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 13:02:35.012036 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-f559667f-5a39-435d-b105-c5aea7576d22 tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 13:02:35.012471 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-f559667f-5a39-435d-b105-c5aea7576d22 tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 13:02:35.077575 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.policy [None req-f559667f-5a39-435d-b105-c5aea7576d22 tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79d74a2ea1e541d28d085c15cec34032', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68a8770b8dbe489a8119016fbee64eb5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116063) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 13:02:35.086037 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.policy [None req-f559667f-5a39-435d-b105-c5aea7576d22 tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '79d74a2ea1e541d28d085c15cec34032', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68a8770b8dbe489a8119016fbee64eb5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116063) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 13:02:35.088090 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.policy [None req-f559667f-5a39-435d-b105-c5aea7576d22 tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '79d74a2ea1e541d28d085c15cec34032', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68a8770b8dbe489a8119016fbee64eb5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116063) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 13:02:35.089760 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: INFO nova.api.openstack.requestlog [None req-f559667f-5a39-435d-b105-c5aea7576d22 tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] 10.222.0.49 "GET /compute/v2.1/servers/c8de7730-62f2-4a77-b1e9-cf6a74fa366d" status: 200 len: 1657 microversion: 2.20 time: 0.089633 Dec 14 13:02:35.090277 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: [pid: 116063|app: 0|req: 371/715] 10.222.0.49 () {60 vars in 1276 bytes} [Tue Dec 14 13:02:34 2021] GET /compute/v2.1/servers/c8de7730-62f2-4a77-b1e9-cf6a74fa366d => generated 1657 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 14 13:02:35.277739 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.api.openstack.wsgi [req-b4bef79b-f49b-4807-82f3-eb3df82e50da req-9068511f-1adf-476d-af5f-cb2d7914e579 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c8de7730-62f2-4a77-b1e9-cf6a74fa366d", "name": "network-vif-deleted", "tag": "45d34d58-1ff8-4ce3-a024-e2acb9451196"}]} {{(pid=116064) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 14 13:02:35.279905 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 14 13:02:35.279905 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: warnings.warn(msg) Dec 14 13:02:35.287989 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [req-b4bef79b-f49b-4807-82f3-eb3df82e50da req-9068511f-1adf-476d-af5f-cb2d7914e579 service nova] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 13:02:35.288684 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [req-b4bef79b-f49b-4807-82f3-eb3df82e50da req-9068511f-1adf-476d-af5f-cb2d7914e579 service nova] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 13:02:35.301531 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: INFO nova.api.openstack.compute.server_external_events [req-b4bef79b-f49b-4807-82f3-eb3df82e50da req-9068511f-1adf-476d-af5f-cb2d7914e579 service nova] Creating event network-vif-deleted:45d34d58-1ff8-4ce3-a024-e2acb9451196 for instance c8de7730-62f2-4a77-b1e9-cf6a74fa366d on hv-cinder-78447 Dec 14 13:02:35.306860 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: INFO nova.api.openstack.requestlog [req-b4bef79b-f49b-4807-82f3-eb3df82e50da req-9068511f-1adf-476d-af5f-cb2d7914e579 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033604 Dec 14 13:02:35.311265 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: [pid: 116064|app: 0|req: 345/716] 10.222.0.49 () {64 vars in 1317 bytes} [Tue Dec 14 13:02:35 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 14 13:02:35.312073 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.api.openstack.wsgi [None req-c34bb907-2f95-46d9-879e-87568da7bd27 tempest-AttachVolumeTestJSON-709357402 tempest-AttachVolumeTestJSON-709357402-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116063) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 14 13:02:35.320444 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.compute.api [None req-c34bb907-2f95-46d9-879e-87568da7bd27 tempest-AttachVolumeTestJSON-709357402 tempest-AttachVolumeTestJSON-709357402-project] [instance: 1b8e1f2f-c109-4413-9d56-33ef0b651f85] Fetching instance by UUID {{(pid=116063) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 13:02:35.335151 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-c34bb907-2f95-46d9-879e-87568da7bd27 tempest-AttachVolumeTestJSON-709357402 tempest-AttachVolumeTestJSON-709357402-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 13:02:35.335969 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-c34bb907-2f95-46d9-879e-87568da7bd27 tempest-AttachVolumeTestJSON-709357402 tempest-AttachVolumeTestJSON-709357402-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 13:02:35.343944 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-c34bb907-2f95-46d9-879e-87568da7bd27 tempest-AttachVolumeTestJSON-709357402 tempest-AttachVolumeTestJSON-709357402-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 13:02:35.344792 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-c34bb907-2f95-46d9-879e-87568da7bd27 tempest-AttachVolumeTestJSON-709357402 tempest-AttachVolumeTestJSON-709357402-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 13:02:35.454299 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: INFO nova.api.openstack.requestlog [None req-c34bb907-2f95-46d9-879e-87568da7bd27 tempest-AttachVolumeTestJSON-709357402 tempest-AttachVolumeTestJSON-709357402-project] 10.222.0.49 "POST /compute/v2.1/servers/1b8e1f2f-c109-4413-9d56-33ef0b651f85/action" status: 200 len: 14 microversion: 2.1 time: 0.147170 Dec 14 13:02:35.458908 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: [pid: 116063|app: 0|req: 372/717] 10.222.0.49 () {60 vars in 1277 bytes} [Tue Dec 14 13:02:35 2021] POST /compute/v2.1/servers/1b8e1f2f-c109-4413-9d56-33ef0b651f85/action => generated 14 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Dec 14 13:02:36.108644 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.api.openstack.wsgi [None req-eae9310b-29b6-433d-89fc-5e4939aebe91 tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] Calling method '>' {{(pid=116064) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 13:02:36.109357 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.compute.api [None req-eae9310b-29b6-433d-89fc-5e4939aebe91 tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] [instance: c8de7730-62f2-4a77-b1e9-cf6a74fa366d] Fetching instance by UUID {{(pid=116064) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 13:02:36.116226 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-eae9310b-29b6-433d-89fc-5e4939aebe91 tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 13:02:36.116671 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-eae9310b-29b6-433d-89fc-5e4939aebe91 tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 13:02:36.117482 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-eae9310b-29b6-433d-89fc-5e4939aebe91 tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 13:02:36.117909 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-eae9310b-29b6-433d-89fc-5e4939aebe91 tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 13:02:36.135913 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: INFO nova.api.openstack.wsgi [None req-eae9310b-29b6-433d-89fc-5e4939aebe91 tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] HTTP exception thrown: Instance c8de7730-62f2-4a77-b1e9-cf6a74fa366d could not be found. Dec 14 13:02:36.136548 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.api.openstack.wsgi [None req-eae9310b-29b6-433d-89fc-5e4939aebe91 tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] Returning 404 to user: Instance c8de7730-62f2-4a77-b1e9-cf6a74fa366d could not be found. {{(pid=116064) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 14 13:02:36.137438 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: INFO nova.api.openstack.requestlog [None req-eae9310b-29b6-433d-89fc-5e4939aebe91 tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] 10.222.0.49 "GET /compute/v2.1/servers/c8de7730-62f2-4a77-b1e9-cf6a74fa366d" status: 404 len: 111 microversion: 2.20 time: 0.033060 Dec 14 13:02:36.138000 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: [pid: 116064|app: 0|req: 346/718] 10.222.0.49 () {60 vars in 1276 bytes} [Tue Dec 14 13:02:36 2021] GET /compute/v2.1/servers/c8de7730-62f2-4a77-b1e9-cf6a74fa366d => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Dec 14 13:02:36.146740 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.api.openstack.wsgi [None req-b99e276d-5840-4317-bd0c-cfdd87834a78 tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] Calling method '.version_select at 0x7f2acda88d30>' {{(pid=116063) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 13:02:36.176780 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: INFO nova.api.openstack.requestlog [None req-b99e276d-5840-4317-bd0c-cfdd87834a78 tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] 10.222.0.49 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1408201028" status: 204 len: 0 microversion: 2.20 time: 0.033938 Dec 14 13:02:36.178104 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: [pid: 116063|app: 0|req: 373/719] 10.222.0.49 () {60 vars in 1261 bytes} [Tue Dec 14 13:02:36 2021] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1408201028 => generated 0 bytes in 36 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Dec 14 13:02:36.470195 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.api.openstack.wsgi [None req-d60a776e-46c6-4f1d-8ce2-b16638bd3fab tempest-AttachVolumeTestJSON-709357402 tempest-AttachVolumeTestJSON-709357402-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116064) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 14 13:02:36.471140 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.compute.api [None req-d60a776e-46c6-4f1d-8ce2-b16638bd3fab tempest-AttachVolumeTestJSON-709357402 tempest-AttachVolumeTestJSON-709357402-project] [instance: 1b8e1f2f-c109-4413-9d56-33ef0b651f85] Fetching instance by UUID {{(pid=116064) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 13:02:36.480080 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-d60a776e-46c6-4f1d-8ce2-b16638bd3fab tempest-AttachVolumeTestJSON-709357402 tempest-AttachVolumeTestJSON-709357402-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 13:02:36.480525 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-d60a776e-46c6-4f1d-8ce2-b16638bd3fab tempest-AttachVolumeTestJSON-709357402 tempest-AttachVolumeTestJSON-709357402-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 13:02:36.481338 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-d60a776e-46c6-4f1d-8ce2-b16638bd3fab tempest-AttachVolumeTestJSON-709357402 tempest-AttachVolumeTestJSON-709357402-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 13:02:36.481768 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-d60a776e-46c6-4f1d-8ce2-b16638bd3fab tempest-AttachVolumeTestJSON-709357402 tempest-AttachVolumeTestJSON-709357402-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 13:02:36.570036 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: INFO nova.api.openstack.requestlog [None req-d60a776e-46c6-4f1d-8ce2-b16638bd3fab tempest-AttachVolumeTestJSON-709357402 tempest-AttachVolumeTestJSON-709357402-project] 10.222.0.49 "POST /compute/v2.1/servers/1b8e1f2f-c109-4413-9d56-33ef0b651f85/action" status: 200 len: 14 microversion: 2.1 time: 0.107526 Dec 14 13:02:36.571356 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: [pid: 116064|app: 0|req: 347/720] 10.222.0.49 () {60 vars in 1277 bytes} [Tue Dec 14 13:02:36 2021] POST /compute/v2.1/servers/1b8e1f2f-c109-4413-9d56-33ef0b651f85/action => generated 14 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Dec 14 13:02:37.130034 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.api.openstack.wsgi [None req-6f0c09b2-77e8-4072-b865-8187862480e7 tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] Action: 'create', calling method: .version_select at 0x7f2acdabfee0>, body: {"keypair": {"name": "tempest-keypair-395647254"}} {{(pid=116063) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 14 13:02:37.144965 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.quota [None req-6f0c09b2-77e8-4072-b865-8187862480e7 tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] Getting quotas for project 68a8770b8dbe489a8119016fbee64eb5. Resources: {'key_pairs'} {{(pid=116063) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 14 13:02:37.149092 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.quota [None req-6f0c09b2-77e8-4072-b865-8187862480e7 tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] Getting quotas for user 79d74a2ea1e541d28d085c15cec34032 and project 68a8770b8dbe489a8119016fbee64eb5. Resources: {'key_pairs'} {{(pid=116063) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 14 13:02:37.403192 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.quota [None req-6f0c09b2-77e8-4072-b865-8187862480e7 tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] Getting quotas for project 68a8770b8dbe489a8119016fbee64eb5. Resources: {'key_pairs'} {{(pid=116063) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 14 13:02:37.406755 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.quota [None req-6f0c09b2-77e8-4072-b865-8187862480e7 tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] Getting quotas for user 79d74a2ea1e541d28d085c15cec34032 and project 68a8770b8dbe489a8119016fbee64eb5. Resources: {'key_pairs'} {{(pid=116063) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 14 13:02:37.419839 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: INFO nova.api.openstack.requestlog [None req-6f0c09b2-77e8-4072-b865-8187862480e7 tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] 10.222.0.49 "POST /compute/v2.1/os-keypairs" status: 201 len: 2319 microversion: 2.20 time: 0.293755 Dec 14 13:02:37.420412 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: [pid: 116063|app: 0|req: 374/721] 10.222.0.49 () {62 vars in 1198 bytes} [Tue Dec 14 13:02:37 2021] POST /compute/v2.1/os-keypairs => generated 2319 bytes in 295 msecs (HTTP/1.1 201) 9 headers in 365 bytes (1 switches on core 0) Dec 14 13:02:37.582478 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.api.openstack.wsgi [None req-1c60e179-058c-41e7-9fd8-5e68ae24a7a2 tempest-AttachVolumeTestJSON-709357402 tempest-AttachVolumeTestJSON-709357402-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116064) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 14 13:02:37.584465 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.compute.api [None req-1c60e179-058c-41e7-9fd8-5e68ae24a7a2 tempest-AttachVolumeTestJSON-709357402 tempest-AttachVolumeTestJSON-709357402-project] [instance: 1b8e1f2f-c109-4413-9d56-33ef0b651f85] Fetching instance by UUID {{(pid=116064) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 13:02:37.593912 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-1c60e179-058c-41e7-9fd8-5e68ae24a7a2 tempest-AttachVolumeTestJSON-709357402 tempest-AttachVolumeTestJSON-709357402-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 13:02:37.594476 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-1c60e179-058c-41e7-9fd8-5e68ae24a7a2 tempest-AttachVolumeTestJSON-709357402 tempest-AttachVolumeTestJSON-709357402-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 13:02:37.595349 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-1c60e179-058c-41e7-9fd8-5e68ae24a7a2 tempest-AttachVolumeTestJSON-709357402 tempest-AttachVolumeTestJSON-709357402-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 13:02:37.595856 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-1c60e179-058c-41e7-9fd8-5e68ae24a7a2 tempest-AttachVolumeTestJSON-709357402 tempest-AttachVolumeTestJSON-709357402-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 13:02:37.655135 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: INFO nova.api.openstack.requestlog [None req-1c60e179-058c-41e7-9fd8-5e68ae24a7a2 tempest-AttachVolumeTestJSON-709357402 tempest-AttachVolumeTestJSON-709357402-project] 10.222.0.49 "POST /compute/v2.1/servers/1b8e1f2f-c109-4413-9d56-33ef0b651f85/action" status: 200 len: 14 microversion: 2.1 time: 0.076845 Dec 14 13:02:37.656159 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: [pid: 116064|app: 0|req: 348/722] 10.222.0.49 () {60 vars in 1277 bytes} [Tue Dec 14 13:02:37 2021] POST /compute/v2.1/servers/1b8e1f2f-c109-4413-9d56-33ef0b651f85/action => generated 14 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Dec 14 13:02:38.667022 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.api.openstack.wsgi [None req-b90a9462-0583-409f-81c1-e0b7539ce6cc tempest-AttachVolumeTestJSON-709357402 tempest-AttachVolumeTestJSON-709357402-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116063) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 14 13:02:38.668255 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.compute.api [None req-b90a9462-0583-409f-81c1-e0b7539ce6cc tempest-AttachVolumeTestJSON-709357402 tempest-AttachVolumeTestJSON-709357402-project] [instance: 1b8e1f2f-c109-4413-9d56-33ef0b651f85] Fetching instance by UUID {{(pid=116063) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 13:02:38.674744 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-b90a9462-0583-409f-81c1-e0b7539ce6cc tempest-AttachVolumeTestJSON-709357402 tempest-AttachVolumeTestJSON-709357402-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 13:02:38.675201 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-b90a9462-0583-409f-81c1-e0b7539ce6cc tempest-AttachVolumeTestJSON-709357402 tempest-AttachVolumeTestJSON-709357402-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 13:02:38.675978 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-b90a9462-0583-409f-81c1-e0b7539ce6cc tempest-AttachVolumeTestJSON-709357402 tempest-AttachVolumeTestJSON-709357402-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 13:02:38.676416 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-b90a9462-0583-409f-81c1-e0b7539ce6cc tempest-AttachVolumeTestJSON-709357402 tempest-AttachVolumeTestJSON-709357402-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 13:02:38.708797 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.api.openstack.wsgi [None req-939636b2-edcd-4125-9456-e72656ebc01f tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-642753281", "imageRef": "1733dcd4-5ded-44e1-8b8d-392adb05c67a", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "685eb097-be44-442e-9106-664041f3bdb2"}], "security_groups": [{"name": "tempest-securitygroup--602254397"}], "key_name": "tempest-keypair-395647254", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=116064) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 14 13:02:38.808665 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.network.neutron [None req-939636b2-edcd-4125-9456-e72656ebc01f tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] validate_networks() for [('685eb097-be44-442e-9106-664041f3bdb2', None, None, None, None, None)] {{(pid=116064) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Dec 14 13:02:39.180379 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.virt.hardware [None req-939636b2-edcd-4125-9456-e72656ebc01f tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] Flavor limits 0:0:0 {{(pid=116064) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Dec 14 13:02:39.181018 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.virt.hardware [None req-939636b2-edcd-4125-9456-e72656ebc01f tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] Image limits 0:0:0 {{(pid=116064) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Dec 14 13:02:39.181728 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.virt.hardware [None req-939636b2-edcd-4125-9456-e72656ebc01f tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] Flavor pref 0:0:0 {{(pid=116064) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Dec 14 13:02:39.182278 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.virt.hardware [None req-939636b2-edcd-4125-9456-e72656ebc01f tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] Image pref 0:0:0 {{(pid=116064) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Dec 14 13:02:39.182858 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.virt.hardware [None req-939636b2-edcd-4125-9456-e72656ebc01f tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=116064) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Dec 14 13:02:39.195021 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-939636b2-edcd-4125-9456-e72656ebc01f tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 13:02:39.195471 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-939636b2-edcd-4125-9456-e72656ebc01f tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 13:02:39.196284 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-939636b2-edcd-4125-9456-e72656ebc01f tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 13:02:39.196716 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-939636b2-edcd-4125-9456-e72656ebc01f tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 13:02:39.213284 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.quota [None req-939636b2-edcd-4125-9456-e72656ebc01f tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] Getting quotas for project 68a8770b8dbe489a8119016fbee64eb5. Resources: {'cores', 'instances', 'ram'} {{(pid=116064) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 14 13:02:39.217110 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.quota [None req-939636b2-edcd-4125-9456-e72656ebc01f tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] Getting quotas for user 79d74a2ea1e541d28d085c15cec34032 and project 68a8770b8dbe489a8119016fbee64eb5. Resources: {'cores', 'instances', 'ram'} {{(pid=116064) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 14 13:02:39.228444 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.compute.api [None req-939636b2-edcd-4125-9456-e72656ebc01f tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] Going to run 1 instances... {{(pid=116064) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Dec 14 13:02:39.230877 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.compute.api [None req-939636b2-edcd-4125-9456-e72656ebc01f tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] [instance: 9b3b44a7-7c20-473c-841c-318e471fc6cd] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='1733dcd4-5ded-44e1-8b8d-392adb05c67a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=116064) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Dec 14 13:02:39.280049 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: INFO nova.api.openstack.requestlog [None req-939636b2-edcd-4125-9456-e72656ebc01f tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] 10.222.0.49 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.20 time: 0.575725 Dec 14 13:02:39.280961 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: [pid: 116064|app: 0|req: 349/723] 10.222.0.49 () {62 vars in 1187 bytes} [Tue Dec 14 13:02:38 2021] POST /compute/v2.1/servers => generated 401 bytes in 577 msecs (HTTP/1.1 202) 10 headers in 453 bytes (2 switches on core 0) Dec 14 13:02:39.291321 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.api.openstack.wsgi [None req-eaa1fe86-fab9-4b65-8e0b-f47daef75a3c tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] Calling method '>' {{(pid=116064) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 13:02:39.291920 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.compute.api [None req-eaa1fe86-fab9-4b65-8e0b-f47daef75a3c tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] [instance: 9b3b44a7-7c20-473c-841c-318e471fc6cd] Fetching instance by UUID {{(pid=116064) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 13:02:39.343397 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.policy [None req-eaa1fe86-fab9-4b65-8e0b-f47daef75a3c tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79d74a2ea1e541d28d085c15cec34032', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68a8770b8dbe489a8119016fbee64eb5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116064) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 13:02:39.350951 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.policy [None req-eaa1fe86-fab9-4b65-8e0b-f47daef75a3c tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '79d74a2ea1e541d28d085c15cec34032', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68a8770b8dbe489a8119016fbee64eb5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116064) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 13:02:39.352450 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.policy [None req-eaa1fe86-fab9-4b65-8e0b-f47daef75a3c tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '79d74a2ea1e541d28d085c15cec34032', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68a8770b8dbe489a8119016fbee64eb5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116064) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 13:02:39.353546 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: INFO nova.api.openstack.requestlog [None req-eaa1fe86-fab9-4b65-8e0b-f47daef75a3c tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] 10.222.0.49 "GET /compute/v2.1/servers/9b3b44a7-7c20-473c-841c-318e471fc6cd" status: 200 len: 1280 microversion: 2.20 time: 0.066289 Dec 14 13:02:39.354388 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: [pid: 116064|app: 0|req: 350/724] 10.222.0.49 () {60 vars in 1276 bytes} [Tue Dec 14 13:02:39 2021] GET /compute/v2.1/servers/9b3b44a7-7c20-473c-841c-318e471fc6cd => generated 1280 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Dec 14 13:02:40.375397 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.api.openstack.wsgi [None req-269f59d2-af26-4163-b74a-fa543582512d tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] Calling method '>' {{(pid=116064) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 13:02:40.376418 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.compute.api [None req-269f59d2-af26-4163-b74a-fa543582512d tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] [instance: 9b3b44a7-7c20-473c-841c-318e471fc6cd] Fetching instance by UUID {{(pid=116064) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 13:02:40.385228 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-269f59d2-af26-4163-b74a-fa543582512d tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 13:02:40.385674 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-269f59d2-af26-4163-b74a-fa543582512d tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 13:02:40.386446 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-269f59d2-af26-4163-b74a-fa543582512d tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 13:02:40.386874 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-269f59d2-af26-4163-b74a-fa543582512d tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 13:02:40.447041 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.policy [None req-269f59d2-af26-4163-b74a-fa543582512d tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79d74a2ea1e541d28d085c15cec34032', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68a8770b8dbe489a8119016fbee64eb5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116064) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 13:02:40.455078 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.policy [None req-269f59d2-af26-4163-b74a-fa543582512d tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '79d74a2ea1e541d28d085c15cec34032', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68a8770b8dbe489a8119016fbee64eb5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116064) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 13:02:40.456560 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.policy [None req-269f59d2-af26-4163-b74a-fa543582512d tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '79d74a2ea1e541d28d085c15cec34032', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68a8770b8dbe489a8119016fbee64eb5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116064) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 13:02:40.457660 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: INFO nova.api.openstack.requestlog [None req-269f59d2-af26-4163-b74a-fa543582512d tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] 10.222.0.49 "GET /compute/v2.1/servers/9b3b44a7-7c20-473c-841c-318e471fc6cd" status: 200 len: 1284 microversion: 2.20 time: 0.088565 Dec 14 13:02:40.458235 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: [pid: 116064|app: 0|req: 351/725] 10.222.0.49 () {60 vars in 1276 bytes} [Tue Dec 14 13:02:40 2021] GET /compute/v2.1/servers/9b3b44a7-7c20-473c-841c-318e471fc6cd => generated 1284 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 14 13:02:41.368637 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: INFO nova.api.openstack.requestlog [None req-b90a9462-0583-409f-81c1-e0b7539ce6cc tempest-AttachVolumeTestJSON-709357402 tempest-AttachVolumeTestJSON-709357402-project] 10.222.0.49 "POST /compute/v2.1/servers/1b8e1f2f-c109-4413-9d56-33ef0b651f85/action" status: 200 len: 14 microversion: 2.1 time: 2.705392 Dec 14 13:02:41.370662 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: [pid: 116063|app: 0|req: 375/726] 10.222.0.49 () {60 vars in 1277 bytes} [Tue Dec 14 13:02:38 2021] POST /compute/v2.1/servers/1b8e1f2f-c109-4413-9d56-33ef0b651f85/action => generated 14 bytes in 2709 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Dec 14 13:02:41.475675 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.api.openstack.wsgi [None req-d9eb8845-bc6e-4684-83ae-4a9b87bb66d3 tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] Calling method '>' {{(pid=116064) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 13:02:41.476312 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.compute.api [None req-d9eb8845-bc6e-4684-83ae-4a9b87bb66d3 tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] [instance: 9b3b44a7-7c20-473c-841c-318e471fc6cd] Fetching instance by UUID {{(pid=116064) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 13:02:41.482837 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-d9eb8845-bc6e-4684-83ae-4a9b87bb66d3 tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 13:02:41.483293 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-d9eb8845-bc6e-4684-83ae-4a9b87bb66d3 tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 13:02:41.484084 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-d9eb8845-bc6e-4684-83ae-4a9b87bb66d3 tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 13:02:41.484524 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-d9eb8845-bc6e-4684-83ae-4a9b87bb66d3 tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 13:02:41.558514 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.policy [None req-d9eb8845-bc6e-4684-83ae-4a9b87bb66d3 tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79d74a2ea1e541d28d085c15cec34032', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68a8770b8dbe489a8119016fbee64eb5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116064) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 13:02:41.568234 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.policy [None req-d9eb8845-bc6e-4684-83ae-4a9b87bb66d3 tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '79d74a2ea1e541d28d085c15cec34032', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68a8770b8dbe489a8119016fbee64eb5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116064) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 13:02:41.569967 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.policy [None req-d9eb8845-bc6e-4684-83ae-4a9b87bb66d3 tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '79d74a2ea1e541d28d085c15cec34032', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68a8770b8dbe489a8119016fbee64eb5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116064) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 13:02:41.571107 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: INFO nova.api.openstack.requestlog [None req-d9eb8845-bc6e-4684-83ae-4a9b87bb66d3 tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] 10.222.0.49 "GET /compute/v2.1/servers/9b3b44a7-7c20-473c-841c-318e471fc6cd" status: 200 len: 1276 microversion: 2.20 time: 0.099347 Dec 14 13:02:41.581710 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: [pid: 116064|app: 0|req: 352/727] 10.222.0.49 () {60 vars in 1276 bytes} [Tue Dec 14 13:02:41 2021] GET /compute/v2.1/servers/9b3b44a7-7c20-473c-841c-318e471fc6cd => generated 1276 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 14 13:02:42.382825 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.api.openstack.wsgi [None req-f8dbffd5-beaf-4e69-b221-c738fc2dd8d0 tempest-AttachVolumeTestJSON-709357402 tempest-AttachVolumeTestJSON-709357402-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116063) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 14 13:02:42.383857 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.compute.api [None req-f8dbffd5-beaf-4e69-b221-c738fc2dd8d0 tempest-AttachVolumeTestJSON-709357402 tempest-AttachVolumeTestJSON-709357402-project] [instance: 1b8e1f2f-c109-4413-9d56-33ef0b651f85] Fetching instance by UUID {{(pid=116063) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 13:02:42.390890 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-f8dbffd5-beaf-4e69-b221-c738fc2dd8d0 tempest-AttachVolumeTestJSON-709357402 tempest-AttachVolumeTestJSON-709357402-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 13:02:42.391322 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-f8dbffd5-beaf-4e69-b221-c738fc2dd8d0 tempest-AttachVolumeTestJSON-709357402 tempest-AttachVolumeTestJSON-709357402-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 13:02:42.392086 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-f8dbffd5-beaf-4e69-b221-c738fc2dd8d0 tempest-AttachVolumeTestJSON-709357402 tempest-AttachVolumeTestJSON-709357402-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 13:02:42.392507 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-f8dbffd5-beaf-4e69-b221-c738fc2dd8d0 tempest-AttachVolumeTestJSON-709357402 tempest-AttachVolumeTestJSON-709357402-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 13:02:42.452614 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: INFO nova.api.openstack.requestlog [None req-f8dbffd5-beaf-4e69-b221-c738fc2dd8d0 tempest-AttachVolumeTestJSON-709357402 tempest-AttachVolumeTestJSON-709357402-project] 10.222.0.49 "POST /compute/v2.1/servers/1b8e1f2f-c109-4413-9d56-33ef0b651f85/action" status: 200 len: 14 microversion: 2.1 time: 0.073850 Dec 14 13:02:42.455987 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: [pid: 116063|app: 0|req: 376/728] 10.222.0.49 () {60 vars in 1277 bytes} [Tue Dec 14 13:02:42 2021] POST /compute/v2.1/servers/1b8e1f2f-c109-4413-9d56-33ef0b651f85/action => generated 14 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Dec 14 13:02:42.589353 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.api.openstack.wsgi [None req-41cd4399-e3e7-40a6-b817-9fbf0b42c361 tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] Calling method '>' {{(pid=116064) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 13:02:42.589985 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.compute.api [None req-41cd4399-e3e7-40a6-b817-9fbf0b42c361 tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] [instance: 9b3b44a7-7c20-473c-841c-318e471fc6cd] Fetching instance by UUID {{(pid=116064) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 13:02:42.597707 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-41cd4399-e3e7-40a6-b817-9fbf0b42c361 tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 13:02:42.597707 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-41cd4399-e3e7-40a6-b817-9fbf0b42c361 tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 13:02:42.598128 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-41cd4399-e3e7-40a6-b817-9fbf0b42c361 tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 13:02:42.598556 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-41cd4399-e3e7-40a6-b817-9fbf0b42c361 tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 13:02:42.743801 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.policy [None req-41cd4399-e3e7-40a6-b817-9fbf0b42c361 tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79d74a2ea1e541d28d085c15cec34032', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68a8770b8dbe489a8119016fbee64eb5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116064) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 13:02:42.752236 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.policy [None req-41cd4399-e3e7-40a6-b817-9fbf0b42c361 tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '79d74a2ea1e541d28d085c15cec34032', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68a8770b8dbe489a8119016fbee64eb5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116064) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 13:02:42.754004 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.policy [None req-41cd4399-e3e7-40a6-b817-9fbf0b42c361 tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '79d74a2ea1e541d28d085c15cec34032', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68a8770b8dbe489a8119016fbee64eb5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116064) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 13:02:42.755905 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: INFO nova.api.openstack.requestlog [None req-41cd4399-e3e7-40a6-b817-9fbf0b42c361 tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] 10.222.0.49 "GET /compute/v2.1/servers/9b3b44a7-7c20-473c-841c-318e471fc6cd" status: 200 len: 1405 microversion: 2.20 time: 0.170283 Dec 14 13:02:42.756727 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: [pid: 116064|app: 0|req: 353/729] 10.222.0.49 () {60 vars in 1276 bytes} [Tue Dec 14 13:02:42 2021] GET /compute/v2.1/servers/9b3b44a7-7c20-473c-841c-318e471fc6cd => generated 1405 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 14 13:02:43.309361 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.api.openstack.wsgi [req-36bd9c30-6e9f-4d11-a257-128754552832 req-10b6da6d-fbf1-4820-8f3b-db584b008a8f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9b3b44a7-7c20-473c-841c-318e471fc6cd", "tag": "0ed44ee3-2630-4f50-9391-4bb374b76e1d"}]} {{(pid=116063) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 14 13:02:43.311210 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 14 13:02:43.311210 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: warnings.warn(msg) Dec 14 13:02:43.319386 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [req-36bd9c30-6e9f-4d11-a257-128754552832 req-10b6da6d-fbf1-4820-8f3b-db584b008a8f service nova] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 13:02:43.319912 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [req-36bd9c30-6e9f-4d11-a257-128754552832 req-10b6da6d-fbf1-4820-8f3b-db584b008a8f service nova] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 13:02:43.331799 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: INFO nova.api.openstack.compute.server_external_events [req-36bd9c30-6e9f-4d11-a257-128754552832 req-10b6da6d-fbf1-4820-8f3b-db584b008a8f service nova] Creating event network-changed:0ed44ee3-2630-4f50-9391-4bb374b76e1d for instance 9b3b44a7-7c20-473c-841c-318e471fc6cd on hv-cinder-78447 Dec 14 13:02:43.344605 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: INFO nova.api.openstack.requestlog [req-36bd9c30-6e9f-4d11-a257-128754552832 req-10b6da6d-fbf1-4820-8f3b-db584b008a8f service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039068 Dec 14 13:02:43.345141 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: [pid: 116063|app: 0|req: 377/730] 10.222.0.49 () {64 vars in 1317 bytes} [Tue Dec 14 13:02:43 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 14 13:02:43.464013 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.api.openstack.wsgi [None req-0ae576e7-071d-45d7-9a63-413c8dab7788 tempest-AttachVolumeTestJSON-709357402 tempest-AttachVolumeTestJSON-709357402-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116064) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 14 13:02:43.465635 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.compute.api [None req-0ae576e7-071d-45d7-9a63-413c8dab7788 tempest-AttachVolumeTestJSON-709357402 tempest-AttachVolumeTestJSON-709357402-project] [instance: 1b8e1f2f-c109-4413-9d56-33ef0b651f85] Fetching instance by UUID {{(pid=116064) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 13:02:43.473207 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-0ae576e7-071d-45d7-9a63-413c8dab7788 tempest-AttachVolumeTestJSON-709357402 tempest-AttachVolumeTestJSON-709357402-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 13:02:43.473823 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-0ae576e7-071d-45d7-9a63-413c8dab7788 tempest-AttachVolumeTestJSON-709357402 tempest-AttachVolumeTestJSON-709357402-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 13:02:43.474808 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-0ae576e7-071d-45d7-9a63-413c8dab7788 tempest-AttachVolumeTestJSON-709357402 tempest-AttachVolumeTestJSON-709357402-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 13:02:43.475262 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-0ae576e7-071d-45d7-9a63-413c8dab7788 tempest-AttachVolumeTestJSON-709357402 tempest-AttachVolumeTestJSON-709357402-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 13:02:43.545858 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: INFO nova.api.openstack.requestlog [None req-0ae576e7-071d-45d7-9a63-413c8dab7788 tempest-AttachVolumeTestJSON-709357402 tempest-AttachVolumeTestJSON-709357402-project] 10.222.0.49 "POST /compute/v2.1/servers/1b8e1f2f-c109-4413-9d56-33ef0b651f85/action" status: 200 len: 10159 microversion: 2.1 time: 0.085643 Dec 14 13:02:43.546712 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: [pid: 116064|app: 0|req: 354/731] 10.222.0.49 () {60 vars in 1277 bytes} [Tue Dec 14 13:02:43 2021] POST /compute/v2.1/servers/1b8e1f2f-c109-4413-9d56-33ef0b651f85/action => generated 10159 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 14 13:02:43.777172 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.api.openstack.wsgi [None req-c65f99ba-ec8b-4e28-9a10-6338b45dcfb1 tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] Calling method '>' {{(pid=116063) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 13:02:43.777963 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.compute.api [None req-c65f99ba-ec8b-4e28-9a10-6338b45dcfb1 tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] [instance: 9b3b44a7-7c20-473c-841c-318e471fc6cd] Fetching instance by UUID {{(pid=116063) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 13:02:43.784285 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-c65f99ba-ec8b-4e28-9a10-6338b45dcfb1 tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 13:02:43.784752 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-c65f99ba-ec8b-4e28-9a10-6338b45dcfb1 tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 13:02:43.785592 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-c65f99ba-ec8b-4e28-9a10-6338b45dcfb1 tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 13:02:43.786026 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-c65f99ba-ec8b-4e28-9a10-6338b45dcfb1 tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 13:02:43.915969 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.policy [None req-c65f99ba-ec8b-4e28-9a10-6338b45dcfb1 tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79d74a2ea1e541d28d085c15cec34032', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68a8770b8dbe489a8119016fbee64eb5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116063) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 13:02:43.924688 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.policy [None req-c65f99ba-ec8b-4e28-9a10-6338b45dcfb1 tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '79d74a2ea1e541d28d085c15cec34032', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68a8770b8dbe489a8119016fbee64eb5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116063) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 13:02:43.926213 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.policy [None req-c65f99ba-ec8b-4e28-9a10-6338b45dcfb1 tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '79d74a2ea1e541d28d085c15cec34032', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68a8770b8dbe489a8119016fbee64eb5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116063) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 13:02:43.927377 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: INFO nova.api.openstack.requestlog [None req-c65f99ba-ec8b-4e28-9a10-6338b45dcfb1 tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] 10.222.0.49 "GET /compute/v2.1/servers/9b3b44a7-7c20-473c-841c-318e471fc6cd" status: 200 len: 1405 microversion: 2.20 time: 0.155955 Dec 14 13:02:43.927984 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: [pid: 116063|app: 0|req: 378/732] 10.222.0.49 () {60 vars in 1276 bytes} [Tue Dec 14 13:02:43 2021] GET /compute/v2.1/servers/9b3b44a7-7c20-473c-841c-318e471fc6cd => generated 1405 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 14 13:02:44.557774 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.api.openstack.wsgi [None req-05724431-fbb2-4d39-a15b-f9260810e128 tempest-AttachVolumeTestJSON-709357402 tempest-AttachVolumeTestJSON-709357402-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116064) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 14 13:02:44.558768 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.compute.api [None req-05724431-fbb2-4d39-a15b-f9260810e128 tempest-AttachVolumeTestJSON-709357402 tempest-AttachVolumeTestJSON-709357402-project] [instance: 1b8e1f2f-c109-4413-9d56-33ef0b651f85] Fetching instance by UUID {{(pid=116064) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 13:02:44.565960 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-05724431-fbb2-4d39-a15b-f9260810e128 tempest-AttachVolumeTestJSON-709357402 tempest-AttachVolumeTestJSON-709357402-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 13:02:44.566404 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-05724431-fbb2-4d39-a15b-f9260810e128 tempest-AttachVolumeTestJSON-709357402 tempest-AttachVolumeTestJSON-709357402-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 13:02:44.567210 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-05724431-fbb2-4d39-a15b-f9260810e128 tempest-AttachVolumeTestJSON-709357402 tempest-AttachVolumeTestJSON-709357402-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 13:02:44.567639 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-05724431-fbb2-4d39-a15b-f9260810e128 tempest-AttachVolumeTestJSON-709357402 tempest-AttachVolumeTestJSON-709357402-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 13:02:44.640650 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: INFO nova.api.openstack.requestlog [None req-05724431-fbb2-4d39-a15b-f9260810e128 tempest-AttachVolumeTestJSON-709357402 tempest-AttachVolumeTestJSON-709357402-project] 10.222.0.49 "POST /compute/v2.1/servers/1b8e1f2f-c109-4413-9d56-33ef0b651f85/action" status: 200 len: 16447 microversion: 2.1 time: 0.086787 Dec 14 13:02:44.641452 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: [pid: 116064|app: 0|req: 355/733] 10.222.0.49 () {60 vars in 1277 bytes} [Tue Dec 14 13:02:44 2021] POST /compute/v2.1/servers/1b8e1f2f-c109-4413-9d56-33ef0b651f85/action => generated 16447 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 14 13:02:44.945712 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.api.openstack.wsgi [None req-dc27684f-9346-434a-954b-6fb429041fba tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] Calling method '>' {{(pid=116063) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 13:02:44.946558 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.compute.api [None req-dc27684f-9346-434a-954b-6fb429041fba tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] [instance: 9b3b44a7-7c20-473c-841c-318e471fc6cd] Fetching instance by UUID {{(pid=116063) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 13:02:44.953220 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-dc27684f-9346-434a-954b-6fb429041fba tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 13:02:44.953675 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-dc27684f-9346-434a-954b-6fb429041fba tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 13:02:44.954464 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-dc27684f-9346-434a-954b-6fb429041fba tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 13:02:44.955084 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-dc27684f-9346-434a-954b-6fb429041fba tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 13:02:45.090371 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.policy [None req-dc27684f-9346-434a-954b-6fb429041fba tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79d74a2ea1e541d28d085c15cec34032', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68a8770b8dbe489a8119016fbee64eb5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116063) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 13:02:45.098370 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.policy [None req-dc27684f-9346-434a-954b-6fb429041fba tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '79d74a2ea1e541d28d085c15cec34032', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68a8770b8dbe489a8119016fbee64eb5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116063) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 13:02:45.099928 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.policy [None req-dc27684f-9346-434a-954b-6fb429041fba tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '79d74a2ea1e541d28d085c15cec34032', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68a8770b8dbe489a8119016fbee64eb5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116063) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 13:02:45.101086 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: INFO nova.api.openstack.requestlog [None req-dc27684f-9346-434a-954b-6fb429041fba tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] 10.222.0.49 "GET /compute/v2.1/servers/9b3b44a7-7c20-473c-841c-318e471fc6cd" status: 200 len: 1405 microversion: 2.20 time: 0.159216 Dec 14 13:02:45.101631 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: [pid: 116063|app: 0|req: 379/734] 10.222.0.49 () {60 vars in 1276 bytes} [Tue Dec 14 13:02:44 2021] GET /compute/v2.1/servers/9b3b44a7-7c20-473c-841c-318e471fc6cd => generated 1405 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 14 13:02:45.655057 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.api.openstack.wsgi [None req-bc104e43-e2c4-4aae-b061-61ddea0ca572 tempest-AttachVolumeTestJSON-709357402 tempest-AttachVolumeTestJSON-709357402-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116064) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 14 13:02:45.656940 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.compute.api [None req-bc104e43-e2c4-4aae-b061-61ddea0ca572 tempest-AttachVolumeTestJSON-709357402 tempest-AttachVolumeTestJSON-709357402-project] [instance: 1b8e1f2f-c109-4413-9d56-33ef0b651f85] Fetching instance by UUID {{(pid=116064) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 13:02:45.664882 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-bc104e43-e2c4-4aae-b061-61ddea0ca572 tempest-AttachVolumeTestJSON-709357402 tempest-AttachVolumeTestJSON-709357402-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 13:02:45.665191 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-bc104e43-e2c4-4aae-b061-61ddea0ca572 tempest-AttachVolumeTestJSON-709357402 tempest-AttachVolumeTestJSON-709357402-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 13:02:45.665972 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-bc104e43-e2c4-4aae-b061-61ddea0ca572 tempest-AttachVolumeTestJSON-709357402 tempest-AttachVolumeTestJSON-709357402-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 13:02:45.666611 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-bc104e43-e2c4-4aae-b061-61ddea0ca572 tempest-AttachVolumeTestJSON-709357402 tempest-AttachVolumeTestJSON-709357402-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 13:02:45.738153 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: INFO nova.api.openstack.requestlog [None req-bc104e43-e2c4-4aae-b061-61ddea0ca572 tempest-AttachVolumeTestJSON-709357402 tempest-AttachVolumeTestJSON-709357402-project] 10.222.0.49 "POST /compute/v2.1/servers/1b8e1f2f-c109-4413-9d56-33ef0b651f85/action" status: 200 len: 18608 microversion: 2.1 time: 0.088764 Dec 14 13:02:45.738778 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: [pid: 116064|app: 0|req: 356/735] 10.222.0.49 () {60 vars in 1277 bytes} [Tue Dec 14 13:02:45 2021] POST /compute/v2.1/servers/1b8e1f2f-c109-4413-9d56-33ef0b651f85/action => generated 18608 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 14 13:02:46.118703 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.api.openstack.wsgi [None req-57c43251-4da3-43e3-a7b0-caec40f896a6 tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] Calling method '>' {{(pid=116063) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 13:02:46.119401 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.compute.api [None req-57c43251-4da3-43e3-a7b0-caec40f896a6 tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] [instance: 9b3b44a7-7c20-473c-841c-318e471fc6cd] Fetching instance by UUID {{(pid=116063) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 13:02:46.126093 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-57c43251-4da3-43e3-a7b0-caec40f896a6 tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 13:02:46.126548 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-57c43251-4da3-43e3-a7b0-caec40f896a6 tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 13:02:46.127357 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-57c43251-4da3-43e3-a7b0-caec40f896a6 tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 13:02:46.127809 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-57c43251-4da3-43e3-a7b0-caec40f896a6 tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 13:02:46.296708 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.policy [None req-57c43251-4da3-43e3-a7b0-caec40f896a6 tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79d74a2ea1e541d28d085c15cec34032', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68a8770b8dbe489a8119016fbee64eb5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116063) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 13:02:46.305108 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.policy [None req-57c43251-4da3-43e3-a7b0-caec40f896a6 tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '79d74a2ea1e541d28d085c15cec34032', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68a8770b8dbe489a8119016fbee64eb5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116063) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 13:02:46.306602 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.policy [None req-57c43251-4da3-43e3-a7b0-caec40f896a6 tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '79d74a2ea1e541d28d085c15cec34032', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68a8770b8dbe489a8119016fbee64eb5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116063) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 13:02:46.307698 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: INFO nova.api.openstack.requestlog [None req-57c43251-4da3-43e3-a7b0-caec40f896a6 tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] 10.222.0.49 "GET /compute/v2.1/servers/9b3b44a7-7c20-473c-841c-318e471fc6cd" status: 200 len: 1405 microversion: 2.20 time: 0.192772 Dec 14 13:02:46.308257 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: [pid: 116063|app: 0|req: 380/736] 10.222.0.49 () {60 vars in 1276 bytes} [Tue Dec 14 13:02:46 2021] GET /compute/v2.1/servers/9b3b44a7-7c20-473c-841c-318e471fc6cd => generated 1405 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 14 13:02:46.750619 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.api.openstack.wsgi [None req-31a476e3-6e44-46c3-9290-a8226e84bff7 tempest-AttachVolumeTestJSON-709357402 tempest-AttachVolumeTestJSON-709357402-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116064) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 14 13:02:46.751784 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.compute.api [None req-31a476e3-6e44-46c3-9290-a8226e84bff7 tempest-AttachVolumeTestJSON-709357402 tempest-AttachVolumeTestJSON-709357402-project] [instance: 1b8e1f2f-c109-4413-9d56-33ef0b651f85] Fetching instance by UUID {{(pid=116064) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 13:02:46.759924 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-31a476e3-6e44-46c3-9290-a8226e84bff7 tempest-AttachVolumeTestJSON-709357402 tempest-AttachVolumeTestJSON-709357402-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 13:02:46.760452 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-31a476e3-6e44-46c3-9290-a8226e84bff7 tempest-AttachVolumeTestJSON-709357402 tempest-AttachVolumeTestJSON-709357402-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 13:02:46.761288 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-31a476e3-6e44-46c3-9290-a8226e84bff7 tempest-AttachVolumeTestJSON-709357402 tempest-AttachVolumeTestJSON-709357402-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 13:02:46.761713 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-31a476e3-6e44-46c3-9290-a8226e84bff7 tempest-AttachVolumeTestJSON-709357402 tempest-AttachVolumeTestJSON-709357402-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 13:02:46.837867 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: INFO nova.api.openstack.requestlog [None req-31a476e3-6e44-46c3-9290-a8226e84bff7 tempest-AttachVolumeTestJSON-709357402 tempest-AttachVolumeTestJSON-709357402-project] 10.222.0.49 "POST /compute/v2.1/servers/1b8e1f2f-c109-4413-9d56-33ef0b651f85/action" status: 200 len: 20997 microversion: 2.1 time: 0.091168 Dec 14 13:02:46.838549 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: [pid: 116064|app: 0|req: 357/737] 10.222.0.49 () {60 vars in 1277 bytes} [Tue Dec 14 13:02:46 2021] POST /compute/v2.1/servers/1b8e1f2f-c109-4413-9d56-33ef0b651f85/action => generated 20997 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 14 13:02:47.325870 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.api.openstack.wsgi [None req-df79988a-2fcc-4081-8afa-588620e3b85e tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] Calling method '>' {{(pid=116063) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 13:02:47.326415 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.compute.api [None req-df79988a-2fcc-4081-8afa-588620e3b85e tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] [instance: 9b3b44a7-7c20-473c-841c-318e471fc6cd] Fetching instance by UUID {{(pid=116063) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 13:02:47.332708 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-df79988a-2fcc-4081-8afa-588620e3b85e tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 13:02:47.333185 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-df79988a-2fcc-4081-8afa-588620e3b85e tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 13:02:47.333953 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-df79988a-2fcc-4081-8afa-588620e3b85e tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 13:02:47.334375 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-df79988a-2fcc-4081-8afa-588620e3b85e tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 13:02:47.482091 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.policy [None req-df79988a-2fcc-4081-8afa-588620e3b85e tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79d74a2ea1e541d28d085c15cec34032', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68a8770b8dbe489a8119016fbee64eb5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116063) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 13:02:47.491898 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.policy [None req-df79988a-2fcc-4081-8afa-588620e3b85e tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '79d74a2ea1e541d28d085c15cec34032', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68a8770b8dbe489a8119016fbee64eb5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116063) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 13:02:47.493601 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.policy [None req-df79988a-2fcc-4081-8afa-588620e3b85e tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '79d74a2ea1e541d28d085c15cec34032', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68a8770b8dbe489a8119016fbee64eb5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116063) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 13:02:47.494792 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: INFO nova.api.openstack.requestlog [None req-df79988a-2fcc-4081-8afa-588620e3b85e tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] 10.222.0.49 "GET /compute/v2.1/servers/9b3b44a7-7c20-473c-841c-318e471fc6cd" status: 200 len: 1405 microversion: 2.20 time: 0.172974 Dec 14 13:02:47.495484 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: [pid: 116063|app: 0|req: 381/738] 10.222.0.49 () {60 vars in 1276 bytes} [Tue Dec 14 13:02:47 2021] GET /compute/v2.1/servers/9b3b44a7-7c20-473c-841c-318e471fc6cd => generated 1405 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 14 13:02:47.595916 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.api.openstack.wsgi [req-fa77e572-afcc-439f-b5c9-ce12f8fe193d req-20d74a06-0743-404f-af6e-96cf8ce31cd5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9b3b44a7-7c20-473c-841c-318e471fc6cd", "name": "network-vif-plugged", "status": "completed", "tag": "0ed44ee3-2630-4f50-9391-4bb374b76e1d"}]} {{(pid=116064) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 14 13:02:47.597837 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 14 13:02:47.597837 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: warnings.warn(msg) Dec 14 13:02:47.606209 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [req-fa77e572-afcc-439f-b5c9-ce12f8fe193d req-20d74a06-0743-404f-af6e-96cf8ce31cd5 service nova] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 13:02:47.607165 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [req-fa77e572-afcc-439f-b5c9-ce12f8fe193d req-20d74a06-0743-404f-af6e-96cf8ce31cd5 service nova] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 13:02:47.619731 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: INFO nova.api.openstack.compute.server_external_events [req-fa77e572-afcc-439f-b5c9-ce12f8fe193d req-20d74a06-0743-404f-af6e-96cf8ce31cd5 service nova] Creating event network-vif-plugged:0ed44ee3-2630-4f50-9391-4bb374b76e1d for instance 9b3b44a7-7c20-473c-841c-318e471fc6cd on hv-cinder-78447 Dec 14 13:02:47.625716 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: INFO nova.api.openstack.requestlog [req-fa77e572-afcc-439f-b5c9-ce12f8fe193d req-20d74a06-0743-404f-af6e-96cf8ce31cd5 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033740 Dec 14 13:02:47.627166 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: [pid: 116064|app: 0|req: 358/739] 10.222.0.49 () {64 vars in 1317 bytes} [Tue Dec 14 13:02:47 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Dec 14 13:02:47.849607 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.api.openstack.wsgi [None req-265402f2-f893-4985-b472-c1dd97205be6 tempest-AttachVolumeTestJSON-709357402 tempest-AttachVolumeTestJSON-709357402-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116063) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 14 13:02:47.851082 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.compute.api [None req-265402f2-f893-4985-b472-c1dd97205be6 tempest-AttachVolumeTestJSON-709357402 tempest-AttachVolumeTestJSON-709357402-project] [instance: 1b8e1f2f-c109-4413-9d56-33ef0b651f85] Fetching instance by UUID {{(pid=116063) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 13:02:47.857613 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-265402f2-f893-4985-b472-c1dd97205be6 tempest-AttachVolumeTestJSON-709357402 tempest-AttachVolumeTestJSON-709357402-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 13:02:47.858335 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-265402f2-f893-4985-b472-c1dd97205be6 tempest-AttachVolumeTestJSON-709357402 tempest-AttachVolumeTestJSON-709357402-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 13:02:47.859135 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-265402f2-f893-4985-b472-c1dd97205be6 tempest-AttachVolumeTestJSON-709357402 tempest-AttachVolumeTestJSON-709357402-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 13:02:47.859814 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-265402f2-f893-4985-b472-c1dd97205be6 tempest-AttachVolumeTestJSON-709357402 tempest-AttachVolumeTestJSON-709357402-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 13:02:47.942064 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: INFO nova.api.openstack.requestlog [None req-265402f2-f893-4985-b472-c1dd97205be6 tempest-AttachVolumeTestJSON-709357402 tempest-AttachVolumeTestJSON-709357402-project] 10.222.0.49 "POST /compute/v2.1/servers/1b8e1f2f-c109-4413-9d56-33ef0b651f85/action" status: 200 len: 22897 microversion: 2.1 time: 0.096109 Dec 14 13:02:47.942982 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: [pid: 116063|app: 0|req: 382/740] 10.222.0.49 () {60 vars in 1277 bytes} [Tue Dec 14 13:02:47 2021] POST /compute/v2.1/servers/1b8e1f2f-c109-4413-9d56-33ef0b651f85/action => generated 22897 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 14 13:02:48.517089 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.api.openstack.wsgi [None req-9ddd1c86-53d8-460c-afff-c57791eb386e tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] Calling method '>' {{(pid=116064) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 13:02:48.517791 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.compute.api [None req-9ddd1c86-53d8-460c-afff-c57791eb386e tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] [instance: 9b3b44a7-7c20-473c-841c-318e471fc6cd] Fetching instance by UUID {{(pid=116064) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 13:02:48.525130 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-9ddd1c86-53d8-460c-afff-c57791eb386e tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 13:02:48.525579 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-9ddd1c86-53d8-460c-afff-c57791eb386e tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 13:02:48.526372 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-9ddd1c86-53d8-460c-afff-c57791eb386e tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 13:02:48.526801 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-9ddd1c86-53d8-460c-afff-c57791eb386e tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 13:02:48.669822 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.policy [None req-9ddd1c86-53d8-460c-afff-c57791eb386e tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79d74a2ea1e541d28d085c15cec34032', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68a8770b8dbe489a8119016fbee64eb5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116064) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 13:02:48.679333 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.policy [None req-9ddd1c86-53d8-460c-afff-c57791eb386e tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '79d74a2ea1e541d28d085c15cec34032', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68a8770b8dbe489a8119016fbee64eb5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116064) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 13:02:48.681081 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.policy [None req-9ddd1c86-53d8-460c-afff-c57791eb386e tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '79d74a2ea1e541d28d085c15cec34032', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68a8770b8dbe489a8119016fbee64eb5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116064) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 13:02:48.682347 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: INFO nova.api.openstack.requestlog [None req-9ddd1c86-53d8-460c-afff-c57791eb386e tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] 10.222.0.49 "GET /compute/v2.1/servers/9b3b44a7-7c20-473c-841c-318e471fc6cd" status: 200 len: 1405 microversion: 2.20 time: 0.171302 Dec 14 13:02:48.683021 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: [pid: 116064|app: 0|req: 359/741] 10.222.0.49 () {60 vars in 1276 bytes} [Tue Dec 14 13:02:48 2021] GET /compute/v2.1/servers/9b3b44a7-7c20-473c-841c-318e471fc6cd => generated 1405 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 14 13:02:48.955197 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.api.openstack.wsgi [None req-dd45f6c2-3424-4c53-824c-4f48a5ca243f tempest-AttachVolumeTestJSON-709357402 tempest-AttachVolumeTestJSON-709357402-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116063) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 14 13:02:48.958683 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.compute.api [None req-dd45f6c2-3424-4c53-824c-4f48a5ca243f tempest-AttachVolumeTestJSON-709357402 tempest-AttachVolumeTestJSON-709357402-project] [instance: 1b8e1f2f-c109-4413-9d56-33ef0b651f85] Fetching instance by UUID {{(pid=116063) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 13:02:48.975129 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-dd45f6c2-3424-4c53-824c-4f48a5ca243f tempest-AttachVolumeTestJSON-709357402 tempest-AttachVolumeTestJSON-709357402-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 13:02:48.975587 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-dd45f6c2-3424-4c53-824c-4f48a5ca243f tempest-AttachVolumeTestJSON-709357402 tempest-AttachVolumeTestJSON-709357402-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 13:02:48.976747 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-dd45f6c2-3424-4c53-824c-4f48a5ca243f tempest-AttachVolumeTestJSON-709357402 tempest-AttachVolumeTestJSON-709357402-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 13:02:48.977214 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-dd45f6c2-3424-4c53-824c-4f48a5ca243f tempest-AttachVolumeTestJSON-709357402 tempest-AttachVolumeTestJSON-709357402-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 13:02:49.056276 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: INFO nova.api.openstack.requestlog [None req-dd45f6c2-3424-4c53-824c-4f48a5ca243f tempest-AttachVolumeTestJSON-709357402 tempest-AttachVolumeTestJSON-709357402-project] 10.222.0.49 "POST /compute/v2.1/servers/1b8e1f2f-c109-4413-9d56-33ef0b651f85/action" status: 200 len: 23804 microversion: 2.1 time: 0.105367 Dec 14 13:02:49.057559 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: [pid: 116063|app: 0|req: 383/742] 10.222.0.49 () {60 vars in 1277 bytes} [Tue Dec 14 13:02:48 2021] POST /compute/v2.1/servers/1b8e1f2f-c109-4413-9d56-33ef0b651f85/action => generated 23804 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 14 13:02:49.700894 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.api.openstack.wsgi [None req-cce1ab51-fa55-4f6d-a7b1-33dcba5252a7 tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] Calling method '>' {{(pid=116064) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 13:02:49.702329 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.compute.api [None req-cce1ab51-fa55-4f6d-a7b1-33dcba5252a7 tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] [instance: 9b3b44a7-7c20-473c-841c-318e471fc6cd] Fetching instance by UUID {{(pid=116064) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 13:02:49.710392 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-cce1ab51-fa55-4f6d-a7b1-33dcba5252a7 tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 13:02:49.711108 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-cce1ab51-fa55-4f6d-a7b1-33dcba5252a7 tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 13:02:49.712119 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-cce1ab51-fa55-4f6d-a7b1-33dcba5252a7 tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 13:02:49.712766 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-cce1ab51-fa55-4f6d-a7b1-33dcba5252a7 tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 13:02:50.006243 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.policy [None req-cce1ab51-fa55-4f6d-a7b1-33dcba5252a7 tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79d74a2ea1e541d28d085c15cec34032', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68a8770b8dbe489a8119016fbee64eb5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116064) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 13:02:50.016796 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.policy [None req-cce1ab51-fa55-4f6d-a7b1-33dcba5252a7 tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '79d74a2ea1e541d28d085c15cec34032', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68a8770b8dbe489a8119016fbee64eb5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116064) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 13:02:50.018287 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.policy [None req-cce1ab51-fa55-4f6d-a7b1-33dcba5252a7 tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '79d74a2ea1e541d28d085c15cec34032', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68a8770b8dbe489a8119016fbee64eb5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116064) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 13:02:50.019654 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: INFO nova.api.openstack.requestlog [None req-cce1ab51-fa55-4f6d-a7b1-33dcba5252a7 tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] 10.222.0.49 "GET /compute/v2.1/servers/9b3b44a7-7c20-473c-841c-318e471fc6cd" status: 200 len: 1597 microversion: 2.20 time: 0.322766 Dec 14 13:02:50.020410 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: [pid: 116064|app: 0|req: 360/743] 10.222.0.49 () {60 vars in 1276 bytes} [Tue Dec 14 13:02:49 2021] GET /compute/v2.1/servers/9b3b44a7-7c20-473c-841c-318e471fc6cd => generated 1597 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 14 13:02:50.037727 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.api.openstack.wsgi [None req-bce4d0bd-14a7-4b8f-8efb-c73fc0a940ce tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] Calling method '>' {{(pid=116063) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 13:02:50.038876 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.compute.api [None req-bce4d0bd-14a7-4b8f-8efb-c73fc0a940ce tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] [instance: 9b3b44a7-7c20-473c-841c-318e471fc6cd] Fetching instance by UUID {{(pid=116063) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 13:02:50.046428 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-bce4d0bd-14a7-4b8f-8efb-c73fc0a940ce tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 13:02:50.047270 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-bce4d0bd-14a7-4b8f-8efb-c73fc0a940ce tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 13:02:50.048255 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-bce4d0bd-14a7-4b8f-8efb-c73fc0a940ce tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 13:02:50.048836 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-bce4d0bd-14a7-4b8f-8efb-c73fc0a940ce tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 13:02:50.068081 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.api.openstack.wsgi [None req-529384bb-42ea-4d4b-8cea-1cc4c250ee30 tempest-AttachVolumeTestJSON-709357402 tempest-AttachVolumeTestJSON-709357402-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116064) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 14 13:02:50.069154 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.compute.api [None req-529384bb-42ea-4d4b-8cea-1cc4c250ee30 tempest-AttachVolumeTestJSON-709357402 tempest-AttachVolumeTestJSON-709357402-project] [instance: 1b8e1f2f-c109-4413-9d56-33ef0b651f85] Fetching instance by UUID {{(pid=116064) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 13:02:50.080914 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-529384bb-42ea-4d4b-8cea-1cc4c250ee30 tempest-AttachVolumeTestJSON-709357402 tempest-AttachVolumeTestJSON-709357402-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 13:02:50.081438 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-529384bb-42ea-4d4b-8cea-1cc4c250ee30 tempest-AttachVolumeTestJSON-709357402 tempest-AttachVolumeTestJSON-709357402-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 13:02:50.082372 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-529384bb-42ea-4d4b-8cea-1cc4c250ee30 tempest-AttachVolumeTestJSON-709357402 tempest-AttachVolumeTestJSON-709357402-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 13:02:50.082804 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-529384bb-42ea-4d4b-8cea-1cc4c250ee30 tempest-AttachVolumeTestJSON-709357402 tempest-AttachVolumeTestJSON-709357402-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 13:02:50.156237 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: INFO nova.api.openstack.requestlog [None req-529384bb-42ea-4d4b-8cea-1cc4c250ee30 tempest-AttachVolumeTestJSON-709357402 tempest-AttachVolumeTestJSON-709357402-project] 10.222.0.49 "POST /compute/v2.1/servers/1b8e1f2f-c109-4413-9d56-33ef0b651f85/action" status: 200 len: 25495 microversion: 2.1 time: 0.090732 Dec 14 13:02:50.161374 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: [pid: 116064|app: 0|req: 361/744] 10.222.0.49 () {60 vars in 1277 bytes} [Tue Dec 14 13:02:50 2021] POST /compute/v2.1/servers/1b8e1f2f-c109-4413-9d56-33ef0b651f85/action => generated 25495 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 14 13:02:50.187989 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: INFO nova.api.openstack.requestlog [None req-bce4d0bd-14a7-4b8f-8efb-c73fc0a940ce tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] 10.222.0.49 "GET /compute/v2.1/servers/9b3b44a7-7c20-473c-841c-318e471fc6cd/os-interface" status: 200 len: 284 microversion: 2.20 time: 0.154238 Dec 14 13:02:50.194235 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: [pid: 116063|app: 0|req: 384/745] 10.222.0.49 () {60 vars in 1315 bytes} [Tue Dec 14 13:02:50 2021] GET /compute/v2.1/servers/9b3b44a7-7c20-473c-841c-318e471fc6cd/os-interface => generated 284 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 14 13:02:51.172604 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.api.openstack.wsgi [None req-adcd3158-71e7-4c3f-9a23-5db06a1617c0 tempest-AttachVolumeTestJSON-709357402 tempest-AttachVolumeTestJSON-709357402-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116064) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 14 13:02:51.173684 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.compute.api [None req-adcd3158-71e7-4c3f-9a23-5db06a1617c0 tempest-AttachVolumeTestJSON-709357402 tempest-AttachVolumeTestJSON-709357402-project] [instance: 1b8e1f2f-c109-4413-9d56-33ef0b651f85] Fetching instance by UUID {{(pid=116064) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 13:02:51.191776 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-adcd3158-71e7-4c3f-9a23-5db06a1617c0 tempest-AttachVolumeTestJSON-709357402 tempest-AttachVolumeTestJSON-709357402-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 13:02:51.192449 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-adcd3158-71e7-4c3f-9a23-5db06a1617c0 tempest-AttachVolumeTestJSON-709357402 tempest-AttachVolumeTestJSON-709357402-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 13:02:51.193614 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-adcd3158-71e7-4c3f-9a23-5db06a1617c0 tempest-AttachVolumeTestJSON-709357402 tempest-AttachVolumeTestJSON-709357402-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 13:02:51.194885 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-adcd3158-71e7-4c3f-9a23-5db06a1617c0 tempest-AttachVolumeTestJSON-709357402 tempest-AttachVolumeTestJSON-709357402-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 13:02:51.278657 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: INFO nova.api.openstack.requestlog [None req-adcd3158-71e7-4c3f-9a23-5db06a1617c0 tempest-AttachVolumeTestJSON-709357402 tempest-AttachVolumeTestJSON-709357402-project] 10.222.0.49 "POST /compute/v2.1/servers/1b8e1f2f-c109-4413-9d56-33ef0b651f85/action" status: 200 len: 26760 microversion: 2.1 time: 0.112208 Dec 14 13:02:51.280920 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: [pid: 116064|app: 0|req: 362/746] 10.222.0.49 () {60 vars in 1277 bytes} [Tue Dec 14 13:02:51 2021] POST /compute/v2.1/servers/1b8e1f2f-c109-4413-9d56-33ef0b651f85/action => generated 26760 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 14 13:02:51.451233 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.api.openstack.wsgi [req-9f10535f-ab61-4c65-a913-486af3d672b3 req-eb3f3696-b512-4913-aede-ca1acd5f9668 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9b3b44a7-7c20-473c-841c-318e471fc6cd", "tag": "0ed44ee3-2630-4f50-9391-4bb374b76e1d"}]} {{(pid=116064) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 14 13:02:51.452198 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.api.openstack.wsgi [None req-6bb778b5-fdbf-4636-bcf8-4420c3aa1bdb tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116063) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 14 13:02:51.455002 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.compute.api [None req-6bb778b5-fdbf-4636-bcf8-4420c3aa1bdb tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] [instance: 9b3b44a7-7c20-473c-841c-318e471fc6cd] Fetching instance by UUID {{(pid=116063) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 13:02:51.456894 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 14 13:02:51.456894 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: warnings.warn(msg) Dec 14 13:02:51.477340 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-6bb778b5-fdbf-4636-bcf8-4420c3aa1bdb tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 13:02:51.480480 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [req-9f10535f-ab61-4c65-a913-486af3d672b3 req-eb3f3696-b512-4913-aede-ca1acd5f9668 service nova] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 13:02:51.480962 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [req-9f10535f-ab61-4c65-a913-486af3d672b3 req-eb3f3696-b512-4913-aede-ca1acd5f9668 service nova] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 13:02:51.484894 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-6bb778b5-fdbf-4636-bcf8-4420c3aa1bdb tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 13:02:51.487722 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-6bb778b5-fdbf-4636-bcf8-4420c3aa1bdb tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 13:02:51.488618 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-6bb778b5-fdbf-4636-bcf8-4420c3aa1bdb tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 13:02:51.502955 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: INFO nova.api.openstack.compute.server_external_events [req-9f10535f-ab61-4c65-a913-486af3d672b3 req-eb3f3696-b512-4913-aede-ca1acd5f9668 service nova] Creating event network-changed:0ed44ee3-2630-4f50-9391-4bb374b76e1d for instance 9b3b44a7-7c20-473c-841c-318e471fc6cd on hv-cinder-78447 Dec 14 13:02:51.508047 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: INFO nova.api.openstack.requestlog [req-9f10535f-ab61-4c65-a913-486af3d672b3 req-eb3f3696-b512-4913-aede-ca1acd5f9668 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.060681 Dec 14 13:02:51.509027 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: [pid: 116064|app: 0|req: 363/747] 10.222.0.49 () {64 vars in 1317 bytes} [Tue Dec 14 13:02:51 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 14 13:02:51.590661 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: INFO nova.api.openstack.requestlog [None req-6bb778b5-fdbf-4636-bcf8-4420c3aa1bdb tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] 10.222.0.49 "POST /compute/v2.1/servers/9b3b44a7-7c20-473c-841c-318e471fc6cd/action" status: 200 len: 14 microversion: 2.20 time: 0.152212 Dec 14 13:02:51.594078 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: [pid: 116063|app: 0|req: 385/748] 10.222.0.49 () {62 vars in 1318 bytes} [Tue Dec 14 13:02:51 2021] POST /compute/v2.1/servers/9b3b44a7-7c20-473c-841c-318e471fc6cd/action => generated 14 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 14 13:02:52.292054 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.api.openstack.wsgi [None req-61186d3a-4de4-4536-bfc1-1bfc0f7de7fd tempest-AttachVolumeTestJSON-709357402 tempest-AttachVolumeTestJSON-709357402-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116064) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 14 13:02:52.294454 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.compute.api [None req-61186d3a-4de4-4536-bfc1-1bfc0f7de7fd tempest-AttachVolumeTestJSON-709357402 tempest-AttachVolumeTestJSON-709357402-project] [instance: 1b8e1f2f-c109-4413-9d56-33ef0b651f85] Fetching instance by UUID {{(pid=116064) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 13:02:52.303160 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-61186d3a-4de4-4536-bfc1-1bfc0f7de7fd tempest-AttachVolumeTestJSON-709357402 tempest-AttachVolumeTestJSON-709357402-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 13:02:52.303646 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-61186d3a-4de4-4536-bfc1-1bfc0f7de7fd tempest-AttachVolumeTestJSON-709357402 tempest-AttachVolumeTestJSON-709357402-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 13:02:52.304647 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-61186d3a-4de4-4536-bfc1-1bfc0f7de7fd tempest-AttachVolumeTestJSON-709357402 tempest-AttachVolumeTestJSON-709357402-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 13:02:52.305136 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-61186d3a-4de4-4536-bfc1-1bfc0f7de7fd tempest-AttachVolumeTestJSON-709357402 tempest-AttachVolumeTestJSON-709357402-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 13:02:52.380374 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: INFO nova.api.openstack.requestlog [None req-61186d3a-4de4-4536-bfc1-1bfc0f7de7fd tempest-AttachVolumeTestJSON-709357402 tempest-AttachVolumeTestJSON-709357402-project] 10.222.0.49 "POST /compute/v2.1/servers/1b8e1f2f-c109-4413-9d56-33ef0b651f85/action" status: 200 len: 27641 microversion: 2.1 time: 0.092609 Dec 14 13:02:52.381761 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: [pid: 116064|app: 0|req: 364/749] 10.222.0.49 () {60 vars in 1277 bytes} [Tue Dec 14 13:02:52 2021] POST /compute/v2.1/servers/1b8e1f2f-c109-4413-9d56-33ef0b651f85/action => generated 27641 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 14 13:02:52.604176 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.api.openstack.wsgi [None req-7c6d3bec-a4d9-4e95-b1c9-c5e7a7f8af6c tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116063) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 14 13:02:52.606199 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.compute.api [None req-7c6d3bec-a4d9-4e95-b1c9-c5e7a7f8af6c tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] [instance: 9b3b44a7-7c20-473c-841c-318e471fc6cd] Fetching instance by UUID {{(pid=116063) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 13:02:52.616789 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-7c6d3bec-a4d9-4e95-b1c9-c5e7a7f8af6c tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 13:02:52.617469 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-7c6d3bec-a4d9-4e95-b1c9-c5e7a7f8af6c tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 13:02:52.618426 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-7c6d3bec-a4d9-4e95-b1c9-c5e7a7f8af6c tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 13:02:52.619449 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-7c6d3bec-a4d9-4e95-b1c9-c5e7a7f8af6c tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 13:02:52.692411 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: INFO nova.api.openstack.requestlog [None req-7c6d3bec-a4d9-4e95-b1c9-c5e7a7f8af6c tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] 10.222.0.49 "POST /compute/v2.1/servers/9b3b44a7-7c20-473c-841c-318e471fc6cd/action" status: 200 len: 14 microversion: 2.20 time: 0.094048 Dec 14 13:02:52.693089 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: [pid: 116063|app: 0|req: 386/750] 10.222.0.49 () {62 vars in 1318 bytes} [Tue Dec 14 13:02:52 2021] POST /compute/v2.1/servers/9b3b44a7-7c20-473c-841c-318e471fc6cd/action => generated 14 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 14 13:02:53.396475 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.api.openstack.wsgi [None req-56884671-4355-4e5a-a159-978e6121c941 tempest-AttachVolumeTestJSON-709357402 tempest-AttachVolumeTestJSON-709357402-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116064) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 14 13:02:53.400119 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.compute.api [None req-56884671-4355-4e5a-a159-978e6121c941 tempest-AttachVolumeTestJSON-709357402 tempest-AttachVolumeTestJSON-709357402-project] [instance: 1b8e1f2f-c109-4413-9d56-33ef0b651f85] Fetching instance by UUID {{(pid=116064) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 13:02:53.409341 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-56884671-4355-4e5a-a159-978e6121c941 tempest-AttachVolumeTestJSON-709357402 tempest-AttachVolumeTestJSON-709357402-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 13:02:53.410061 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-56884671-4355-4e5a-a159-978e6121c941 tempest-AttachVolumeTestJSON-709357402 tempest-AttachVolumeTestJSON-709357402-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 13:02:53.411592 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-56884671-4355-4e5a-a159-978e6121c941 tempest-AttachVolumeTestJSON-709357402 tempest-AttachVolumeTestJSON-709357402-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 13:02:53.413324 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-56884671-4355-4e5a-a159-978e6121c941 tempest-AttachVolumeTestJSON-709357402 tempest-AttachVolumeTestJSON-709357402-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 13:02:53.501583 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: INFO nova.api.openstack.requestlog [None req-56884671-4355-4e5a-a159-978e6121c941 tempest-AttachVolumeTestJSON-709357402 tempest-AttachVolumeTestJSON-709357402-project] 10.222.0.49 "POST /compute/v2.1/servers/1b8e1f2f-c109-4413-9d56-33ef0b651f85/action" status: 200 len: 28046 microversion: 2.1 time: 0.111645 Dec 14 13:02:53.507132 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: [pid: 116064|app: 0|req: 365/751] 10.222.0.49 () {60 vars in 1277 bytes} [Tue Dec 14 13:02:53 2021] POST /compute/v2.1/servers/1b8e1f2f-c109-4413-9d56-33ef0b651f85/action => generated 28046 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 14 13:02:53.704578 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.api.openstack.wsgi [None req-a1312f42-bd33-4d5f-8678-95fe1ebdbd29 tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116063) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 14 13:02:53.705625 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.compute.api [None req-a1312f42-bd33-4d5f-8678-95fe1ebdbd29 tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] [instance: 9b3b44a7-7c20-473c-841c-318e471fc6cd] Fetching instance by UUID {{(pid=116063) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 13:02:53.728277 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-a1312f42-bd33-4d5f-8678-95fe1ebdbd29 tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 13:02:53.729201 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-a1312f42-bd33-4d5f-8678-95fe1ebdbd29 tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 13:02:53.736961 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-a1312f42-bd33-4d5f-8678-95fe1ebdbd29 tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 13:02:53.737782 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-a1312f42-bd33-4d5f-8678-95fe1ebdbd29 tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 13:02:53.806324 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: INFO nova.api.openstack.requestlog [None req-a1312f42-bd33-4d5f-8678-95fe1ebdbd29 tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] 10.222.0.49 "POST /compute/v2.1/servers/9b3b44a7-7c20-473c-841c-318e471fc6cd/action" status: 200 len: 14 microversion: 2.20 time: 0.106699 Dec 14 13:02:53.807849 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: [pid: 116063|app: 0|req: 387/752] 10.222.0.49 () {62 vars in 1318 bytes} [Tue Dec 14 13:02:53 2021] POST /compute/v2.1/servers/9b3b44a7-7c20-473c-841c-318e471fc6cd/action => generated 14 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 14 13:02:54.516193 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.api.openstack.wsgi [None req-135bd550-f804-4035-87b8-faad554a95a2 tempest-AttachVolumeTestJSON-709357402 tempest-AttachVolumeTestJSON-709357402-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116064) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 14 13:02:54.517411 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.compute.api [None req-135bd550-f804-4035-87b8-faad554a95a2 tempest-AttachVolumeTestJSON-709357402 tempest-AttachVolumeTestJSON-709357402-project] [instance: 1b8e1f2f-c109-4413-9d56-33ef0b651f85] Fetching instance by UUID {{(pid=116064) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 13:02:54.530367 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-135bd550-f804-4035-87b8-faad554a95a2 tempest-AttachVolumeTestJSON-709357402 tempest-AttachVolumeTestJSON-709357402-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 13:02:54.531218 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-135bd550-f804-4035-87b8-faad554a95a2 tempest-AttachVolumeTestJSON-709357402 tempest-AttachVolumeTestJSON-709357402-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 13:02:54.532454 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-135bd550-f804-4035-87b8-faad554a95a2 tempest-AttachVolumeTestJSON-709357402 tempest-AttachVolumeTestJSON-709357402-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 13:02:54.533081 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-135bd550-f804-4035-87b8-faad554a95a2 tempest-AttachVolumeTestJSON-709357402 tempest-AttachVolumeTestJSON-709357402-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 13:02:54.635099 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: INFO nova.api.openstack.requestlog [None req-135bd550-f804-4035-87b8-faad554a95a2 tempest-AttachVolumeTestJSON-709357402 tempest-AttachVolumeTestJSON-709357402-project] 10.222.0.49 "POST /compute/v2.1/servers/1b8e1f2f-c109-4413-9d56-33ef0b651f85/action" status: 200 len: 28189 microversion: 2.1 time: 0.124091 Dec 14 13:02:54.639147 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: [pid: 116064|app: 0|req: 366/753] 10.222.0.49 () {60 vars in 1277 bytes} [Tue Dec 14 13:02:54 2021] POST /compute/v2.1/servers/1b8e1f2f-c109-4413-9d56-33ef0b651f85/action => generated 28189 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 14 13:02:54.819459 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.api.openstack.wsgi [None req-4527ca11-d942-4dd7-8b22-24e84c4f488c tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116063) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 14 13:02:54.821254 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.compute.api [None req-4527ca11-d942-4dd7-8b22-24e84c4f488c tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] [instance: 9b3b44a7-7c20-473c-841c-318e471fc6cd] Fetching instance by UUID {{(pid=116063) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 13:02:54.829652 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-4527ca11-d942-4dd7-8b22-24e84c4f488c tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 13:02:54.830298 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-4527ca11-d942-4dd7-8b22-24e84c4f488c tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 13:02:54.831273 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-4527ca11-d942-4dd7-8b22-24e84c4f488c tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 13:02:54.831781 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-4527ca11-d942-4dd7-8b22-24e84c4f488c tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 13:02:54.923293 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: INFO nova.api.openstack.requestlog [None req-4527ca11-d942-4dd7-8b22-24e84c4f488c tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] 10.222.0.49 "POST /compute/v2.1/servers/9b3b44a7-7c20-473c-841c-318e471fc6cd/action" status: 200 len: 14 microversion: 2.20 time: 0.107684 Dec 14 13:02:54.927937 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: [pid: 116063|app: 0|req: 388/754] 10.222.0.49 () {62 vars in 1318 bytes} [Tue Dec 14 13:02:54 2021] POST /compute/v2.1/servers/9b3b44a7-7c20-473c-841c-318e471fc6cd/action => generated 14 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 14 13:02:55.647470 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.api.openstack.wsgi [None req-e76c9177-e83d-4eef-b08d-469ccf47b06a tempest-AttachVolumeTestJSON-709357402 tempest-AttachVolumeTestJSON-709357402-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116064) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 14 13:02:55.648529 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.compute.api [None req-e76c9177-e83d-4eef-b08d-469ccf47b06a tempest-AttachVolumeTestJSON-709357402 tempest-AttachVolumeTestJSON-709357402-project] [instance: 1b8e1f2f-c109-4413-9d56-33ef0b651f85] Fetching instance by UUID {{(pid=116064) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 13:02:55.656028 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-e76c9177-e83d-4eef-b08d-469ccf47b06a tempest-AttachVolumeTestJSON-709357402 tempest-AttachVolumeTestJSON-709357402-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 13:02:55.656494 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-e76c9177-e83d-4eef-b08d-469ccf47b06a tempest-AttachVolumeTestJSON-709357402 tempest-AttachVolumeTestJSON-709357402-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 13:02:55.657322 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-e76c9177-e83d-4eef-b08d-469ccf47b06a tempest-AttachVolumeTestJSON-709357402 tempest-AttachVolumeTestJSON-709357402-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 13:02:55.657768 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-e76c9177-e83d-4eef-b08d-469ccf47b06a tempest-AttachVolumeTestJSON-709357402 tempest-AttachVolumeTestJSON-709357402-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 13:02:55.879646 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: INFO nova.api.openstack.requestlog [None req-e76c9177-e83d-4eef-b08d-469ccf47b06a tempest-AttachVolumeTestJSON-709357402 tempest-AttachVolumeTestJSON-709357402-project] 10.222.0.49 "POST /compute/v2.1/servers/1b8e1f2f-c109-4413-9d56-33ef0b651f85/action" status: 200 len: 28480 microversion: 2.1 time: 0.235958 Dec 14 13:02:55.880332 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: [pid: 116064|app: 0|req: 367/755] 10.222.0.49 () {60 vars in 1277 bytes} [Tue Dec 14 13:02:55 2021] POST /compute/v2.1/servers/1b8e1f2f-c109-4413-9d56-33ef0b651f85/action => generated 28480 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 14 13:02:55.936192 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.api.openstack.wsgi [None req-ae0db1f1-29be-4e06-bc73-60a14ef6d943 tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116063) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 14 13:02:55.937259 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.compute.api [None req-ae0db1f1-29be-4e06-bc73-60a14ef6d943 tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] [instance: 9b3b44a7-7c20-473c-841c-318e471fc6cd] Fetching instance by UUID {{(pid=116063) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 13:02:55.950535 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-ae0db1f1-29be-4e06-bc73-60a14ef6d943 tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 13:02:55.950977 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-ae0db1f1-29be-4e06-bc73-60a14ef6d943 tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 13:02:55.951772 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-ae0db1f1-29be-4e06-bc73-60a14ef6d943 tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 13:02:55.957259 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-ae0db1f1-29be-4e06-bc73-60a14ef6d943 tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 13:02:56.062730 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: INFO nova.api.openstack.requestlog [None req-ae0db1f1-29be-4e06-bc73-60a14ef6d943 tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] 10.222.0.49 "POST /compute/v2.1/servers/9b3b44a7-7c20-473c-841c-318e471fc6cd/action" status: 200 len: 14 microversion: 2.20 time: 0.131387 Dec 14 13:02:56.066233 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: [pid: 116063|app: 0|req: 389/756] 10.222.0.49 () {62 vars in 1318 bytes} [Tue Dec 14 13:02:55 2021] POST /compute/v2.1/servers/9b3b44a7-7c20-473c-841c-318e471fc6cd/action => generated 14 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 14 13:02:56.892114 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.api.openstack.wsgi [None req-06836e59-9c62-4d14-acc6-2a58f5619dea tempest-AttachVolumeTestJSON-709357402 tempest-AttachVolumeTestJSON-709357402-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116064) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 14 13:02:56.893139 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.compute.api [None req-06836e59-9c62-4d14-acc6-2a58f5619dea tempest-AttachVolumeTestJSON-709357402 tempest-AttachVolumeTestJSON-709357402-project] [instance: 1b8e1f2f-c109-4413-9d56-33ef0b651f85] Fetching instance by UUID {{(pid=116064) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 13:02:56.900200 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-06836e59-9c62-4d14-acc6-2a58f5619dea tempest-AttachVolumeTestJSON-709357402 tempest-AttachVolumeTestJSON-709357402-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 13:02:56.900641 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-06836e59-9c62-4d14-acc6-2a58f5619dea tempest-AttachVolumeTestJSON-709357402 tempest-AttachVolumeTestJSON-709357402-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 13:02:56.901398 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-06836e59-9c62-4d14-acc6-2a58f5619dea tempest-AttachVolumeTestJSON-709357402 tempest-AttachVolumeTestJSON-709357402-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 13:02:56.901845 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-06836e59-9c62-4d14-acc6-2a58f5619dea tempest-AttachVolumeTestJSON-709357402 tempest-AttachVolumeTestJSON-709357402-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 13:02:56.988465 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: INFO nova.api.openstack.requestlog [None req-06836e59-9c62-4d14-acc6-2a58f5619dea tempest-AttachVolumeTestJSON-709357402 tempest-AttachVolumeTestJSON-709357402-project] 10.222.0.49 "POST /compute/v2.1/servers/1b8e1f2f-c109-4413-9d56-33ef0b651f85/action" status: 200 len: 28648 microversion: 2.1 time: 0.100073 Dec 14 13:02:56.989192 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: [pid: 116064|app: 0|req: 368/757] 10.222.0.49 () {60 vars in 1277 bytes} [Tue Dec 14 13:02:56 2021] POST /compute/v2.1/servers/1b8e1f2f-c109-4413-9d56-33ef0b651f85/action => generated 28648 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 14 13:02:57.074288 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.api.openstack.wsgi [None req-33d102b7-ad63-4f4a-bc6f-0be6130d1ca1 tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116063) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 14 13:02:57.075276 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.compute.api [None req-33d102b7-ad63-4f4a-bc6f-0be6130d1ca1 tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] [instance: 9b3b44a7-7c20-473c-841c-318e471fc6cd] Fetching instance by UUID {{(pid=116063) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 13:02:57.082427 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-33d102b7-ad63-4f4a-bc6f-0be6130d1ca1 tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 13:02:57.082883 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-33d102b7-ad63-4f4a-bc6f-0be6130d1ca1 tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 13:02:57.083664 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-33d102b7-ad63-4f4a-bc6f-0be6130d1ca1 tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 13:02:57.084088 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-33d102b7-ad63-4f4a-bc6f-0be6130d1ca1 tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 13:02:57.141582 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: INFO nova.api.openstack.requestlog [None req-33d102b7-ad63-4f4a-bc6f-0be6130d1ca1 tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] 10.222.0.49 "POST /compute/v2.1/servers/9b3b44a7-7c20-473c-841c-318e471fc6cd/action" status: 200 len: 14 microversion: 2.20 time: 0.071153 Dec 14 13:02:57.144794 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: [pid: 116063|app: 0|req: 390/758] 10.222.0.49 () {62 vars in 1318 bytes} [Tue Dec 14 13:02:57 2021] POST /compute/v2.1/servers/9b3b44a7-7c20-473c-841c-318e471fc6cd/action => generated 14 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 14 13:02:58.000285 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.api.openstack.wsgi [None req-0badfc4e-d628-469f-9429-0b8626d5765d tempest-AttachVolumeTestJSON-709357402 tempest-AttachVolumeTestJSON-709357402-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116064) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 14 13:02:58.001307 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.compute.api [None req-0badfc4e-d628-469f-9429-0b8626d5765d tempest-AttachVolumeTestJSON-709357402 tempest-AttachVolumeTestJSON-709357402-project] [instance: 1b8e1f2f-c109-4413-9d56-33ef0b651f85] Fetching instance by UUID {{(pid=116064) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 13:02:58.010023 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-0badfc4e-d628-469f-9429-0b8626d5765d tempest-AttachVolumeTestJSON-709357402 tempest-AttachVolumeTestJSON-709357402-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 13:02:58.010683 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-0badfc4e-d628-469f-9429-0b8626d5765d tempest-AttachVolumeTestJSON-709357402 tempest-AttachVolumeTestJSON-709357402-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 13:02:58.011627 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-0badfc4e-d628-469f-9429-0b8626d5765d tempest-AttachVolumeTestJSON-709357402 tempest-AttachVolumeTestJSON-709357402-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 13:02:58.012209 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-0badfc4e-d628-469f-9429-0b8626d5765d tempest-AttachVolumeTestJSON-709357402 tempest-AttachVolumeTestJSON-709357402-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 13:02:58.086210 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: INFO nova.api.openstack.requestlog [None req-0badfc4e-d628-469f-9429-0b8626d5765d tempest-AttachVolumeTestJSON-709357402 tempest-AttachVolumeTestJSON-709357402-project] 10.222.0.49 "POST /compute/v2.1/servers/1b8e1f2f-c109-4413-9d56-33ef0b651f85/action" status: 200 len: 28648 microversion: 2.1 time: 0.089753 Dec 14 13:02:58.090424 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: [pid: 116064|app: 0|req: 369/759] 10.222.0.49 () {60 vars in 1277 bytes} [Tue Dec 14 13:02:57 2021] POST /compute/v2.1/servers/1b8e1f2f-c109-4413-9d56-33ef0b651f85/action => generated 28648 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 14 13:02:58.154340 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.api.openstack.wsgi [None req-94fdd2b4-29d8-483f-923d-f6b333c305f3 tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116063) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 14 13:02:58.155357 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.compute.api [None req-94fdd2b4-29d8-483f-923d-f6b333c305f3 tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] [instance: 9b3b44a7-7c20-473c-841c-318e471fc6cd] Fetching instance by UUID {{(pid=116063) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 13:02:58.164881 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-94fdd2b4-29d8-483f-923d-f6b333c305f3 tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 13:02:58.165325 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-94fdd2b4-29d8-483f-923d-f6b333c305f3 tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 13:02:58.166170 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-94fdd2b4-29d8-483f-923d-f6b333c305f3 tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 13:02:58.166775 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-94fdd2b4-29d8-483f-923d-f6b333c305f3 tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 13:02:58.229927 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: INFO nova.api.openstack.requestlog [None req-94fdd2b4-29d8-483f-923d-f6b333c305f3 tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] 10.222.0.49 "POST /compute/v2.1/servers/9b3b44a7-7c20-473c-841c-318e471fc6cd/action" status: 200 len: 14 microversion: 2.20 time: 0.081525 Dec 14 13:02:58.231739 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: [pid: 116063|app: 0|req: 391/760] 10.222.0.49 () {62 vars in 1318 bytes} [Tue Dec 14 13:02:58 2021] POST /compute/v2.1/servers/9b3b44a7-7c20-473c-841c-318e471fc6cd/action => generated 14 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 14 13:02:59.098798 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.api.openstack.wsgi [None req-92b45654-5751-4c0b-ba15-f052cea4bd73 tempest-AttachVolumeTestJSON-709357402 tempest-AttachVolumeTestJSON-709357402-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116064) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 14 13:02:59.100525 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.compute.api [None req-92b45654-5751-4c0b-ba15-f052cea4bd73 tempest-AttachVolumeTestJSON-709357402 tempest-AttachVolumeTestJSON-709357402-project] [instance: 1b8e1f2f-c109-4413-9d56-33ef0b651f85] Fetching instance by UUID {{(pid=116064) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 13:02:59.108680 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-92b45654-5751-4c0b-ba15-f052cea4bd73 tempest-AttachVolumeTestJSON-709357402 tempest-AttachVolumeTestJSON-709357402-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 13:02:59.110158 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-92b45654-5751-4c0b-ba15-f052cea4bd73 tempest-AttachVolumeTestJSON-709357402 tempest-AttachVolumeTestJSON-709357402-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 13:02:59.110158 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-92b45654-5751-4c0b-ba15-f052cea4bd73 tempest-AttachVolumeTestJSON-709357402 tempest-AttachVolumeTestJSON-709357402-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 13:02:59.110817 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-92b45654-5751-4c0b-ba15-f052cea4bd73 tempest-AttachVolumeTestJSON-709357402 tempest-AttachVolumeTestJSON-709357402-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 13:02:59.182026 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: INFO nova.api.openstack.requestlog [None req-92b45654-5751-4c0b-ba15-f052cea4bd73 tempest-AttachVolumeTestJSON-709357402 tempest-AttachVolumeTestJSON-709357402-project] 10.222.0.49 "POST /compute/v2.1/servers/1b8e1f2f-c109-4413-9d56-33ef0b651f85/action" status: 200 len: 28648 microversion: 2.1 time: 0.087166 Dec 14 13:02:59.183386 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: [pid: 116064|app: 0|req: 370/761] 10.222.0.49 () {60 vars in 1277 bytes} [Tue Dec 14 13:02:59 2021] POST /compute/v2.1/servers/1b8e1f2f-c109-4413-9d56-33ef0b651f85/action => generated 28648 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 14 13:02:59.243459 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.api.openstack.wsgi [None req-910f1b50-6fcd-4009-8942-0798c7f719b0 tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116063) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 14 13:02:59.245806 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.compute.api [None req-910f1b50-6fcd-4009-8942-0798c7f719b0 tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] [instance: 9b3b44a7-7c20-473c-841c-318e471fc6cd] Fetching instance by UUID {{(pid=116063) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 13:02:59.253526 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-910f1b50-6fcd-4009-8942-0798c7f719b0 tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 13:02:59.254186 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-910f1b50-6fcd-4009-8942-0798c7f719b0 tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 13:02:59.255272 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-910f1b50-6fcd-4009-8942-0798c7f719b0 tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 13:02:59.255848 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-910f1b50-6fcd-4009-8942-0798c7f719b0 tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 13:02:59.323832 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: INFO nova.api.openstack.requestlog [None req-910f1b50-6fcd-4009-8942-0798c7f719b0 tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] 10.222.0.49 "POST /compute/v2.1/servers/9b3b44a7-7c20-473c-841c-318e471fc6cd/action" status: 200 len: 14 microversion: 2.20 time: 0.084530 Dec 14 13:02:59.324699 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: [pid: 116063|app: 0|req: 392/762] 10.222.0.49 () {62 vars in 1318 bytes} [Tue Dec 14 13:02:59 2021] POST /compute/v2.1/servers/9b3b44a7-7c20-473c-841c-318e471fc6cd/action => generated 14 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 14 13:03:00.195187 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.api.openstack.wsgi [None req-fcc102f9-ac3d-4c45-9e44-b8309355aa7e tempest-AttachVolumeTestJSON-709357402 tempest-AttachVolumeTestJSON-709357402-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116064) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 14 13:03:00.196109 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.compute.api [None req-fcc102f9-ac3d-4c45-9e44-b8309355aa7e tempest-AttachVolumeTestJSON-709357402 tempest-AttachVolumeTestJSON-709357402-project] [instance: 1b8e1f2f-c109-4413-9d56-33ef0b651f85] Fetching instance by UUID {{(pid=116064) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 13:03:00.204298 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-fcc102f9-ac3d-4c45-9e44-b8309355aa7e tempest-AttachVolumeTestJSON-709357402 tempest-AttachVolumeTestJSON-709357402-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 13:03:00.205041 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-fcc102f9-ac3d-4c45-9e44-b8309355aa7e tempest-AttachVolumeTestJSON-709357402 tempest-AttachVolumeTestJSON-709357402-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 13:03:00.206012 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-fcc102f9-ac3d-4c45-9e44-b8309355aa7e tempest-AttachVolumeTestJSON-709357402 tempest-AttachVolumeTestJSON-709357402-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 13:03:00.206594 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-fcc102f9-ac3d-4c45-9e44-b8309355aa7e tempest-AttachVolumeTestJSON-709357402 tempest-AttachVolumeTestJSON-709357402-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 13:03:00.295567 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: INFO nova.api.openstack.requestlog [None req-fcc102f9-ac3d-4c45-9e44-b8309355aa7e tempest-AttachVolumeTestJSON-709357402 tempest-AttachVolumeTestJSON-709357402-project] 10.222.0.49 "POST /compute/v2.1/servers/1b8e1f2f-c109-4413-9d56-33ef0b651f85/action" status: 200 len: 28769 microversion: 2.1 time: 0.104295 Dec 14 13:03:00.296224 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: [pid: 116064|app: 0|req: 371/763] 10.222.0.49 () {60 vars in 1277 bytes} [Tue Dec 14 13:03:00 2021] POST /compute/v2.1/servers/1b8e1f2f-c109-4413-9d56-33ef0b651f85/action => generated 28769 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 14 13:03:00.336730 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.api.openstack.wsgi [None req-8026dd96-b0c8-4b2e-81be-20581074a70e tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116063) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 14 13:03:00.338791 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.compute.api [None req-8026dd96-b0c8-4b2e-81be-20581074a70e tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] [instance: 9b3b44a7-7c20-473c-841c-318e471fc6cd] Fetching instance by UUID {{(pid=116063) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 13:03:00.348963 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-8026dd96-b0c8-4b2e-81be-20581074a70e tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 13:03:00.349796 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-8026dd96-b0c8-4b2e-81be-20581074a70e tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 13:03:00.351062 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-8026dd96-b0c8-4b2e-81be-20581074a70e tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 13:03:00.351759 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-8026dd96-b0c8-4b2e-81be-20581074a70e tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 13:03:00.424283 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: INFO nova.api.openstack.requestlog [None req-8026dd96-b0c8-4b2e-81be-20581074a70e tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] 10.222.0.49 "POST /compute/v2.1/servers/9b3b44a7-7c20-473c-841c-318e471fc6cd/action" status: 200 len: 14 microversion: 2.20 time: 0.092781 Dec 14 13:03:00.429312 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: [pid: 116063|app: 0|req: 393/764] 10.222.0.49 () {62 vars in 1318 bytes} [Tue Dec 14 13:03:00 2021] POST /compute/v2.1/servers/9b3b44a7-7c20-473c-841c-318e471fc6cd/action => generated 14 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 14 13:03:01.307230 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.api.openstack.wsgi [None req-349ff787-7dd2-4f6a-afcb-bc45f5af6e77 tempest-AttachVolumeTestJSON-709357402 tempest-AttachVolumeTestJSON-709357402-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116064) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 14 13:03:01.308943 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.compute.api [None req-349ff787-7dd2-4f6a-afcb-bc45f5af6e77 tempest-AttachVolumeTestJSON-709357402 tempest-AttachVolumeTestJSON-709357402-project] [instance: 1b8e1f2f-c109-4413-9d56-33ef0b651f85] Fetching instance by UUID {{(pid=116064) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 13:03:01.315983 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-349ff787-7dd2-4f6a-afcb-bc45f5af6e77 tempest-AttachVolumeTestJSON-709357402 tempest-AttachVolumeTestJSON-709357402-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 13:03:01.316556 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-349ff787-7dd2-4f6a-afcb-bc45f5af6e77 tempest-AttachVolumeTestJSON-709357402 tempest-AttachVolumeTestJSON-709357402-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 13:03:01.317467 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-349ff787-7dd2-4f6a-afcb-bc45f5af6e77 tempest-AttachVolumeTestJSON-709357402 tempest-AttachVolumeTestJSON-709357402-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 13:03:01.317999 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-349ff787-7dd2-4f6a-afcb-bc45f5af6e77 tempest-AttachVolumeTestJSON-709357402 tempest-AttachVolumeTestJSON-709357402-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 13:03:01.395633 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: INFO nova.api.openstack.requestlog [None req-349ff787-7dd2-4f6a-afcb-bc45f5af6e77 tempest-AttachVolumeTestJSON-709357402 tempest-AttachVolumeTestJSON-709357402-project] 10.222.0.49 "POST /compute/v2.1/servers/1b8e1f2f-c109-4413-9d56-33ef0b651f85/action" status: 200 len: 30706 microversion: 2.1 time: 0.092249 Dec 14 13:03:01.400246 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: [pid: 116064|app: 0|req: 372/765] 10.222.0.49 () {60 vars in 1277 bytes} [Tue Dec 14 13:03:01 2021] POST /compute/v2.1/servers/1b8e1f2f-c109-4413-9d56-33ef0b651f85/action => generated 30706 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 14 13:03:01.435549 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.api.openstack.wsgi [None req-6118b5b4-9eba-4210-972d-e3123f0f74dd tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116063) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 14 13:03:01.437055 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.compute.api [None req-6118b5b4-9eba-4210-972d-e3123f0f74dd tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] [instance: 9b3b44a7-7c20-473c-841c-318e471fc6cd] Fetching instance by UUID {{(pid=116063) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 13:03:01.444575 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-6118b5b4-9eba-4210-972d-e3123f0f74dd tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 13:03:01.445323 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-6118b5b4-9eba-4210-972d-e3123f0f74dd tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 13:03:01.446778 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-6118b5b4-9eba-4210-972d-e3123f0f74dd tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 13:03:01.447374 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-6118b5b4-9eba-4210-972d-e3123f0f74dd tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 13:03:01.532826 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: INFO nova.api.openstack.requestlog [None req-6118b5b4-9eba-4210-972d-e3123f0f74dd tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] 10.222.0.49 "POST /compute/v2.1/servers/9b3b44a7-7c20-473c-841c-318e471fc6cd/action" status: 200 len: 6795 microversion: 2.20 time: 0.101239 Dec 14 13:03:01.537808 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: [pid: 116063|app: 0|req: 394/766] 10.222.0.49 () {62 vars in 1318 bytes} [Tue Dec 14 13:03:01 2021] POST /compute/v2.1/servers/9b3b44a7-7c20-473c-841c-318e471fc6cd/action => generated 6795 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 14 13:03:02.408434 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.api.openstack.wsgi [None req-01a5cb87-c596-44ef-af6c-176d4736a6a3 tempest-AttachVolumeTestJSON-709357402 tempest-AttachVolumeTestJSON-709357402-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116064) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 14 13:03:02.409476 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.compute.api [None req-01a5cb87-c596-44ef-af6c-176d4736a6a3 tempest-AttachVolumeTestJSON-709357402 tempest-AttachVolumeTestJSON-709357402-project] [instance: 1b8e1f2f-c109-4413-9d56-33ef0b651f85] Fetching instance by UUID {{(pid=116064) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 13:03:02.416779 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-01a5cb87-c596-44ef-af6c-176d4736a6a3 tempest-AttachVolumeTestJSON-709357402 tempest-AttachVolumeTestJSON-709357402-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 13:03:02.417476 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-01a5cb87-c596-44ef-af6c-176d4736a6a3 tempest-AttachVolumeTestJSON-709357402 tempest-AttachVolumeTestJSON-709357402-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 13:03:02.418860 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-01a5cb87-c596-44ef-af6c-176d4736a6a3 tempest-AttachVolumeTestJSON-709357402 tempest-AttachVolumeTestJSON-709357402-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 13:03:02.419369 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-01a5cb87-c596-44ef-af6c-176d4736a6a3 tempest-AttachVolumeTestJSON-709357402 tempest-AttachVolumeTestJSON-709357402-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 13:03:02.493211 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: INFO nova.api.openstack.requestlog [None req-01a5cb87-c596-44ef-af6c-176d4736a6a3 tempest-AttachVolumeTestJSON-709357402 tempest-AttachVolumeTestJSON-709357402-project] 10.222.0.49 "POST /compute/v2.1/servers/1b8e1f2f-c109-4413-9d56-33ef0b651f85/action" status: 200 len: 32531 microversion: 2.1 time: 0.088940 Dec 14 13:03:02.494657 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: [pid: 116064|app: 0|req: 373/767] 10.222.0.49 () {60 vars in 1277 bytes} [Tue Dec 14 13:03:02 2021] POST /compute/v2.1/servers/1b8e1f2f-c109-4413-9d56-33ef0b651f85/action => generated 32531 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 14 13:03:02.545945 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.api.openstack.wsgi [None req-0e9b8e50-7ba6-4b47-aae3-dea1c74a1430 tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116063) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 14 13:03:02.547020 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.compute.api [None req-0e9b8e50-7ba6-4b47-aae3-dea1c74a1430 tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] [instance: 9b3b44a7-7c20-473c-841c-318e471fc6cd] Fetching instance by UUID {{(pid=116063) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 13:03:02.554365 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-0e9b8e50-7ba6-4b47-aae3-dea1c74a1430 tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 13:03:02.555152 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-0e9b8e50-7ba6-4b47-aae3-dea1c74a1430 tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 13:03:02.556191 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-0e9b8e50-7ba6-4b47-aae3-dea1c74a1430 tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 13:03:02.556830 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-0e9b8e50-7ba6-4b47-aae3-dea1c74a1430 tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 13:03:02.632649 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: INFO nova.api.openstack.requestlog [None req-0e9b8e50-7ba6-4b47-aae3-dea1c74a1430 tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] 10.222.0.49 "POST /compute/v2.1/servers/9b3b44a7-7c20-473c-841c-318e471fc6cd/action" status: 200 len: 15025 microversion: 2.20 time: 0.091022 Dec 14 13:03:02.633795 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: [pid: 116063|app: 0|req: 395/768] 10.222.0.49 () {62 vars in 1318 bytes} [Tue Dec 14 13:03:02 2021] POST /compute/v2.1/servers/9b3b44a7-7c20-473c-841c-318e471fc6cd/action => generated 15025 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 14 13:03:03.506190 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.api.openstack.wsgi [None req-ede87726-2748-442f-a630-6b788c908e4f tempest-AttachVolumeTestJSON-709357402 tempest-AttachVolumeTestJSON-709357402-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116064) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 14 13:03:03.508101 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.compute.api [None req-ede87726-2748-442f-a630-6b788c908e4f tempest-AttachVolumeTestJSON-709357402 tempest-AttachVolumeTestJSON-709357402-project] [instance: 1b8e1f2f-c109-4413-9d56-33ef0b651f85] Fetching instance by UUID {{(pid=116064) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 13:03:03.517103 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-ede87726-2748-442f-a630-6b788c908e4f tempest-AttachVolumeTestJSON-709357402 tempest-AttachVolumeTestJSON-709357402-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 13:03:03.517859 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-ede87726-2748-442f-a630-6b788c908e4f tempest-AttachVolumeTestJSON-709357402 tempest-AttachVolumeTestJSON-709357402-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 13:03:03.518646 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-ede87726-2748-442f-a630-6b788c908e4f tempest-AttachVolumeTestJSON-709357402 tempest-AttachVolumeTestJSON-709357402-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 13:03:03.519248 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-ede87726-2748-442f-a630-6b788c908e4f tempest-AttachVolumeTestJSON-709357402 tempest-AttachVolumeTestJSON-709357402-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 13:03:03.604729 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: INFO nova.api.openstack.requestlog [None req-ede87726-2748-442f-a630-6b788c908e4f tempest-AttachVolumeTestJSON-709357402 tempest-AttachVolumeTestJSON-709357402-project] 10.222.0.49 "POST /compute/v2.1/servers/1b8e1f2f-c109-4413-9d56-33ef0b651f85/action" status: 200 len: 33625 microversion: 2.1 time: 0.102551 Dec 14 13:03:03.605550 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: [pid: 116064|app: 0|req: 374/769] 10.222.0.49 () {60 vars in 1277 bytes} [Tue Dec 14 13:03:03 2021] POST /compute/v2.1/servers/1b8e1f2f-c109-4413-9d56-33ef0b651f85/action => generated 33625 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 14 13:03:03.646861 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.api.openstack.wsgi [None req-80eb79c1-8d7c-47e9-a57f-4de21ddf809e tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116063) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 14 13:03:03.648600 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.compute.api [None req-80eb79c1-8d7c-47e9-a57f-4de21ddf809e tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] [instance: 9b3b44a7-7c20-473c-841c-318e471fc6cd] Fetching instance by UUID {{(pid=116063) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 13:03:03.655822 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-80eb79c1-8d7c-47e9-a57f-4de21ddf809e tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 13:03:03.656340 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-80eb79c1-8d7c-47e9-a57f-4de21ddf809e tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 13:03:03.657217 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-80eb79c1-8d7c-47e9-a57f-4de21ddf809e tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 13:03:03.657660 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-80eb79c1-8d7c-47e9-a57f-4de21ddf809e tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 13:03:03.736408 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: INFO nova.api.openstack.requestlog [None req-80eb79c1-8d7c-47e9-a57f-4de21ddf809e tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] 10.222.0.49 "POST /compute/v2.1/servers/9b3b44a7-7c20-473c-841c-318e471fc6cd/action" status: 200 len: 18608 microversion: 2.20 time: 0.093508 Dec 14 13:03:03.741230 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: [pid: 116063|app: 0|req: 396/770] 10.222.0.49 () {62 vars in 1318 bytes} [Tue Dec 14 13:03:03 2021] POST /compute/v2.1/servers/9b3b44a7-7c20-473c-841c-318e471fc6cd/action => generated 18608 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Dec 14 13:03:04.617875 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.api.openstack.wsgi [None req-a46461c8-e73c-4e5d-968c-c39beba27fce tempest-AttachVolumeTestJSON-709357402 tempest-AttachVolumeTestJSON-709357402-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116064) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 14 13:03:04.619133 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.compute.api [None req-a46461c8-e73c-4e5d-968c-c39beba27fce tempest-AttachVolumeTestJSON-709357402 tempest-AttachVolumeTestJSON-709357402-project] [instance: 1b8e1f2f-c109-4413-9d56-33ef0b651f85] Fetching instance by UUID {{(pid=116064) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 13:03:04.627492 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-a46461c8-e73c-4e5d-968c-c39beba27fce tempest-AttachVolumeTestJSON-709357402 tempest-AttachVolumeTestJSON-709357402-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 13:03:04.628325 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-a46461c8-e73c-4e5d-968c-c39beba27fce tempest-AttachVolumeTestJSON-709357402 tempest-AttachVolumeTestJSON-709357402-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 13:03:04.629412 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-a46461c8-e73c-4e5d-968c-c39beba27fce tempest-AttachVolumeTestJSON-709357402 tempest-AttachVolumeTestJSON-709357402-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 13:03:04.629806 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-a46461c8-e73c-4e5d-968c-c39beba27fce tempest-AttachVolumeTestJSON-709357402 tempest-AttachVolumeTestJSON-709357402-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 13:03:04.712183 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: INFO nova.api.openstack.requestlog [None req-a46461c8-e73c-4e5d-968c-c39beba27fce tempest-AttachVolumeTestJSON-709357402 tempest-AttachVolumeTestJSON-709357402-project] 10.222.0.49 "POST /compute/v2.1/servers/1b8e1f2f-c109-4413-9d56-33ef0b651f85/action" status: 200 len: 34717 microversion: 2.1 time: 0.098474 Dec 14 13:03:04.713703 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: [pid: 116064|app: 0|req: 375/771] 10.222.0.49 () {60 vars in 1277 bytes} [Tue Dec 14 13:03:04 2021] POST /compute/v2.1/servers/1b8e1f2f-c109-4413-9d56-33ef0b651f85/action => generated 34717 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 14 13:03:04.749078 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.api.openstack.wsgi [None req-19440536-874f-47b3-8931-e0ac7c8c4529 tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116063) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 14 13:03:04.750766 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.compute.api [None req-19440536-874f-47b3-8931-e0ac7c8c4529 tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] [instance: 9b3b44a7-7c20-473c-841c-318e471fc6cd] Fetching instance by UUID {{(pid=116063) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 13:03:04.757851 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-19440536-874f-47b3-8931-e0ac7c8c4529 tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 13:03:04.758512 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-19440536-874f-47b3-8931-e0ac7c8c4529 tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 13:03:04.759485 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-19440536-874f-47b3-8931-e0ac7c8c4529 tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 13:03:04.760071 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-19440536-874f-47b3-8931-e0ac7c8c4529 tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 13:03:04.833557 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: INFO nova.api.openstack.requestlog [None req-19440536-874f-47b3-8931-e0ac7c8c4529 tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] 10.222.0.49 "POST /compute/v2.1/servers/9b3b44a7-7c20-473c-841c-318e471fc6cd/action" status: 200 len: 20074 microversion: 2.20 time: 0.088262 Dec 14 13:03:04.834582 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: [pid: 116063|app: 0|req: 397/772] 10.222.0.49 () {62 vars in 1318 bytes} [Tue Dec 14 13:03:04 2021] POST /compute/v2.1/servers/9b3b44a7-7c20-473c-841c-318e471fc6cd/action => generated 20074 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 14 13:03:05.724402 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.api.openstack.wsgi [None req-8ba064e5-dfb2-494d-9c64-cf06766fe988 tempest-AttachVolumeTestJSON-709357402 tempest-AttachVolumeTestJSON-709357402-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116064) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 14 13:03:05.725556 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.compute.api [None req-8ba064e5-dfb2-494d-9c64-cf06766fe988 tempest-AttachVolumeTestJSON-709357402 tempest-AttachVolumeTestJSON-709357402-project] [instance: 1b8e1f2f-c109-4413-9d56-33ef0b651f85] Fetching instance by UUID {{(pid=116064) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 13:03:05.732292 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-8ba064e5-dfb2-494d-9c64-cf06766fe988 tempest-AttachVolumeTestJSON-709357402 tempest-AttachVolumeTestJSON-709357402-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 13:03:05.732987 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-8ba064e5-dfb2-494d-9c64-cf06766fe988 tempest-AttachVolumeTestJSON-709357402 tempest-AttachVolumeTestJSON-709357402-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 13:03:05.733927 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-8ba064e5-dfb2-494d-9c64-cf06766fe988 tempest-AttachVolumeTestJSON-709357402 tempest-AttachVolumeTestJSON-709357402-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 13:03:05.734528 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-8ba064e5-dfb2-494d-9c64-cf06766fe988 tempest-AttachVolumeTestJSON-709357402 tempest-AttachVolumeTestJSON-709357402-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 13:03:05.810155 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: INFO nova.api.openstack.requestlog [None req-8ba064e5-dfb2-494d-9c64-cf06766fe988 tempest-AttachVolumeTestJSON-709357402 tempest-AttachVolumeTestJSON-709357402-project] 10.222.0.49 "POST /compute/v2.1/servers/1b8e1f2f-c109-4413-9d56-33ef0b651f85/action" status: 200 len: 35705 microversion: 2.1 time: 0.089811 Dec 14 13:03:05.813337 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: [pid: 116064|app: 0|req: 376/773] 10.222.0.49 () {60 vars in 1277 bytes} [Tue Dec 14 13:03:05 2021] POST /compute/v2.1/servers/1b8e1f2f-c109-4413-9d56-33ef0b651f85/action => generated 35705 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 14 13:03:05.846295 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.api.openstack.wsgi [None req-8cdec58e-6714-452b-bc0d-62562faa008e tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116063) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 14 13:03:05.847409 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.compute.api [None req-8cdec58e-6714-452b-bc0d-62562faa008e tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] [instance: 9b3b44a7-7c20-473c-841c-318e471fc6cd] Fetching instance by UUID {{(pid=116063) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 13:03:05.854869 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-8cdec58e-6714-452b-bc0d-62562faa008e tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 13:03:05.855661 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-8cdec58e-6714-452b-bc0d-62562faa008e tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 13:03:05.856654 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-8cdec58e-6714-452b-bc0d-62562faa008e tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 13:03:05.857303 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-8cdec58e-6714-452b-bc0d-62562faa008e tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 13:03:05.933186 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: INFO nova.api.openstack.requestlog [None req-8cdec58e-6714-452b-bc0d-62562faa008e tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] 10.222.0.49 "POST /compute/v2.1/servers/9b3b44a7-7c20-473c-841c-318e471fc6cd/action" status: 200 len: 22674 microversion: 2.20 time: 0.090812 Dec 14 13:03:05.934438 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: [pid: 116063|app: 0|req: 398/774] 10.222.0.49 () {62 vars in 1318 bytes} [Tue Dec 14 13:03:05 2021] POST /compute/v2.1/servers/9b3b44a7-7c20-473c-841c-318e471fc6cd/action => generated 22674 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 14 13:03:06.193175 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.api.openstack.wsgi [None req-19012e1c-5f9f-4385-ac6c-a2766014d87a tempest-TestMinimumBasicScenario-84513626 tempest-TestMinimumBasicScenario-84513626-project] Action: 'create', calling method: .version_select at 0x7f2ace2dd790>, body: {"keypair": {"name": "tempest-TestMinimumBasicScenario-1545478889"}} {{(pid=116064) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 14 13:03:06.208224 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.quota [None req-19012e1c-5f9f-4385-ac6c-a2766014d87a tempest-TestMinimumBasicScenario-84513626 tempest-TestMinimumBasicScenario-84513626-project] Getting quotas for project 8bcb503e37b2449484c788574e4c88f0. Resources: {'key_pairs'} {{(pid=116064) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 14 13:03:06.212520 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.quota [None req-19012e1c-5f9f-4385-ac6c-a2766014d87a tempest-TestMinimumBasicScenario-84513626 tempest-TestMinimumBasicScenario-84513626-project] Getting quotas for user edf65e37b42d40b28c4e90bd92987016 and project 8bcb503e37b2449484c788574e4c88f0. Resources: {'key_pairs'} {{(pid=116064) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 14 13:03:06.328026 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.quota [None req-19012e1c-5f9f-4385-ac6c-a2766014d87a tempest-TestMinimumBasicScenario-84513626 tempest-TestMinimumBasicScenario-84513626-project] Getting quotas for project 8bcb503e37b2449484c788574e4c88f0. Resources: {'key_pairs'} {{(pid=116064) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 14 13:03:06.332072 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.quota [None req-19012e1c-5f9f-4385-ac6c-a2766014d87a tempest-TestMinimumBasicScenario-84513626 tempest-TestMinimumBasicScenario-84513626-project] Getting quotas for user edf65e37b42d40b28c4e90bd92987016 and project 8bcb503e37b2449484c788574e4c88f0. Resources: {'key_pairs'} {{(pid=116064) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 14 13:03:06.345856 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: INFO nova.api.openstack.requestlog [None req-19012e1c-5f9f-4385-ac6c-a2766014d87a tempest-TestMinimumBasicScenario-84513626 tempest-TestMinimumBasicScenario-84513626-project] 10.222.0.49 "POST /compute/v2.1/os-keypairs" status: 200 len: 2322 microversion: 2.1 time: 0.156811 Dec 14 13:03:06.346440 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: [pid: 116064|app: 0|req: 377/775] 10.222.0.49 () {60 vars in 1157 bytes} [Tue Dec 14 13:03:06 2021] POST /compute/v2.1/os-keypairs => generated 2322 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 14 13:03:06.394442 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.api.openstack.wsgi [None req-f5c5fb92-9f95-4f0e-94cd-0732147e2959 tempest-TestMinimumBasicScenario-84513626 tempest-TestMinimumBasicScenario-84513626-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestMinimumBasicScenario-server-1119965483", "imageRef": "a2129cbf-0162-4073-9e20-bc704628fe2e", "flavorRef": "452", "key_name": "tempest-TestMinimumBasicScenario-1545478889", "networks": [{"uuid": "307f40e5-9e68-482b-a9bd-285dbfdfbe49"}]}} {{(pid=116063) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 14 13:03:06.567895 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.network.neutron [None req-f5c5fb92-9f95-4f0e-94cd-0732147e2959 tempest-TestMinimumBasicScenario-84513626 tempest-TestMinimumBasicScenario-84513626-project] validate_networks() for [('307f40e5-9e68-482b-a9bd-285dbfdfbe49', None, None, None, None, None)] {{(pid=116063) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Dec 14 13:03:06.823446 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.api.openstack.wsgi [None req-025871d5-4325-4a4d-875b-0f8c1c55fa9b tempest-AttachVolumeTestJSON-709357402 tempest-AttachVolumeTestJSON-709357402-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116064) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 14 13:03:06.824469 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.compute.api [None req-025871d5-4325-4a4d-875b-0f8c1c55fa9b tempest-AttachVolumeTestJSON-709357402 tempest-AttachVolumeTestJSON-709357402-project] [instance: 1b8e1f2f-c109-4413-9d56-33ef0b651f85] Fetching instance by UUID {{(pid=116064) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 13:03:06.831043 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-025871d5-4325-4a4d-875b-0f8c1c55fa9b tempest-AttachVolumeTestJSON-709357402 tempest-AttachVolumeTestJSON-709357402-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 13:03:06.831466 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-025871d5-4325-4a4d-875b-0f8c1c55fa9b tempest-AttachVolumeTestJSON-709357402 tempest-AttachVolumeTestJSON-709357402-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 13:03:06.832406 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-025871d5-4325-4a4d-875b-0f8c1c55fa9b tempest-AttachVolumeTestJSON-709357402 tempest-AttachVolumeTestJSON-709357402-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 13:03:06.832705 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-025871d5-4325-4a4d-875b-0f8c1c55fa9b tempest-AttachVolumeTestJSON-709357402 tempest-AttachVolumeTestJSON-709357402-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 13:03:06.912036 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: INFO nova.api.openstack.requestlog [None req-025871d5-4325-4a4d-875b-0f8c1c55fa9b tempest-AttachVolumeTestJSON-709357402 tempest-AttachVolumeTestJSON-709357402-project] 10.222.0.49 "POST /compute/v2.1/servers/1b8e1f2f-c109-4413-9d56-33ef0b651f85/action" status: 200 len: 37057 microversion: 2.1 time: 0.092750 Dec 14 13:03:06.916688 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: [pid: 116064|app: 0|req: 378/776] 10.222.0.49 () {60 vars in 1277 bytes} [Tue Dec 14 13:03:06 2021] POST /compute/v2.1/servers/1b8e1f2f-c109-4413-9d56-33ef0b651f85/action => generated 37057 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 14 13:03:06.945510 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.api.openstack.wsgi [None req-0689dfab-10fe-400e-8e23-3f8b4073b04c tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116064) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 14 13:03:06.946518 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.compute.api [None req-0689dfab-10fe-400e-8e23-3f8b4073b04c tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] [instance: 9b3b44a7-7c20-473c-841c-318e471fc6cd] Fetching instance by UUID {{(pid=116064) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 13:03:06.953632 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-0689dfab-10fe-400e-8e23-3f8b4073b04c tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 13:03:06.954079 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-0689dfab-10fe-400e-8e23-3f8b4073b04c tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 13:03:06.954837 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-0689dfab-10fe-400e-8e23-3f8b4073b04c tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 13:03:06.955278 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-0689dfab-10fe-400e-8e23-3f8b4073b04c tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 13:03:07.026817 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: INFO nova.api.openstack.requestlog [None req-0689dfab-10fe-400e-8e23-3f8b4073b04c tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] 10.222.0.49 "POST /compute/v2.1/servers/9b3b44a7-7c20-473c-841c-318e471fc6cd/action" status: 200 len: 23812 microversion: 2.20 time: 0.085735 Dec 14 13:03:07.028042 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: [pid: 116064|app: 0|req: 379/777] 10.222.0.49 () {62 vars in 1318 bytes} [Tue Dec 14 13:03:06 2021] POST /compute/v2.1/servers/9b3b44a7-7c20-473c-841c-318e471fc6cd/action => generated 23812 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 14 13:03:07.039507 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.virt.hardware [None req-f5c5fb92-9f95-4f0e-94cd-0732147e2959 tempest-TestMinimumBasicScenario-84513626 tempest-TestMinimumBasicScenario-84513626-project] Flavor limits 0:0:0 {{(pid=116063) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Dec 14 13:03:07.039985 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.virt.hardware [None req-f5c5fb92-9f95-4f0e-94cd-0732147e2959 tempest-TestMinimumBasicScenario-84513626 tempest-TestMinimumBasicScenario-84513626-project] Image limits 0:0:0 {{(pid=116063) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Dec 14 13:03:07.040371 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.virt.hardware [None req-f5c5fb92-9f95-4f0e-94cd-0732147e2959 tempest-TestMinimumBasicScenario-84513626 tempest-TestMinimumBasicScenario-84513626-project] Flavor pref 0:0:0 {{(pid=116063) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Dec 14 13:03:07.040776 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.virt.hardware [None req-f5c5fb92-9f95-4f0e-94cd-0732147e2959 tempest-TestMinimumBasicScenario-84513626 tempest-TestMinimumBasicScenario-84513626-project] Image pref 0:0:0 {{(pid=116063) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Dec 14 13:03:07.041209 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.virt.hardware [None req-f5c5fb92-9f95-4f0e-94cd-0732147e2959 tempest-TestMinimumBasicScenario-84513626 tempest-TestMinimumBasicScenario-84513626-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=116063) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Dec 14 13:03:07.051059 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-f5c5fb92-9f95-4f0e-94cd-0732147e2959 tempest-TestMinimumBasicScenario-84513626 tempest-TestMinimumBasicScenario-84513626-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 13:03:07.051491 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-f5c5fb92-9f95-4f0e-94cd-0732147e2959 tempest-TestMinimumBasicScenario-84513626 tempest-TestMinimumBasicScenario-84513626-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 13:03:07.052285 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-f5c5fb92-9f95-4f0e-94cd-0732147e2959 tempest-TestMinimumBasicScenario-84513626 tempest-TestMinimumBasicScenario-84513626-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 13:03:07.052706 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-f5c5fb92-9f95-4f0e-94cd-0732147e2959 tempest-TestMinimumBasicScenario-84513626 tempest-TestMinimumBasicScenario-84513626-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 13:03:07.069935 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.quota [None req-f5c5fb92-9f95-4f0e-94cd-0732147e2959 tempest-TestMinimumBasicScenario-84513626 tempest-TestMinimumBasicScenario-84513626-project] Getting quotas for project 8bcb503e37b2449484c788574e4c88f0. Resources: {'cores', 'instances', 'ram'} {{(pid=116063) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 14 13:03:07.074335 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.quota [None req-f5c5fb92-9f95-4f0e-94cd-0732147e2959 tempest-TestMinimumBasicScenario-84513626 tempest-TestMinimumBasicScenario-84513626-project] Getting quotas for user edf65e37b42d40b28c4e90bd92987016 and project 8bcb503e37b2449484c788574e4c88f0. Resources: {'cores', 'instances', 'ram'} {{(pid=116063) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 14 13:03:07.086184 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.compute.api [None req-f5c5fb92-9f95-4f0e-94cd-0732147e2959 tempest-TestMinimumBasicScenario-84513626 tempest-TestMinimumBasicScenario-84513626-project] Going to run 1 instances... {{(pid=116063) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Dec 14 13:03:07.088611 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.compute.api [None req-f5c5fb92-9f95-4f0e-94cd-0732147e2959 tempest-TestMinimumBasicScenario-84513626 tempest-TestMinimumBasicScenario-84513626-project] [instance: dd367814-45bc-4808-b2de-d54f79eb7933] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='a2129cbf-0162-4073-9e20-bc704628fe2e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=116063) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Dec 14 13:03:07.132246 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: INFO nova.api.openstack.requestlog [None req-f5c5fb92-9f95-4f0e-94cd-0732147e2959 tempest-TestMinimumBasicScenario-84513626 tempest-TestMinimumBasicScenario-84513626-project] 10.222.0.49 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.742046 Dec 14 13:03:07.132913 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: [pid: 116063|app: 0|req: 399/778] 10.222.0.49 () {60 vars in 1146 bytes} [Tue Dec 14 13:03:06 2021] POST /compute/v2.1/servers => generated 380 bytes in 743 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Dec 14 13:03:07.143165 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.api.openstack.wsgi [None req-38945a97-558c-455d-9cb8-84bb25631d68 tempest-TestMinimumBasicScenario-84513626 tempest-TestMinimumBasicScenario-84513626-project] Calling method '>' {{(pid=116064) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 13:03:07.143849 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.compute.api [None req-38945a97-558c-455d-9cb8-84bb25631d68 tempest-TestMinimumBasicScenario-84513626 tempest-TestMinimumBasicScenario-84513626-project] [instance: dd367814-45bc-4808-b2de-d54f79eb7933] Fetching instance by UUID {{(pid=116064) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 13:03:07.247728 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.policy [None req-38945a97-558c-455d-9cb8-84bb25631d68 tempest-TestMinimumBasicScenario-84513626 tempest-TestMinimumBasicScenario-84513626-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edf65e37b42d40b28c4e90bd92987016', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bcb503e37b2449484c788574e4c88f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116064) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 13:03:07.254354 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: INFO nova.api.openstack.requestlog [None req-38945a97-558c-455d-9cb8-84bb25631d68 tempest-TestMinimumBasicScenario-84513626 tempest-TestMinimumBasicScenario-84513626-project] 10.222.0.49 "GET /compute/v2.1/servers/dd367814-45bc-4808-b2de-d54f79eb7933" status: 200 len: 1259 microversion: 2.1 time: 0.115170 Dec 14 13:03:07.254930 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: [pid: 116064|app: 0|req: 380/779] 10.222.0.49 () {58 vars in 1235 bytes} [Tue Dec 14 13:03:07 2021] GET /compute/v2.1/servers/dd367814-45bc-4808-b2de-d54f79eb7933 => generated 1259 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 14 13:03:07.924626 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.api.openstack.wsgi [None req-1015ce98-569f-44b6-aba3-bc88e245fc90 tempest-AttachVolumeTestJSON-709357402 tempest-AttachVolumeTestJSON-709357402-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116063) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 14 13:03:07.925636 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.compute.api [None req-1015ce98-569f-44b6-aba3-bc88e245fc90 tempest-AttachVolumeTestJSON-709357402 tempest-AttachVolumeTestJSON-709357402-project] [instance: 1b8e1f2f-c109-4413-9d56-33ef0b651f85] Fetching instance by UUID {{(pid=116063) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 13:03:07.932192 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-1015ce98-569f-44b6-aba3-bc88e245fc90 tempest-AttachVolumeTestJSON-709357402 tempest-AttachVolumeTestJSON-709357402-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 13:03:07.932642 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-1015ce98-569f-44b6-aba3-bc88e245fc90 tempest-AttachVolumeTestJSON-709357402 tempest-AttachVolumeTestJSON-709357402-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 13:03:07.933457 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-1015ce98-569f-44b6-aba3-bc88e245fc90 tempest-AttachVolumeTestJSON-709357402 tempest-AttachVolumeTestJSON-709357402-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 13:03:07.933893 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-1015ce98-569f-44b6-aba3-bc88e245fc90 tempest-AttachVolumeTestJSON-709357402 tempest-AttachVolumeTestJSON-709357402-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 13:03:08.010996 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: INFO nova.api.openstack.requestlog [None req-1015ce98-569f-44b6-aba3-bc88e245fc90 tempest-AttachVolumeTestJSON-709357402 tempest-AttachVolumeTestJSON-709357402-project] 10.222.0.49 "POST /compute/v2.1/servers/1b8e1f2f-c109-4413-9d56-33ef0b651f85/action" status: 200 len: 38178 microversion: 2.1 time: 0.090347 Dec 14 13:03:08.011854 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: [pid: 116063|app: 0|req: 400/780] 10.222.0.49 () {60 vars in 1277 bytes} [Tue Dec 14 13:03:07 2021] POST /compute/v2.1/servers/1b8e1f2f-c109-4413-9d56-33ef0b651f85/action => generated 38178 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 14 13:03:08.039987 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.api.openstack.wsgi [None req-2a4416c8-f328-4b37-b133-d73472bfc3a7 tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116064) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 14 13:03:08.040962 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.compute.api [None req-2a4416c8-f328-4b37-b133-d73472bfc3a7 tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] [instance: 9b3b44a7-7c20-473c-841c-318e471fc6cd] Fetching instance by UUID {{(pid=116064) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 13:03:08.048357 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-2a4416c8-f328-4b37-b133-d73472bfc3a7 tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 13:03:08.048812 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-2a4416c8-f328-4b37-b133-d73472bfc3a7 tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 13:03:08.049638 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-2a4416c8-f328-4b37-b133-d73472bfc3a7 tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 13:03:08.050077 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-2a4416c8-f328-4b37-b133-d73472bfc3a7 tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 13:03:08.120622 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: INFO nova.api.openstack.requestlog [None req-2a4416c8-f328-4b37-b133-d73472bfc3a7 tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] 10.222.0.49 "POST /compute/v2.1/servers/9b3b44a7-7c20-473c-841c-318e471fc6cd/action" status: 200 len: 25346 microversion: 2.20 time: 0.085288 Dec 14 13:03:08.121314 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: [pid: 116064|app: 0|req: 381/781] 10.222.0.49 () {62 vars in 1318 bytes} [Tue Dec 14 13:03:08 2021] POST /compute/v2.1/servers/9b3b44a7-7c20-473c-841c-318e471fc6cd/action => generated 25346 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 14 13:03:08.271566 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.api.openstack.wsgi [None req-c643ccd0-96f1-4952-8d97-e2aa7dba9ad0 tempest-TestMinimumBasicScenario-84513626 tempest-TestMinimumBasicScenario-84513626-project] Calling method '>' {{(pid=116063) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 13:03:08.272903 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.compute.api [None req-c643ccd0-96f1-4952-8d97-e2aa7dba9ad0 tempest-TestMinimumBasicScenario-84513626 tempest-TestMinimumBasicScenario-84513626-project] [instance: dd367814-45bc-4808-b2de-d54f79eb7933] Fetching instance by UUID {{(pid=116063) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 13:03:08.281011 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-c643ccd0-96f1-4952-8d97-e2aa7dba9ad0 tempest-TestMinimumBasicScenario-84513626 tempest-TestMinimumBasicScenario-84513626-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 13:03:08.281755 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-c643ccd0-96f1-4952-8d97-e2aa7dba9ad0 tempest-TestMinimumBasicScenario-84513626 tempest-TestMinimumBasicScenario-84513626-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 13:03:08.282627 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-c643ccd0-96f1-4952-8d97-e2aa7dba9ad0 tempest-TestMinimumBasicScenario-84513626 tempest-TestMinimumBasicScenario-84513626-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 13:03:08.283068 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-c643ccd0-96f1-4952-8d97-e2aa7dba9ad0 tempest-TestMinimumBasicScenario-84513626 tempest-TestMinimumBasicScenario-84513626-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 13:03:08.349996 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.policy [None req-c643ccd0-96f1-4952-8d97-e2aa7dba9ad0 tempest-TestMinimumBasicScenario-84513626 tempest-TestMinimumBasicScenario-84513626-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edf65e37b42d40b28c4e90bd92987016', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bcb503e37b2449484c788574e4c88f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116063) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 13:03:08.362109 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: INFO nova.api.openstack.requestlog [None req-c643ccd0-96f1-4952-8d97-e2aa7dba9ad0 tempest-TestMinimumBasicScenario-84513626 tempest-TestMinimumBasicScenario-84513626-project] 10.222.0.49 "GET /compute/v2.1/servers/dd367814-45bc-4808-b2de-d54f79eb7933" status: 200 len: 1319 microversion: 2.1 time: 0.094860 Dec 14 13:03:08.362820 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: [pid: 116063|app: 0|req: 401/782] 10.222.0.49 () {58 vars in 1235 bytes} [Tue Dec 14 13:03:08 2021] GET /compute/v2.1/servers/dd367814-45bc-4808-b2de-d54f79eb7933 => generated 1319 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 14 13:03:09.024316 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.api.openstack.wsgi [None req-893bb71c-0453-44fe-8478-b6d0815f5187 tempest-AttachVolumeTestJSON-709357402 tempest-AttachVolumeTestJSON-709357402-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116064) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 14 13:03:09.025789 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.compute.api [None req-893bb71c-0453-44fe-8478-b6d0815f5187 tempest-AttachVolumeTestJSON-709357402 tempest-AttachVolumeTestJSON-709357402-project] [instance: 1b8e1f2f-c109-4413-9d56-33ef0b651f85] Fetching instance by UUID {{(pid=116064) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 13:03:09.033527 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-893bb71c-0453-44fe-8478-b6d0815f5187 tempest-AttachVolumeTestJSON-709357402 tempest-AttachVolumeTestJSON-709357402-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 13:03:09.033980 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-893bb71c-0453-44fe-8478-b6d0815f5187 tempest-AttachVolumeTestJSON-709357402 tempest-AttachVolumeTestJSON-709357402-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 13:03:09.034784 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-893bb71c-0453-44fe-8478-b6d0815f5187 tempest-AttachVolumeTestJSON-709357402 tempest-AttachVolumeTestJSON-709357402-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 13:03:09.035220 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-893bb71c-0453-44fe-8478-b6d0815f5187 tempest-AttachVolumeTestJSON-709357402 tempest-AttachVolumeTestJSON-709357402-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 13:03:09.132312 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.api.openstack.wsgi [None req-79a80d95-73c6-4e97-a6e7-94a72e994444 tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116063) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 14 13:03:09.133385 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.compute.api [None req-79a80d95-73c6-4e97-a6e7-94a72e994444 tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] [instance: 9b3b44a7-7c20-473c-841c-318e471fc6cd] Fetching instance by UUID {{(pid=116063) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 13:03:09.152154 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-79a80d95-73c6-4e97-a6e7-94a72e994444 tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 13:03:09.152606 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-79a80d95-73c6-4e97-a6e7-94a72e994444 tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 13:03:09.153844 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-79a80d95-73c6-4e97-a6e7-94a72e994444 tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 13:03:09.154275 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-79a80d95-73c6-4e97-a6e7-94a72e994444 tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 13:03:21.194953 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: INFO nova.api.openstack.requestlog [None req-893bb71c-0453-44fe-8478-b6d0815f5187 tempest-AttachVolumeTestJSON-709357402 tempest-AttachVolumeTestJSON-709357402-project] 10.222.0.49 "POST /compute/v2.1/servers/1b8e1f2f-c109-4413-9d56-33ef0b651f85/action" status: 200 len: 38307 microversion: 2.1 time: 12.174667 Dec 14 13:03:21.195652 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: [pid: 116064|app: 0|req: 382/783] 10.222.0.49 () {60 vars in 1277 bytes} [Tue Dec 14 13:03:09 2021] POST /compute/v2.1/servers/1b8e1f2f-c109-4413-9d56-33ef0b651f85/action => generated 38307 bytes in 12177 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 14 13:03:21.200517 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.api.openstack.wsgi [None req-9c0072c8-8885-48ef-ba55-697bd3b27785 tempest-TestMinimumBasicScenario-84513626 tempest-TestMinimumBasicScenario-84513626-project] Calling method '>' {{(pid=116064) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 13:03:21.201387 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.compute.api [None req-9c0072c8-8885-48ef-ba55-697bd3b27785 tempest-TestMinimumBasicScenario-84513626 tempest-TestMinimumBasicScenario-84513626-project] [instance: dd367814-45bc-4808-b2de-d54f79eb7933] Fetching instance by UUID {{(pid=116064) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 13:03:21.210479 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-9c0072c8-8885-48ef-ba55-697bd3b27785 tempest-TestMinimumBasicScenario-84513626 tempest-TestMinimumBasicScenario-84513626-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 13:03:21.210939 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-9c0072c8-8885-48ef-ba55-697bd3b27785 tempest-TestMinimumBasicScenario-84513626 tempest-TestMinimumBasicScenario-84513626-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 13:03:21.211881 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-9c0072c8-8885-48ef-ba55-697bd3b27785 tempest-TestMinimumBasicScenario-84513626 tempest-TestMinimumBasicScenario-84513626-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 13:03:21.212344 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-9c0072c8-8885-48ef-ba55-697bd3b27785 tempest-TestMinimumBasicScenario-84513626 tempest-TestMinimumBasicScenario-84513626-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 13:03:21.216910 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: INFO nova.api.openstack.requestlog [None req-79a80d95-73c6-4e97-a6e7-94a72e994444 tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] 10.222.0.49 "POST /compute/v2.1/servers/9b3b44a7-7c20-473c-841c-318e471fc6cd/action" status: 200 len: 28493 microversion: 2.20 time: 12.088801 Dec 14 13:03:21.218253 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: [pid: 116063|app: 0|req: 402/784] 10.222.0.49 () {62 vars in 1318 bytes} [Tue Dec 14 13:03:09 2021] POST /compute/v2.1/servers/9b3b44a7-7c20-473c-841c-318e471fc6cd/action => generated 28493 bytes in 12091 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 14 13:03:21.223621 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.api.openstack.wsgi [None req-d5ccd26b-f019-46ac-b9fc-a75c3674a42f tempest-AttachVolumeTestJSON-709357402 tempest-AttachVolumeTestJSON-709357402-project] Calling method '>' {{(pid=116063) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 13:03:21.224198 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.compute.api [None req-d5ccd26b-f019-46ac-b9fc-a75c3674a42f tempest-AttachVolumeTestJSON-709357402 tempest-AttachVolumeTestJSON-709357402-project] [instance: 1b8e1f2f-c109-4413-9d56-33ef0b651f85] Fetching instance by UUID {{(pid=116063) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 13:03:21.231385 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-d5ccd26b-f019-46ac-b9fc-a75c3674a42f tempest-AttachVolumeTestJSON-709357402 tempest-AttachVolumeTestJSON-709357402-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 13:03:21.231968 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-d5ccd26b-f019-46ac-b9fc-a75c3674a42f tempest-AttachVolumeTestJSON-709357402 tempest-AttachVolumeTestJSON-709357402-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 13:03:21.232789 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-d5ccd26b-f019-46ac-b9fc-a75c3674a42f tempest-AttachVolumeTestJSON-709357402 tempest-AttachVolumeTestJSON-709357402-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 13:03:21.233240 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-d5ccd26b-f019-46ac-b9fc-a75c3674a42f tempest-AttachVolumeTestJSON-709357402 tempest-AttachVolumeTestJSON-709357402-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 13:03:21.257679 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: INFO nova.api.openstack.requestlog [None req-d5ccd26b-f019-46ac-b9fc-a75c3674a42f tempest-AttachVolumeTestJSON-709357402 tempest-AttachVolumeTestJSON-709357402-project] 10.222.0.49 "GET /compute/v2.1/servers/1b8e1f2f-c109-4413-9d56-33ef0b651f85/ips" status: 200 len: 145 microversion: 2.1 time: 0.038065 Dec 14 13:03:21.274834 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: [pid: 116063|app: 0|req: 403/785] 10.222.0.49 () {58 vars in 1247 bytes} [Tue Dec 14 13:03:21 2021] GET /compute/v2.1/servers/1b8e1f2f-c109-4413-9d56-33ef0b651f85/ips => generated 145 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 14 13:03:21.359692 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.policy [None req-9c0072c8-8885-48ef-ba55-697bd3b27785 tempest-TestMinimumBasicScenario-84513626 tempest-TestMinimumBasicScenario-84513626-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edf65e37b42d40b28c4e90bd92987016', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bcb503e37b2449484c788574e4c88f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116064) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 13:03:21.368691 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: INFO nova.api.openstack.requestlog [None req-9c0072c8-8885-48ef-ba55-697bd3b27785 tempest-TestMinimumBasicScenario-84513626 tempest-TestMinimumBasicScenario-84513626-project] 10.222.0.49 "GET /compute/v2.1/servers/dd367814-45bc-4808-b2de-d54f79eb7933" status: 200 len: 1359 microversion: 2.1 time: 0.171880 Dec 14 13:03:21.369290 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: [pid: 116064|app: 0|req: 383/786] 10.222.0.49 () {58 vars in 1235 bytes} [Tue Dec 14 13:03:21 2021] GET /compute/v2.1/servers/dd367814-45bc-4808-b2de-d54f79eb7933 => generated 1359 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 14 13:03:21.888079 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.api.openstack.wsgi [req-c4b32852-4087-477f-8373-015a6d70f1e0 req-9adc4b71-d5c2-479c-9aaf-1b79b3f2805a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "dd367814-45bc-4808-b2de-d54f79eb7933", "tag": "fee608e1-5f95-4491-9016-8fcb3872f581"}]} {{(pid=116063) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 14 13:03:21.889667 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 14 13:03:21.889667 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: warnings.warn(msg) Dec 14 13:03:21.898005 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [req-c4b32852-4087-477f-8373-015a6d70f1e0 req-9adc4b71-d5c2-479c-9aaf-1b79b3f2805a service nova] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 13:03:21.898764 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [req-c4b32852-4087-477f-8373-015a6d70f1e0 req-9adc4b71-d5c2-479c-9aaf-1b79b3f2805a service nova] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 13:03:21.913677 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: INFO nova.api.openstack.compute.server_external_events [req-c4b32852-4087-477f-8373-015a6d70f1e0 req-9adc4b71-d5c2-479c-9aaf-1b79b3f2805a service nova] Creating event network-changed:fee608e1-5f95-4491-9016-8fcb3872f581 for instance dd367814-45bc-4808-b2de-d54f79eb7933 on hv-cinder-78447 Dec 14 13:03:21.920535 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: INFO nova.api.openstack.requestlog [req-c4b32852-4087-477f-8373-015a6d70f1e0 req-9adc4b71-d5c2-479c-9aaf-1b79b3f2805a service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038229 Dec 14 13:03:21.921601 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: [pid: 116063|app: 0|req: 404/787] 10.222.0.49 () {64 vars in 1317 bytes} [Tue Dec 14 13:03:21 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 14 13:03:22.338382 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.api.openstack.wsgi [None req-4dba0a0a-7cdc-4f99-aa11-f28e7774d0cb tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116064) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 14 13:03:22.339373 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.compute.api [None req-4dba0a0a-7cdc-4f99-aa11-f28e7774d0cb tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] [instance: 9b3b44a7-7c20-473c-841c-318e471fc6cd] Fetching instance by UUID {{(pid=116064) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 13:03:22.345915 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-4dba0a0a-7cdc-4f99-aa11-f28e7774d0cb tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 13:03:22.346490 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-4dba0a0a-7cdc-4f99-aa11-f28e7774d0cb tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 13:03:22.347375 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-4dba0a0a-7cdc-4f99-aa11-f28e7774d0cb tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 13:03:22.348034 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-4dba0a0a-7cdc-4f99-aa11-f28e7774d0cb tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 13:03:22.386761 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.api.openstack.wsgi [None req-dfb82ea5-fd15-462d-8a00-1748c02b05d9 tempest-TestMinimumBasicScenario-84513626 tempest-TestMinimumBasicScenario-84513626-project] Calling method '>' {{(pid=116063) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 13:03:22.387529 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.compute.api [None req-dfb82ea5-fd15-462d-8a00-1748c02b05d9 tempest-TestMinimumBasicScenario-84513626 tempest-TestMinimumBasicScenario-84513626-project] [instance: dd367814-45bc-4808-b2de-d54f79eb7933] Fetching instance by UUID {{(pid=116063) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 13:03:22.394944 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-dfb82ea5-fd15-462d-8a00-1748c02b05d9 tempest-TestMinimumBasicScenario-84513626 tempest-TestMinimumBasicScenario-84513626-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 13:03:22.395396 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-dfb82ea5-fd15-462d-8a00-1748c02b05d9 tempest-TestMinimumBasicScenario-84513626 tempest-TestMinimumBasicScenario-84513626-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 13:03:22.396196 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-dfb82ea5-fd15-462d-8a00-1748c02b05d9 tempest-TestMinimumBasicScenario-84513626 tempest-TestMinimumBasicScenario-84513626-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 13:03:22.396629 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-dfb82ea5-fd15-462d-8a00-1748c02b05d9 tempest-TestMinimumBasicScenario-84513626 tempest-TestMinimumBasicScenario-84513626-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 13:03:22.428840 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: INFO nova.api.openstack.requestlog [None req-4dba0a0a-7cdc-4f99-aa11-f28e7774d0cb tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] 10.222.0.49 "POST /compute/v2.1/servers/9b3b44a7-7c20-473c-841c-318e471fc6cd/action" status: 200 len: 28661 microversion: 2.20 time: 0.203277 Dec 14 13:03:22.430612 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: [pid: 116064|app: 0|req: 384/788] 10.222.0.49 () {62 vars in 1318 bytes} [Tue Dec 14 13:03:22 2021] POST /compute/v2.1/servers/9b3b44a7-7c20-473c-841c-318e471fc6cd/action => generated 28661 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 14 13:03:22.573917 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.policy [None req-dfb82ea5-fd15-462d-8a00-1748c02b05d9 tempest-TestMinimumBasicScenario-84513626 tempest-TestMinimumBasicScenario-84513626-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edf65e37b42d40b28c4e90bd92987016', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bcb503e37b2449484c788574e4c88f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116063) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 13:03:22.581899 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: INFO nova.api.openstack.requestlog [None req-dfb82ea5-fd15-462d-8a00-1748c02b05d9 tempest-TestMinimumBasicScenario-84513626 tempest-TestMinimumBasicScenario-84513626-project] 10.222.0.49 "GET /compute/v2.1/servers/dd367814-45bc-4808-b2de-d54f79eb7933" status: 200 len: 1359 microversion: 2.1 time: 0.199749 Dec 14 13:03:22.582682 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: [pid: 116063|app: 0|req: 405/789] 10.222.0.49 () {58 vars in 1235 bytes} [Tue Dec 14 13:03:22 2021] GET /compute/v2.1/servers/dd367814-45bc-4808-b2de-d54f79eb7933 => generated 1359 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 14 13:03:23.445960 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.api.openstack.wsgi [None req-cfab5873-9435-4d65-bfe6-a428a237a843 tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116064) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 14 13:03:23.447612 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.compute.api [None req-cfab5873-9435-4d65-bfe6-a428a237a843 tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] [instance: 9b3b44a7-7c20-473c-841c-318e471fc6cd] Fetching instance by UUID {{(pid=116064) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 13:03:23.459142 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-cfab5873-9435-4d65-bfe6-a428a237a843 tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 13:03:23.459893 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-cfab5873-9435-4d65-bfe6-a428a237a843 tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 13:03:23.461209 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-cfab5873-9435-4d65-bfe6-a428a237a843 tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 13:03:23.461929 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-cfab5873-9435-4d65-bfe6-a428a237a843 tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 13:03:23.532580 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: INFO nova.api.openstack.requestlog [None req-cfab5873-9435-4d65-bfe6-a428a237a843 tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] 10.222.0.49 "POST /compute/v2.1/servers/9b3b44a7-7c20-473c-841c-318e471fc6cd/action" status: 200 len: 28661 microversion: 2.20 time: 0.092952 Dec 14 13:03:23.534374 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: [pid: 116064|app: 0|req: 385/790] 10.222.0.49 () {62 vars in 1318 bytes} [Tue Dec 14 13:03:23 2021] POST /compute/v2.1/servers/9b3b44a7-7c20-473c-841c-318e471fc6cd/action => generated 28661 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 14 13:03:23.586682 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.api.openstack.wsgi [None req-299e5b8a-5248-4181-b3c5-51409cc7bd2f tempest-AttachVolumeTestJSON-709357402 tempest-AttachVolumeTestJSON-709357402-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "27ca29c4-ea1b-4293-91bb-ffa773ee1e44"}} {{(pid=116063) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 14 13:03:23.587779 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.compute.api [None req-299e5b8a-5248-4181-b3c5-51409cc7bd2f tempest-AttachVolumeTestJSON-709357402 tempest-AttachVolumeTestJSON-709357402-project] [instance: 1b8e1f2f-c109-4413-9d56-33ef0b651f85] Fetching instance by UUID {{(pid=116063) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 13:03:23.594611 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-299e5b8a-5248-4181-b3c5-51409cc7bd2f tempest-AttachVolumeTestJSON-709357402 tempest-AttachVolumeTestJSON-709357402-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 13:03:23.595059 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-299e5b8a-5248-4181-b3c5-51409cc7bd2f tempest-AttachVolumeTestJSON-709357402 tempest-AttachVolumeTestJSON-709357402-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 13:03:23.595852 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-299e5b8a-5248-4181-b3c5-51409cc7bd2f tempest-AttachVolumeTestJSON-709357402 tempest-AttachVolumeTestJSON-709357402-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 13:03:23.596291 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-299e5b8a-5248-4181-b3c5-51409cc7bd2f tempest-AttachVolumeTestJSON-709357402 tempest-AttachVolumeTestJSON-709357402-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 13:03:23.599776 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.api.openstack.wsgi [None req-c6e3c766-4f32-41c8-bff0-35158e8f4824 tempest-TestMinimumBasicScenario-84513626 tempest-TestMinimumBasicScenario-84513626-project] Calling method '>' {{(pid=116064) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 13:03:23.600493 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.compute.api [None req-c6e3c766-4f32-41c8-bff0-35158e8f4824 tempest-TestMinimumBasicScenario-84513626 tempest-TestMinimumBasicScenario-84513626-project] [instance: dd367814-45bc-4808-b2de-d54f79eb7933] Fetching instance by UUID {{(pid=116064) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 13:03:23.607613 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-c6e3c766-4f32-41c8-bff0-35158e8f4824 tempest-TestMinimumBasicScenario-84513626 tempest-TestMinimumBasicScenario-84513626-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 13:03:23.608060 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-c6e3c766-4f32-41c8-bff0-35158e8f4824 tempest-TestMinimumBasicScenario-84513626 tempest-TestMinimumBasicScenario-84513626-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 13:03:23.608836 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-c6e3c766-4f32-41c8-bff0-35158e8f4824 tempest-TestMinimumBasicScenario-84513626 tempest-TestMinimumBasicScenario-84513626-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 13:03:23.609297 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-c6e3c766-4f32-41c8-bff0-35158e8f4824 tempest-TestMinimumBasicScenario-84513626 tempest-TestMinimumBasicScenario-84513626-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 13:03:23.747713 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.policy [None req-c6e3c766-4f32-41c8-bff0-35158e8f4824 tempest-TestMinimumBasicScenario-84513626 tempest-TestMinimumBasicScenario-84513626-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edf65e37b42d40b28c4e90bd92987016', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bcb503e37b2449484c788574e4c88f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116064) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 13:03:23.755484 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: INFO nova.api.openstack.requestlog [None req-c6e3c766-4f32-41c8-bff0-35158e8f4824 tempest-TestMinimumBasicScenario-84513626 tempest-TestMinimumBasicScenario-84513626-project] 10.222.0.49 "GET /compute/v2.1/servers/dd367814-45bc-4808-b2de-d54f79eb7933" status: 200 len: 1359 microversion: 2.1 time: 0.159771 Dec 14 13:03:23.756251 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: [pid: 116064|app: 0|req: 386/791] 10.222.0.49 () {58 vars in 1235 bytes} [Tue Dec 14 13:03:23 2021] GET /compute/v2.1/servers/dd367814-45bc-4808-b2de-d54f79eb7933 => generated 1359 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 14 13:03:23.841843 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: INFO nova.api.openstack.requestlog [None req-299e5b8a-5248-4181-b3c5-51409cc7bd2f tempest-AttachVolumeTestJSON-709357402 tempest-AttachVolumeTestJSON-709357402-project] 10.222.0.49 "POST /compute/v2.1/servers/1b8e1f2f-c109-4413-9d56-33ef0b651f85/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.258883 Dec 14 13:03:23.842479 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: [pid: 116063|app: 0|req: 406/792] 10.222.0.49 () {60 vars in 1322 bytes} [Tue Dec 14 13:03:23 2021] POST /compute/v2.1/servers/1b8e1f2f-c109-4413-9d56-33ef0b651f85/os-volume_attachments => generated 194 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 14 13:03:24.551750 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.api.openstack.wsgi [None req-807c089b-3ed8-47ca-826c-3d623d3a0198 tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116064) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 14 13:03:24.553273 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.compute.api [None req-807c089b-3ed8-47ca-826c-3d623d3a0198 tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] [instance: 9b3b44a7-7c20-473c-841c-318e471fc6cd] Fetching instance by UUID {{(pid=116064) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 13:03:24.563841 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-807c089b-3ed8-47ca-826c-3d623d3a0198 tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 13:03:24.564606 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-807c089b-3ed8-47ca-826c-3d623d3a0198 tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 13:03:24.565992 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-807c089b-3ed8-47ca-826c-3d623d3a0198 tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 13:03:24.566713 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-807c089b-3ed8-47ca-826c-3d623d3a0198 tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 13:03:24.634572 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: INFO nova.api.openstack.requestlog [None req-807c089b-3ed8-47ca-826c-3d623d3a0198 tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] 10.222.0.49 "POST /compute/v2.1/servers/9b3b44a7-7c20-473c-841c-318e471fc6cd/action" status: 200 len: 28661 microversion: 2.20 time: 0.088958 Dec 14 13:03:24.635301 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: [pid: 116064|app: 0|req: 387/793] 10.222.0.49 () {62 vars in 1318 bytes} [Tue Dec 14 13:03:24 2021] POST /compute/v2.1/servers/9b3b44a7-7c20-473c-841c-318e471fc6cd/action => generated 28661 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 14 13:03:24.784048 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.api.openstack.wsgi [None req-1b2bb4c7-d40d-4a36-b8e2-8aab80136abf tempest-TestMinimumBasicScenario-84513626 tempest-TestMinimumBasicScenario-84513626-project] Calling method '>' {{(pid=116063) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 13:03:24.784747 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.compute.api [None req-1b2bb4c7-d40d-4a36-b8e2-8aab80136abf tempest-TestMinimumBasicScenario-84513626 tempest-TestMinimumBasicScenario-84513626-project] [instance: dd367814-45bc-4808-b2de-d54f79eb7933] Fetching instance by UUID {{(pid=116063) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 13:03:24.794918 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-1b2bb4c7-d40d-4a36-b8e2-8aab80136abf tempest-TestMinimumBasicScenario-84513626 tempest-TestMinimumBasicScenario-84513626-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 13:03:24.795356 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-1b2bb4c7-d40d-4a36-b8e2-8aab80136abf tempest-TestMinimumBasicScenario-84513626 tempest-TestMinimumBasicScenario-84513626-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 13:03:24.796158 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-1b2bb4c7-d40d-4a36-b8e2-8aab80136abf tempest-TestMinimumBasicScenario-84513626 tempest-TestMinimumBasicScenario-84513626-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 13:03:24.796584 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-1b2bb4c7-d40d-4a36-b8e2-8aab80136abf tempest-TestMinimumBasicScenario-84513626 tempest-TestMinimumBasicScenario-84513626-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 13:03:24.940415 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.policy [None req-1b2bb4c7-d40d-4a36-b8e2-8aab80136abf tempest-TestMinimumBasicScenario-84513626 tempest-TestMinimumBasicScenario-84513626-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edf65e37b42d40b28c4e90bd92987016', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bcb503e37b2449484c788574e4c88f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116063) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 13:03:24.948696 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: INFO nova.api.openstack.requestlog [None req-1b2bb4c7-d40d-4a36-b8e2-8aab80136abf tempest-TestMinimumBasicScenario-84513626 tempest-TestMinimumBasicScenario-84513626-project] 10.222.0.49 "GET /compute/v2.1/servers/dd367814-45bc-4808-b2de-d54f79eb7933" status: 200 len: 1359 microversion: 2.1 time: 0.178433 Dec 14 13:03:24.949322 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: [pid: 116063|app: 0|req: 407/794] 10.222.0.49 () {58 vars in 1235 bytes} [Tue Dec 14 13:03:24 2021] GET /compute/v2.1/servers/dd367814-45bc-4808-b2de-d54f79eb7933 => generated 1359 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 14 13:03:25.647829 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.api.openstack.wsgi [None req-e79353fc-7177-4eaa-9a80-05e7a75c1dc1 tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116064) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 14 13:03:25.648942 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.compute.api [None req-e79353fc-7177-4eaa-9a80-05e7a75c1dc1 tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] [instance: 9b3b44a7-7c20-473c-841c-318e471fc6cd] Fetching instance by UUID {{(pid=116064) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 13:03:25.656057 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-e79353fc-7177-4eaa-9a80-05e7a75c1dc1 tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 13:03:25.656518 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-e79353fc-7177-4eaa-9a80-05e7a75c1dc1 tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 13:03:25.657353 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-e79353fc-7177-4eaa-9a80-05e7a75c1dc1 tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 13:03:25.657797 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-e79353fc-7177-4eaa-9a80-05e7a75c1dc1 tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 13:03:25.719960 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: INFO nova.api.openstack.requestlog [None req-e79353fc-7177-4eaa-9a80-05e7a75c1dc1 tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] 10.222.0.49 "POST /compute/v2.1/servers/9b3b44a7-7c20-473c-841c-318e471fc6cd/action" status: 200 len: 28661 microversion: 2.20 time: 0.076270 Dec 14 13:03:25.720641 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: [pid: 116064|app: 0|req: 388/795] 10.222.0.49 () {62 vars in 1318 bytes} [Tue Dec 14 13:03:25 2021] POST /compute/v2.1/servers/9b3b44a7-7c20-473c-841c-318e471fc6cd/action => generated 28661 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 14 13:03:25.967355 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.api.openstack.wsgi [None req-efddc213-b824-4e3f-b4eb-572fe243c206 tempest-TestMinimumBasicScenario-84513626 tempest-TestMinimumBasicScenario-84513626-project] Calling method '>' {{(pid=116063) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 13:03:25.968654 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.compute.api [None req-efddc213-b824-4e3f-b4eb-572fe243c206 tempest-TestMinimumBasicScenario-84513626 tempest-TestMinimumBasicScenario-84513626-project] [instance: dd367814-45bc-4808-b2de-d54f79eb7933] Fetching instance by UUID {{(pid=116063) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 13:03:25.975611 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-efddc213-b824-4e3f-b4eb-572fe243c206 tempest-TestMinimumBasicScenario-84513626 tempest-TestMinimumBasicScenario-84513626-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 13:03:25.976094 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-efddc213-b824-4e3f-b4eb-572fe243c206 tempest-TestMinimumBasicScenario-84513626 tempest-TestMinimumBasicScenario-84513626-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 13:03:25.976886 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-efddc213-b824-4e3f-b4eb-572fe243c206 tempest-TestMinimumBasicScenario-84513626 tempest-TestMinimumBasicScenario-84513626-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 13:03:25.977370 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-efddc213-b824-4e3f-b4eb-572fe243c206 tempest-TestMinimumBasicScenario-84513626 tempest-TestMinimumBasicScenario-84513626-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 13:03:26.111474 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.policy [None req-efddc213-b824-4e3f-b4eb-572fe243c206 tempest-TestMinimumBasicScenario-84513626 tempest-TestMinimumBasicScenario-84513626-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edf65e37b42d40b28c4e90bd92987016', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bcb503e37b2449484c788574e4c88f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116063) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 13:03:26.119631 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: INFO nova.api.openstack.requestlog [None req-efddc213-b824-4e3f-b4eb-572fe243c206 tempest-TestMinimumBasicScenario-84513626 tempest-TestMinimumBasicScenario-84513626-project] 10.222.0.49 "GET /compute/v2.1/servers/dd367814-45bc-4808-b2de-d54f79eb7933" status: 200 len: 1359 microversion: 2.1 time: 0.155966 Dec 14 13:03:26.120172 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: [pid: 116063|app: 0|req: 408/796] 10.222.0.49 () {58 vars in 1235 bytes} [Tue Dec 14 13:03:25 2021] GET /compute/v2.1/servers/dd367814-45bc-4808-b2de-d54f79eb7933 => generated 1359 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 14 13:03:26.736880 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.api.openstack.wsgi [None req-98d69e92-e649-4ac0-b8d3-4e531cca5a11 tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116064) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 14 13:03:26.737900 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.compute.api [None req-98d69e92-e649-4ac0-b8d3-4e531cca5a11 tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] [instance: 9b3b44a7-7c20-473c-841c-318e471fc6cd] Fetching instance by UUID {{(pid=116064) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 13:03:26.745447 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-98d69e92-e649-4ac0-b8d3-4e531cca5a11 tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 13:03:26.745890 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-98d69e92-e649-4ac0-b8d3-4e531cca5a11 tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 13:03:26.746668 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-98d69e92-e649-4ac0-b8d3-4e531cca5a11 tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 13:03:26.747103 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-98d69e92-e649-4ac0-b8d3-4e531cca5a11 tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 13:03:26.824729 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: INFO nova.api.openstack.requestlog [None req-98d69e92-e649-4ac0-b8d3-4e531cca5a11 tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] 10.222.0.49 "POST /compute/v2.1/servers/9b3b44a7-7c20-473c-841c-318e471fc6cd/action" status: 200 len: 30409 microversion: 2.20 time: 0.094636 Dec 14 13:03:26.825409 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: [pid: 116064|app: 0|req: 389/797] 10.222.0.49 () {62 vars in 1318 bytes} [Tue Dec 14 13:03:26 2021] POST /compute/v2.1/servers/9b3b44a7-7c20-473c-841c-318e471fc6cd/action => generated 30409 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 14 13:03:27.140008 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.api.openstack.wsgi [None req-781d1447-8f57-4d61-be67-72be45902b60 tempest-TestMinimumBasicScenario-84513626 tempest-TestMinimumBasicScenario-84513626-project] Calling method '>' {{(pid=116063) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 13:03:27.141079 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.compute.api [None req-781d1447-8f57-4d61-be67-72be45902b60 tempest-TestMinimumBasicScenario-84513626 tempest-TestMinimumBasicScenario-84513626-project] [instance: dd367814-45bc-4808-b2de-d54f79eb7933] Fetching instance by UUID {{(pid=116063) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 13:03:27.151327 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-781d1447-8f57-4d61-be67-72be45902b60 tempest-TestMinimumBasicScenario-84513626 tempest-TestMinimumBasicScenario-84513626-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 13:03:27.152007 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-781d1447-8f57-4d61-be67-72be45902b60 tempest-TestMinimumBasicScenario-84513626 tempest-TestMinimumBasicScenario-84513626-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 13:03:27.153378 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-781d1447-8f57-4d61-be67-72be45902b60 tempest-TestMinimumBasicScenario-84513626 tempest-TestMinimumBasicScenario-84513626-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 13:03:27.154094 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-781d1447-8f57-4d61-be67-72be45902b60 tempest-TestMinimumBasicScenario-84513626 tempest-TestMinimumBasicScenario-84513626-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 13:03:27.290523 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.policy [None req-781d1447-8f57-4d61-be67-72be45902b60 tempest-TestMinimumBasicScenario-84513626 tempest-TestMinimumBasicScenario-84513626-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edf65e37b42d40b28c4e90bd92987016', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bcb503e37b2449484c788574e4c88f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116063) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 13:03:27.302707 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: INFO nova.api.openstack.requestlog [None req-781d1447-8f57-4d61-be67-72be45902b60 tempest-TestMinimumBasicScenario-84513626 tempest-TestMinimumBasicScenario-84513626-project] 10.222.0.49 "GET /compute/v2.1/servers/dd367814-45bc-4808-b2de-d54f79eb7933" status: 200 len: 1359 microversion: 2.1 time: 0.168633 Dec 14 13:03:27.303651 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: [pid: 116063|app: 0|req: 409/798] 10.222.0.49 () {58 vars in 1235 bytes} [Tue Dec 14 13:03:27 2021] GET /compute/v2.1/servers/dd367814-45bc-4808-b2de-d54f79eb7933 => generated 1359 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 14 13:03:27.687051 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.api.openstack.wsgi [req-016a6965-5584-4376-a7aa-c8c7b869f8ac req-f074f810-ddeb-4a2e-a7d0-54777573f9c0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dd367814-45bc-4808-b2de-d54f79eb7933", "name": "network-vif-plugged", "status": "completed", "tag": "fee608e1-5f95-4491-9016-8fcb3872f581"}]} {{(pid=116064) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 14 13:03:27.688621 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 14 13:03:27.688621 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: warnings.warn(msg) Dec 14 13:03:27.697500 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [req-016a6965-5584-4376-a7aa-c8c7b869f8ac req-f074f810-ddeb-4a2e-a7d0-54777573f9c0 service nova] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 13:03:27.697938 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [req-016a6965-5584-4376-a7aa-c8c7b869f8ac req-f074f810-ddeb-4a2e-a7d0-54777573f9c0 service nova] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 13:03:27.710086 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: INFO nova.api.openstack.compute.server_external_events [req-016a6965-5584-4376-a7aa-c8c7b869f8ac req-f074f810-ddeb-4a2e-a7d0-54777573f9c0 service nova] Creating event network-vif-plugged:fee608e1-5f95-4491-9016-8fcb3872f581 for instance dd367814-45bc-4808-b2de-d54f79eb7933 on hv-cinder-78447 Dec 14 13:03:27.714678 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: INFO nova.api.openstack.requestlog [req-016a6965-5584-4376-a7aa-c8c7b869f8ac req-f074f810-ddeb-4a2e-a7d0-54777573f9c0 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031753 Dec 14 13:03:27.715296 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: [pid: 116064|app: 0|req: 390/799] 10.222.0.49 () {64 vars in 1317 bytes} [Tue Dec 14 13:03:27 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 14 13:03:27.836472 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.api.openstack.wsgi [None req-2ecd8b97-fbbc-48a9-a600-3a4f560b63f4 tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116063) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 14 13:03:27.837416 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.compute.api [None req-2ecd8b97-fbbc-48a9-a600-3a4f560b63f4 tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] [instance: 9b3b44a7-7c20-473c-841c-318e471fc6cd] Fetching instance by UUID {{(pid=116063) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 13:03:27.843495 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-2ecd8b97-fbbc-48a9-a600-3a4f560b63f4 tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 13:03:27.843968 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-2ecd8b97-fbbc-48a9-a600-3a4f560b63f4 tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 13:03:27.844735 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-2ecd8b97-fbbc-48a9-a600-3a4f560b63f4 tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 13:03:27.845196 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-2ecd8b97-fbbc-48a9-a600-3a4f560b63f4 tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 13:03:27.919260 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: INFO nova.api.openstack.requestlog [None req-2ecd8b97-fbbc-48a9-a600-3a4f560b63f4 tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] 10.222.0.49 "POST /compute/v2.1/servers/9b3b44a7-7c20-473c-841c-318e471fc6cd/action" status: 200 len: 32496 microversion: 2.20 time: 0.086518 Dec 14 13:03:27.919923 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: [pid: 116063|app: 0|req: 410/800] 10.222.0.49 () {62 vars in 1318 bytes} [Tue Dec 14 13:03:27 2021] POST /compute/v2.1/servers/9b3b44a7-7c20-473c-841c-318e471fc6cd/action => generated 32496 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 14 13:03:28.325088 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.api.openstack.wsgi [None req-32279c94-b79c-4e30-8453-559efac125e6 tempest-TestMinimumBasicScenario-84513626 tempest-TestMinimumBasicScenario-84513626-project] Calling method '>' {{(pid=116064) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 13:03:28.326220 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.compute.api [None req-32279c94-b79c-4e30-8453-559efac125e6 tempest-TestMinimumBasicScenario-84513626 tempest-TestMinimumBasicScenario-84513626-project] [instance: dd367814-45bc-4808-b2de-d54f79eb7933] Fetching instance by UUID {{(pid=116064) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 13:03:28.334406 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-32279c94-b79c-4e30-8453-559efac125e6 tempest-TestMinimumBasicScenario-84513626 tempest-TestMinimumBasicScenario-84513626-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 13:03:28.334850 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-32279c94-b79c-4e30-8453-559efac125e6 tempest-TestMinimumBasicScenario-84513626 tempest-TestMinimumBasicScenario-84513626-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 13:03:28.335627 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-32279c94-b79c-4e30-8453-559efac125e6 tempest-TestMinimumBasicScenario-84513626 tempest-TestMinimumBasicScenario-84513626-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 13:03:28.336059 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-32279c94-b79c-4e30-8453-559efac125e6 tempest-TestMinimumBasicScenario-84513626 tempest-TestMinimumBasicScenario-84513626-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 13:03:28.472018 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.policy [None req-32279c94-b79c-4e30-8453-559efac125e6 tempest-TestMinimumBasicScenario-84513626 tempest-TestMinimumBasicScenario-84513626-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edf65e37b42d40b28c4e90bd92987016', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bcb503e37b2449484c788574e4c88f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116064) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 13:03:28.480254 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: INFO nova.api.openstack.requestlog [None req-32279c94-b79c-4e30-8453-559efac125e6 tempest-TestMinimumBasicScenario-84513626 tempest-TestMinimumBasicScenario-84513626-project] 10.222.0.49 "GET /compute/v2.1/servers/dd367814-45bc-4808-b2de-d54f79eb7933" status: 200 len: 1359 microversion: 2.1 time: 0.162696 Dec 14 13:03:28.480818 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: [pid: 116064|app: 0|req: 391/801] 10.222.0.49 () {58 vars in 1235 bytes} [Tue Dec 14 13:03:28 2021] GET /compute/v2.1/servers/dd367814-45bc-4808-b2de-d54f79eb7933 => generated 1359 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 14 13:03:28.932507 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.api.openstack.wsgi [None req-d13bbcc1-f900-4db3-a915-c08600cd26f1 tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116063) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 14 13:03:28.933552 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.compute.api [None req-d13bbcc1-f900-4db3-a915-c08600cd26f1 tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] [instance: 9b3b44a7-7c20-473c-841c-318e471fc6cd] Fetching instance by UUID {{(pid=116063) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 13:03:28.940728 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-d13bbcc1-f900-4db3-a915-c08600cd26f1 tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 13:03:28.941219 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-d13bbcc1-f900-4db3-a915-c08600cd26f1 tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 13:03:28.942008 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-d13bbcc1-f900-4db3-a915-c08600cd26f1 tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 13:03:28.942441 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-d13bbcc1-f900-4db3-a915-c08600cd26f1 tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 13:03:29.029085 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: INFO nova.api.openstack.requestlog [None req-d13bbcc1-f900-4db3-a915-c08600cd26f1 tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] 10.222.0.49 "POST /compute/v2.1/servers/9b3b44a7-7c20-473c-841c-318e471fc6cd/action" status: 200 len: 33525 microversion: 2.20 time: 0.100186 Dec 14 13:03:29.029751 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: [pid: 116063|app: 0|req: 411/802] 10.222.0.49 () {62 vars in 1318 bytes} [Tue Dec 14 13:03:28 2021] POST /compute/v2.1/servers/9b3b44a7-7c20-473c-841c-318e471fc6cd/action => generated 33525 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 14 13:03:29.499294 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.api.openstack.wsgi [None req-6d5c7cf4-3026-40e1-a2d7-974559a65d78 tempest-TestMinimumBasicScenario-84513626 tempest-TestMinimumBasicScenario-84513626-project] Calling method '>' {{(pid=116064) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 13:03:29.499956 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.compute.api [None req-6d5c7cf4-3026-40e1-a2d7-974559a65d78 tempest-TestMinimumBasicScenario-84513626 tempest-TestMinimumBasicScenario-84513626-project] [instance: dd367814-45bc-4808-b2de-d54f79eb7933] Fetching instance by UUID {{(pid=116064) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 13:03:29.509739 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-6d5c7cf4-3026-40e1-a2d7-974559a65d78 tempest-TestMinimumBasicScenario-84513626 tempest-TestMinimumBasicScenario-84513626-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 13:03:29.510265 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-6d5c7cf4-3026-40e1-a2d7-974559a65d78 tempest-TestMinimumBasicScenario-84513626 tempest-TestMinimumBasicScenario-84513626-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 13:03:29.511434 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-6d5c7cf4-3026-40e1-a2d7-974559a65d78 tempest-TestMinimumBasicScenario-84513626 tempest-TestMinimumBasicScenario-84513626-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 13:03:29.512042 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-6d5c7cf4-3026-40e1-a2d7-974559a65d78 tempest-TestMinimumBasicScenario-84513626 tempest-TestMinimumBasicScenario-84513626-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 13:03:29.654324 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.policy [None req-6d5c7cf4-3026-40e1-a2d7-974559a65d78 tempest-TestMinimumBasicScenario-84513626 tempest-TestMinimumBasicScenario-84513626-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edf65e37b42d40b28c4e90bd92987016', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bcb503e37b2449484c788574e4c88f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116064) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 13:03:29.665513 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: INFO nova.api.openstack.requestlog [None req-6d5c7cf4-3026-40e1-a2d7-974559a65d78 tempest-TestMinimumBasicScenario-84513626 tempest-TestMinimumBasicScenario-84513626-project] 10.222.0.49 "GET /compute/v2.1/servers/dd367814-45bc-4808-b2de-d54f79eb7933" status: 200 len: 1548 microversion: 2.1 time: 0.171799 Dec 14 13:03:29.666269 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: [pid: 116064|app: 0|req: 392/803] 10.222.0.49 () {58 vars in 1235 bytes} [Tue Dec 14 13:03:29 2021] GET /compute/v2.1/servers/dd367814-45bc-4808-b2de-d54f79eb7933 => generated 1548 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 14 13:03:29.682618 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.api.openstack.wsgi [None req-ba7b4125-c9b2-4860-b8a6-972d9cb3a173 tempest-TestMinimumBasicScenario-84513626 tempest-TestMinimumBasicScenario-84513626-project] Calling method '>' {{(pid=116063) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 13:03:29.683314 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.compute.api [None req-ba7b4125-c9b2-4860-b8a6-972d9cb3a173 tempest-TestMinimumBasicScenario-84513626 tempest-TestMinimumBasicScenario-84513626-project] [instance: dd367814-45bc-4808-b2de-d54f79eb7933] Fetching instance by UUID {{(pid=116063) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 13:03:29.690640 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-ba7b4125-c9b2-4860-b8a6-972d9cb3a173 tempest-TestMinimumBasicScenario-84513626 tempest-TestMinimumBasicScenario-84513626-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 13:03:29.691123 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-ba7b4125-c9b2-4860-b8a6-972d9cb3a173 tempest-TestMinimumBasicScenario-84513626 tempest-TestMinimumBasicScenario-84513626-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 13:03:29.691918 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-ba7b4125-c9b2-4860-b8a6-972d9cb3a173 tempest-TestMinimumBasicScenario-84513626 tempest-TestMinimumBasicScenario-84513626-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 13:03:29.692348 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-ba7b4125-c9b2-4860-b8a6-972d9cb3a173 tempest-TestMinimumBasicScenario-84513626 tempest-TestMinimumBasicScenario-84513626-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 13:03:29.831333 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.policy [None req-ba7b4125-c9b2-4860-b8a6-972d9cb3a173 tempest-TestMinimumBasicScenario-84513626 tempest-TestMinimumBasicScenario-84513626-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edf65e37b42d40b28c4e90bd92987016', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bcb503e37b2449484c788574e4c88f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116063) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 13:03:29.839153 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: INFO nova.api.openstack.requestlog [None req-ba7b4125-c9b2-4860-b8a6-972d9cb3a173 tempest-TestMinimumBasicScenario-84513626 tempest-TestMinimumBasicScenario-84513626-project] 10.222.0.49 "GET /compute/v2.1/servers/dd367814-45bc-4808-b2de-d54f79eb7933" status: 200 len: 1548 microversion: 2.1 time: 0.160536 Dec 14 13:03:29.839748 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: [pid: 116063|app: 0|req: 412/804] 10.222.0.49 () {58 vars in 1235 bytes} [Tue Dec 14 13:03:29 2021] GET /compute/v2.1/servers/dd367814-45bc-4808-b2de-d54f79eb7933 => generated 1548 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 14 13:03:29.854993 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.api.openstack.wsgi [None req-827cf0fd-455b-4eeb-84d6-bf88ac54b345 tempest-TestMinimumBasicScenario-84513626 tempest-TestMinimumBasicScenario-84513626-project] Calling method '>' {{(pid=116064) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 13:03:29.858294 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:servers:allow_all_filters": "rule:system_reader_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 14 13:03:29.858294 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: warnings.warn(msg) Dec 14 13:03:29.859286 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.policy [None req-827cf0fd-455b-4eeb-84d6-bf88ac54b345 tempest-TestMinimumBasicScenario-84513626 tempest-TestMinimumBasicScenario-84513626-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'edf65e37b42d40b28c4e90bd92987016', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bcb503e37b2449484c788574e4c88f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116064) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 13:03:29.860037 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.compute.api [None req-827cf0fd-455b-4eeb-84d6-bf88ac54b345 tempest-TestMinimumBasicScenario-84513626 tempest-TestMinimumBasicScenario-84513626-project] Searching by: {'deleted': False, 'project_id': '8bcb503e37b2449484c788574e4c88f0'} {{(pid=116064) get_all /opt/stack/nova/nova/compute/api.py:2907}} Dec 14 13:03:29.868048 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-827cf0fd-455b-4eeb-84d6-bf88ac54b345 tempest-TestMinimumBasicScenario-84513626 tempest-TestMinimumBasicScenario-84513626-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 13:03:29.868498 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-827cf0fd-455b-4eeb-84d6-bf88ac54b345 tempest-TestMinimumBasicScenario-84513626 tempest-TestMinimumBasicScenario-84513626-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 13:03:29.869340 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-827cf0fd-455b-4eeb-84d6-bf88ac54b345 tempest-TestMinimumBasicScenario-84513626 tempest-TestMinimumBasicScenario-84513626-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 13:03:29.869775 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-827cf0fd-455b-4eeb-84d6-bf88ac54b345 tempest-TestMinimumBasicScenario-84513626 tempest-TestMinimumBasicScenario-84513626-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 13:03:29.969148 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.compute.multi_cell_list [None req-827cf0fd-455b-4eeb-84d6-bf88ac54b345 tempest-TestMinimumBasicScenario-84513626 tempest-TestMinimumBasicScenario-84513626-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=116064) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Dec 14 13:03:30.041906 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.api.openstack.wsgi [None req-4801744f-23d4-4df2-9331-77c2d606169d tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116063) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 14 13:03:30.042830 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.compute.api [None req-4801744f-23d4-4df2-9331-77c2d606169d tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] [instance: 9b3b44a7-7c20-473c-841c-318e471fc6cd] Fetching instance by UUID {{(pid=116063) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 13:03:30.050210 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-4801744f-23d4-4df2-9331-77c2d606169d tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 13:03:30.050636 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-4801744f-23d4-4df2-9331-77c2d606169d tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 13:03:30.051616 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-4801744f-23d4-4df2-9331-77c2d606169d tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 13:03:30.052047 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-4801744f-23d4-4df2-9331-77c2d606169d tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 13:03:30.063617 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: INFO nova.api.openstack.requestlog [None req-827cf0fd-455b-4eeb-84d6-bf88ac54b345 tempest-TestMinimumBasicScenario-84513626 tempest-TestMinimumBasicScenario-84513626-project] 10.222.0.49 "GET /compute/v2.1/servers" status: 200 len: 343 microversion: 2.1 time: 0.212379 Dec 14 13:03:30.064214 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: [pid: 116064|app: 0|req: 393/805] 10.222.0.49 () {58 vars in 1124 bytes} [Tue Dec 14 13:03:29 2021] GET /compute/v2.1/servers => generated 343 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 14 13:03:30.074268 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.api.openstack.wsgi [None req-fe8a0a73-24c8-43ac-a7b5-7db523e04aa6 tempest-TestMinimumBasicScenario-84513626 tempest-TestMinimumBasicScenario-84513626-project] Calling method '>' {{(pid=116064) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 13:03:30.074888 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.compute.api [None req-fe8a0a73-24c8-43ac-a7b5-7db523e04aa6 tempest-TestMinimumBasicScenario-84513626 tempest-TestMinimumBasicScenario-84513626-project] [instance: dd367814-45bc-4808-b2de-d54f79eb7933] Fetching instance by UUID {{(pid=116064) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 13:03:30.082072 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-fe8a0a73-24c8-43ac-a7b5-7db523e04aa6 tempest-TestMinimumBasicScenario-84513626 tempest-TestMinimumBasicScenario-84513626-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 13:03:30.083271 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-fe8a0a73-24c8-43ac-a7b5-7db523e04aa6 tempest-TestMinimumBasicScenario-84513626 tempest-TestMinimumBasicScenario-84513626-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 13:03:30.084098 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-fe8a0a73-24c8-43ac-a7b5-7db523e04aa6 tempest-TestMinimumBasicScenario-84513626 tempest-TestMinimumBasicScenario-84513626-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 13:03:30.084528 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-fe8a0a73-24c8-43ac-a7b5-7db523e04aa6 tempest-TestMinimumBasicScenario-84513626 tempest-TestMinimumBasicScenario-84513626-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 13:03:30.125429 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: INFO nova.api.openstack.requestlog [None req-4801744f-23d4-4df2-9331-77c2d606169d tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] 10.222.0.49 "POST /compute/v2.1/servers/9b3b44a7-7c20-473c-841c-318e471fc6cd/action" status: 200 len: 34386 microversion: 2.20 time: 0.087006 Dec 14 13:03:30.126598 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: [pid: 116063|app: 0|req: 413/806] 10.222.0.49 () {62 vars in 1318 bytes} [Tue Dec 14 13:03:30 2021] POST /compute/v2.1/servers/9b3b44a7-7c20-473c-841c-318e471fc6cd/action => generated 34386 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 14 13:03:30.224522 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.policy [None req-fe8a0a73-24c8-43ac-a7b5-7db523e04aa6 tempest-TestMinimumBasicScenario-84513626 tempest-TestMinimumBasicScenario-84513626-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edf65e37b42d40b28c4e90bd92987016', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bcb503e37b2449484c788574e4c88f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116064) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 13:03:30.232095 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: INFO nova.api.openstack.requestlog [None req-fe8a0a73-24c8-43ac-a7b5-7db523e04aa6 tempest-TestMinimumBasicScenario-84513626 tempest-TestMinimumBasicScenario-84513626-project] 10.222.0.49 "GET /compute/v2.1/servers/dd367814-45bc-4808-b2de-d54f79eb7933" status: 200 len: 1548 microversion: 2.1 time: 0.161554 Dec 14 13:03:30.232692 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: [pid: 116064|app: 0|req: 394/807] 10.222.0.49 () {58 vars in 1235 bytes} [Tue Dec 14 13:03:30 2021] GET /compute/v2.1/servers/dd367814-45bc-4808-b2de-d54f79eb7933 => generated 1548 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 14 13:03:30.277953 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.api.openstack.wsgi [None req-5ee9d7a9-8189-4aa1-a8b8-5cf287c5cc54 tempest-AttachVolumeTestJSON-709357402 tempest-AttachVolumeTestJSON-709357402-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=116063) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 14 13:03:30.284648 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-5ee9d7a9-8189-4aa1-a8b8-5cf287c5cc54 tempest-AttachVolumeTestJSON-709357402 tempest-AttachVolumeTestJSON-709357402-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 13:03:30.285118 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-5ee9d7a9-8189-4aa1-a8b8-5cf287c5cc54 tempest-AttachVolumeTestJSON-709357402 tempest-AttachVolumeTestJSON-709357402-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 13:03:30.345508 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.compute.api [None req-5ee9d7a9-8189-4aa1-a8b8-5cf287c5cc54 tempest-AttachVolumeTestJSON-709357402 tempest-AttachVolumeTestJSON-709357402-project] [instance: 1b8e1f2f-c109-4413-9d56-33ef0b651f85] Going to try to stop instance {{(pid=116063) force_stop /opt/stack/nova/nova/compute/api.py:2654}} Dec 14 13:03:30.392570 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: INFO nova.api.openstack.requestlog [None req-5ee9d7a9-8189-4aa1-a8b8-5cf287c5cc54 tempest-AttachVolumeTestJSON-709357402 tempest-AttachVolumeTestJSON-709357402-project] 10.222.0.49 "POST /compute/v2.1/servers/1b8e1f2f-c109-4413-9d56-33ef0b651f85/action" status: 202 len: 0 microversion: 2.1 time: 0.118459 Dec 14 13:03:30.393508 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: [pid: 116063|app: 0|req: 414/808] 10.222.0.49 () {60 vars in 1277 bytes} [Tue Dec 14 13:03:30 2021] POST /compute/v2.1/servers/1b8e1f2f-c109-4413-9d56-33ef0b651f85/action => generated 0 bytes in 120 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Dec 14 13:03:30.401146 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.api.openstack.wsgi [None req-81b3c80c-ba0e-491d-babd-9d2be867af39 tempest-AttachVolumeTestJSON-709357402 tempest-AttachVolumeTestJSON-709357402-project] Calling method '>' {{(pid=116064) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 13:03:30.402090 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.compute.api [None req-81b3c80c-ba0e-491d-babd-9d2be867af39 tempest-AttachVolumeTestJSON-709357402 tempest-AttachVolumeTestJSON-709357402-project] [instance: 1b8e1f2f-c109-4413-9d56-33ef0b651f85] Fetching instance by UUID {{(pid=116064) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 13:03:30.409170 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-81b3c80c-ba0e-491d-babd-9d2be867af39 tempest-AttachVolumeTestJSON-709357402 tempest-AttachVolumeTestJSON-709357402-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 13:03:30.409682 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-81b3c80c-ba0e-491d-babd-9d2be867af39 tempest-AttachVolumeTestJSON-709357402 tempest-AttachVolumeTestJSON-709357402-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 13:03:30.410468 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-81b3c80c-ba0e-491d-babd-9d2be867af39 tempest-AttachVolumeTestJSON-709357402 tempest-AttachVolumeTestJSON-709357402-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 13:03:30.410973 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-81b3c80c-ba0e-491d-babd-9d2be867af39 tempest-AttachVolumeTestJSON-709357402 tempest-AttachVolumeTestJSON-709357402-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 13:03:30.552381 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.policy [None req-81b3c80c-ba0e-491d-babd-9d2be867af39 tempest-AttachVolumeTestJSON-709357402 tempest-AttachVolumeTestJSON-709357402-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '083128ec42474a3e82a2b0fc8c278f4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b1a390d20a54f4d9529d286ab7764a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116064) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 13:03:30.561653 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: INFO nova.api.openstack.requestlog [None req-81b3c80c-ba0e-491d-babd-9d2be867af39 tempest-AttachVolumeTestJSON-709357402 tempest-AttachVolumeTestJSON-709357402-project] 10.222.0.49 "GET /compute/v2.1/servers/1b8e1f2f-c109-4413-9d56-33ef0b651f85" status: 200 len: 1723 microversion: 2.1 time: 0.164071 Dec 14 13:03:30.562195 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: [pid: 116064|app: 0|req: 395/809] 10.222.0.49 () {58 vars in 1235 bytes} [Tue Dec 14 13:03:30 2021] GET /compute/v2.1/servers/1b8e1f2f-c109-4413-9d56-33ef0b651f85 => generated 1723 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 14 13:03:31.143255 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.api.openstack.wsgi [None req-0cf75133-20d3-41fa-abf3-2f844decfb49 tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116063) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 14 13:03:31.144307 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.compute.api [None req-0cf75133-20d3-41fa-abf3-2f844decfb49 tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] [instance: 9b3b44a7-7c20-473c-841c-318e471fc6cd] Fetching instance by UUID {{(pid=116063) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 13:03:31.151939 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-0cf75133-20d3-41fa-abf3-2f844decfb49 tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 13:03:31.152688 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-0cf75133-20d3-41fa-abf3-2f844decfb49 tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 13:03:31.155369 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-0cf75133-20d3-41fa-abf3-2f844decfb49 tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 13:03:31.155874 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-0cf75133-20d3-41fa-abf3-2f844decfb49 tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 13:03:31.242136 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: INFO nova.api.openstack.requestlog [None req-0cf75133-20d3-41fa-abf3-2f844decfb49 tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] 10.222.0.49 "POST /compute/v2.1/servers/9b3b44a7-7c20-473c-841c-318e471fc6cd/action" status: 200 len: 35491 microversion: 2.20 time: 0.106073 Dec 14 13:03:31.243092 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: [pid: 116063|app: 0|req: 415/810] 10.222.0.49 () {62 vars in 1318 bytes} [Tue Dec 14 13:03:31 2021] POST /compute/v2.1/servers/9b3b44a7-7c20-473c-841c-318e471fc6cd/action => generated 35491 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 14 13:03:31.579281 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.api.openstack.wsgi [None req-98164205-2b74-4ade-9038-a161d118b7d8 tempest-AttachVolumeTestJSON-709357402 tempest-AttachVolumeTestJSON-709357402-project] Calling method '>' {{(pid=116064) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 13:03:31.580539 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.compute.api [None req-98164205-2b74-4ade-9038-a161d118b7d8 tempest-AttachVolumeTestJSON-709357402 tempest-AttachVolumeTestJSON-709357402-project] [instance: 1b8e1f2f-c109-4413-9d56-33ef0b651f85] Fetching instance by UUID {{(pid=116064) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 13:03:31.593095 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-98164205-2b74-4ade-9038-a161d118b7d8 tempest-AttachVolumeTestJSON-709357402 tempest-AttachVolumeTestJSON-709357402-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 13:03:31.593095 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-98164205-2b74-4ade-9038-a161d118b7d8 tempest-AttachVolumeTestJSON-709357402 tempest-AttachVolumeTestJSON-709357402-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 13:03:31.593095 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-98164205-2b74-4ade-9038-a161d118b7d8 tempest-AttachVolumeTestJSON-709357402 tempest-AttachVolumeTestJSON-709357402-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 13:03:31.593095 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-98164205-2b74-4ade-9038-a161d118b7d8 tempest-AttachVolumeTestJSON-709357402 tempest-AttachVolumeTestJSON-709357402-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 13:03:31.729164 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.policy [None req-98164205-2b74-4ade-9038-a161d118b7d8 tempest-AttachVolumeTestJSON-709357402 tempest-AttachVolumeTestJSON-709357402-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '083128ec42474a3e82a2b0fc8c278f4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b1a390d20a54f4d9529d286ab7764a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116064) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 13:03:31.737140 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: INFO nova.api.openstack.requestlog [None req-98164205-2b74-4ade-9038-a161d118b7d8 tempest-AttachVolumeTestJSON-709357402 tempest-AttachVolumeTestJSON-709357402-project] 10.222.0.49 "GET /compute/v2.1/servers/1b8e1f2f-c109-4413-9d56-33ef0b651f85" status: 200 len: 1723 microversion: 2.1 time: 0.161469 Dec 14 13:03:31.737696 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: [pid: 116064|app: 0|req: 396/811] 10.222.0.49 () {58 vars in 1235 bytes} [Tue Dec 14 13:03:31 2021] GET /compute/v2.1/servers/1b8e1f2f-c109-4413-9d56-33ef0b651f85 => generated 1723 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 14 13:03:31.751704 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.api.openstack.wsgi [None req-38f406b6-b7e2-4ae4-baa3-be4889e71c66 tempest-TestMinimumBasicScenario-84513626 tempest-TestMinimumBasicScenario-84513626-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "aac65dcc-b224-42d0-8431-b1b930fc6a39"}} {{(pid=116063) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 14 13:03:31.753040 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.compute.api [None req-38f406b6-b7e2-4ae4-baa3-be4889e71c66 tempest-TestMinimumBasicScenario-84513626 tempest-TestMinimumBasicScenario-84513626-project] [instance: dd367814-45bc-4808-b2de-d54f79eb7933] Fetching instance by UUID {{(pid=116063) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 13:03:31.760342 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-38f406b6-b7e2-4ae4-baa3-be4889e71c66 tempest-TestMinimumBasicScenario-84513626 tempest-TestMinimumBasicScenario-84513626-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 13:03:31.760770 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-38f406b6-b7e2-4ae4-baa3-be4889e71c66 tempest-TestMinimumBasicScenario-84513626 tempest-TestMinimumBasicScenario-84513626-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 13:03:31.761585 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-38f406b6-b7e2-4ae4-baa3-be4889e71c66 tempest-TestMinimumBasicScenario-84513626 tempest-TestMinimumBasicScenario-84513626-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 13:03:31.762022 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-38f406b6-b7e2-4ae4-baa3-be4889e71c66 tempest-TestMinimumBasicScenario-84513626 tempest-TestMinimumBasicScenario-84513626-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 13:03:32.005186 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: INFO nova.api.openstack.requestlog [None req-38f406b6-b7e2-4ae4-baa3-be4889e71c66 tempest-TestMinimumBasicScenario-84513626 tempest-TestMinimumBasicScenario-84513626-project] 10.222.0.49 "POST /compute/v2.1/servers/dd367814-45bc-4808-b2de-d54f79eb7933/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.257460 Dec 14 13:03:32.005806 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: [pid: 116063|app: 0|req: 416/812] 10.222.0.49 () {60 vars in 1322 bytes} [Tue Dec 14 13:03:31 2021] POST /compute/v2.1/servers/dd367814-45bc-4808-b2de-d54f79eb7933/os-volume_attachments => generated 194 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 14 13:03:32.260148 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.api.openstack.wsgi [None req-c29fb076-b4fc-4de2-bba0-aa4c4215b8d7 tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116064) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 14 13:03:32.261768 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.compute.api [None req-c29fb076-b4fc-4de2-bba0-aa4c4215b8d7 tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] [instance: 9b3b44a7-7c20-473c-841c-318e471fc6cd] Fetching instance by UUID {{(pid=116064) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 13:03:32.272271 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-c29fb076-b4fc-4de2-bba0-aa4c4215b8d7 tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 13:03:32.273090 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-c29fb076-b4fc-4de2-bba0-aa4c4215b8d7 tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 13:03:32.274878 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-c29fb076-b4fc-4de2-bba0-aa4c4215b8d7 tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 13:03:32.275800 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-c29fb076-b4fc-4de2-bba0-aa4c4215b8d7 tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 13:03:32.354646 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: INFO nova.api.openstack.requestlog [None req-c29fb076-b4fc-4de2-bba0-aa4c4215b8d7 tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] 10.222.0.49 "POST /compute/v2.1/servers/9b3b44a7-7c20-473c-841c-318e471fc6cd/action" status: 200 len: 36975 microversion: 2.20 time: 0.100559 Dec 14 13:03:32.355487 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: [pid: 116064|app: 0|req: 397/813] 10.222.0.49 () {62 vars in 1318 bytes} [Tue Dec 14 13:03:32 2021] POST /compute/v2.1/servers/9b3b44a7-7c20-473c-841c-318e471fc6cd/action => generated 36975 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 14 13:03:32.759960 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.api.openstack.wsgi [None req-071e5d39-728f-46cf-ba2b-2e4e664a8dd9 tempest-AttachVolumeTestJSON-709357402 tempest-AttachVolumeTestJSON-709357402-project] Calling method '>' {{(pid=116063) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 13:03:32.761045 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.compute.api [None req-071e5d39-728f-46cf-ba2b-2e4e664a8dd9 tempest-AttachVolumeTestJSON-709357402 tempest-AttachVolumeTestJSON-709357402-project] [instance: 1b8e1f2f-c109-4413-9d56-33ef0b651f85] Fetching instance by UUID {{(pid=116063) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 13:03:32.771521 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-071e5d39-728f-46cf-ba2b-2e4e664a8dd9 tempest-AttachVolumeTestJSON-709357402 tempest-AttachVolumeTestJSON-709357402-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 13:03:32.771965 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-071e5d39-728f-46cf-ba2b-2e4e664a8dd9 tempest-AttachVolumeTestJSON-709357402 tempest-AttachVolumeTestJSON-709357402-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 13:03:32.772747 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-071e5d39-728f-46cf-ba2b-2e4e664a8dd9 tempest-AttachVolumeTestJSON-709357402 tempest-AttachVolumeTestJSON-709357402-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 13:03:32.773205 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-071e5d39-728f-46cf-ba2b-2e4e664a8dd9 tempest-AttachVolumeTestJSON-709357402 tempest-AttachVolumeTestJSON-709357402-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 13:03:32.924610 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.policy [None req-071e5d39-728f-46cf-ba2b-2e4e664a8dd9 tempest-AttachVolumeTestJSON-709357402 tempest-AttachVolumeTestJSON-709357402-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '083128ec42474a3e82a2b0fc8c278f4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b1a390d20a54f4d9529d286ab7764a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116063) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 13:03:32.937109 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: INFO nova.api.openstack.requestlog [None req-071e5d39-728f-46cf-ba2b-2e4e664a8dd9 tempest-AttachVolumeTestJSON-709357402 tempest-AttachVolumeTestJSON-709357402-project] 10.222.0.49 "GET /compute/v2.1/servers/1b8e1f2f-c109-4413-9d56-33ef0b651f85" status: 200 len: 1723 microversion: 2.1 time: 0.184483 Dec 14 13:03:32.937822 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: [pid: 116063|app: 0|req: 417/814] 10.222.0.49 () {58 vars in 1235 bytes} [Tue Dec 14 13:03:32 2021] GET /compute/v2.1/servers/1b8e1f2f-c109-4413-9d56-33ef0b651f85 => generated 1723 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 14 13:03:33.371866 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.api.openstack.wsgi [None req-caf89090-964a-48e6-99c0-96b93a18e06d tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116064) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 14 13:03:33.373687 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.compute.api [None req-caf89090-964a-48e6-99c0-96b93a18e06d tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] [instance: 9b3b44a7-7c20-473c-841c-318e471fc6cd] Fetching instance by UUID {{(pid=116064) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 13:03:33.385191 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-caf89090-964a-48e6-99c0-96b93a18e06d tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 13:03:33.385948 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-caf89090-964a-48e6-99c0-96b93a18e06d tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 13:03:33.387248 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-caf89090-964a-48e6-99c0-96b93a18e06d tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 13:03:33.387981 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-caf89090-964a-48e6-99c0-96b93a18e06d tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 13:03:33.470187 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: INFO nova.api.openstack.requestlog [None req-caf89090-964a-48e6-99c0-96b93a18e06d tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] 10.222.0.49 "POST /compute/v2.1/servers/9b3b44a7-7c20-473c-841c-318e471fc6cd/action" status: 200 len: 38211 microversion: 2.20 time: 0.104671 Dec 14 13:03:33.471222 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: [pid: 116064|app: 0|req: 398/815] 10.222.0.49 () {62 vars in 1318 bytes} [Tue Dec 14 13:03:33 2021] POST /compute/v2.1/servers/9b3b44a7-7c20-473c-841c-318e471fc6cd/action => generated 38211 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 14 13:03:33.959464 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.api.openstack.wsgi [None req-d05076d2-0190-481b-9394-b550ec074a9c tempest-AttachVolumeTestJSON-709357402 tempest-AttachVolumeTestJSON-709357402-project] Calling method '>' {{(pid=116063) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 13:03:33.960231 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.compute.api [None req-d05076d2-0190-481b-9394-b550ec074a9c tempest-AttachVolumeTestJSON-709357402 tempest-AttachVolumeTestJSON-709357402-project] [instance: 1b8e1f2f-c109-4413-9d56-33ef0b651f85] Fetching instance by UUID {{(pid=116063) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 13:03:33.968994 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-d05076d2-0190-481b-9394-b550ec074a9c tempest-AttachVolumeTestJSON-709357402 tempest-AttachVolumeTestJSON-709357402-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 13:03:33.969528 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-d05076d2-0190-481b-9394-b550ec074a9c tempest-AttachVolumeTestJSON-709357402 tempest-AttachVolumeTestJSON-709357402-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 13:03:33.970552 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-d05076d2-0190-481b-9394-b550ec074a9c tempest-AttachVolumeTestJSON-709357402 tempest-AttachVolumeTestJSON-709357402-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 13:03:33.971126 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-d05076d2-0190-481b-9394-b550ec074a9c tempest-AttachVolumeTestJSON-709357402 tempest-AttachVolumeTestJSON-709357402-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 13:03:34.117162 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.policy [None req-d05076d2-0190-481b-9394-b550ec074a9c tempest-AttachVolumeTestJSON-709357402 tempest-AttachVolumeTestJSON-709357402-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '083128ec42474a3e82a2b0fc8c278f4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b1a390d20a54f4d9529d286ab7764a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116063) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 13:03:34.125238 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: INFO nova.api.openstack.requestlog [None req-d05076d2-0190-481b-9394-b550ec074a9c tempest-AttachVolumeTestJSON-709357402 tempest-AttachVolumeTestJSON-709357402-project] 10.222.0.49 "GET /compute/v2.1/servers/1b8e1f2f-c109-4413-9d56-33ef0b651f85" status: 200 len: 1723 microversion: 2.1 time: 0.172061 Dec 14 13:03:34.125849 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: [pid: 116063|app: 0|req: 418/816] 10.222.0.49 () {58 vars in 1235 bytes} [Tue Dec 14 13:03:33 2021] GET /compute/v2.1/servers/1b8e1f2f-c109-4413-9d56-33ef0b651f85 => generated 1723 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 14 13:03:34.489888 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.api.openstack.wsgi [None req-95797b25-8990-4d3a-a462-14af58d5b8d9 tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116064) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 14 13:03:34.491487 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.compute.api [None req-95797b25-8990-4d3a-a462-14af58d5b8d9 tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] [instance: 9b3b44a7-7c20-473c-841c-318e471fc6cd] Fetching instance by UUID {{(pid=116064) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 13:03:34.503024 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-95797b25-8990-4d3a-a462-14af58d5b8d9 tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 13:03:34.503769 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-95797b25-8990-4d3a-a462-14af58d5b8d9 tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 13:03:34.505150 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-95797b25-8990-4d3a-a462-14af58d5b8d9 tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 13:03:34.505895 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-95797b25-8990-4d3a-a462-14af58d5b8d9 tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 13:03:34.581385 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: INFO nova.api.openstack.requestlog [None req-95797b25-8990-4d3a-a462-14af58d5b8d9 tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] 10.222.0.49 "POST /compute/v2.1/servers/9b3b44a7-7c20-473c-841c-318e471fc6cd/action" status: 200 len: 38211 microversion: 2.20 time: 0.097871 Dec 14 13:03:34.582378 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: [pid: 116064|app: 0|req: 399/817] 10.222.0.49 () {62 vars in 1318 bytes} [Tue Dec 14 13:03:34 2021] POST /compute/v2.1/servers/9b3b44a7-7c20-473c-841c-318e471fc6cd/action => generated 38211 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 14 13:03:35.145812 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.api.openstack.wsgi [None req-f9ff26f5-2c93-4efb-867e-d3c956fb42ed tempest-AttachVolumeTestJSON-709357402 tempest-AttachVolumeTestJSON-709357402-project] Calling method '>' {{(pid=116063) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 13:03:35.146666 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.compute.api [None req-f9ff26f5-2c93-4efb-867e-d3c956fb42ed tempest-AttachVolumeTestJSON-709357402 tempest-AttachVolumeTestJSON-709357402-project] [instance: 1b8e1f2f-c109-4413-9d56-33ef0b651f85] Fetching instance by UUID {{(pid=116063) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 13:03:35.157337 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-f9ff26f5-2c93-4efb-867e-d3c956fb42ed tempest-AttachVolumeTestJSON-709357402 tempest-AttachVolumeTestJSON-709357402-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 13:03:35.158072 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-f9ff26f5-2c93-4efb-867e-d3c956fb42ed tempest-AttachVolumeTestJSON-709357402 tempest-AttachVolumeTestJSON-709357402-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 13:03:35.159338 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-f9ff26f5-2c93-4efb-867e-d3c956fb42ed tempest-AttachVolumeTestJSON-709357402 tempest-AttachVolumeTestJSON-709357402-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 13:03:35.160053 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-f9ff26f5-2c93-4efb-867e-d3c956fb42ed tempest-AttachVolumeTestJSON-709357402 tempest-AttachVolumeTestJSON-709357402-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 13:03:35.296668 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.policy [None req-f9ff26f5-2c93-4efb-867e-d3c956fb42ed tempest-AttachVolumeTestJSON-709357402 tempest-AttachVolumeTestJSON-709357402-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '083128ec42474a3e82a2b0fc8c278f4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b1a390d20a54f4d9529d286ab7764a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116063) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 13:03:35.308894 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: INFO nova.api.openstack.requestlog [None req-f9ff26f5-2c93-4efb-867e-d3c956fb42ed tempest-AttachVolumeTestJSON-709357402 tempest-AttachVolumeTestJSON-709357402-project] 10.222.0.49 "GET /compute/v2.1/servers/1b8e1f2f-c109-4413-9d56-33ef0b651f85" status: 200 len: 1723 microversion: 2.1 time: 0.169121 Dec 14 13:03:35.309715 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: [pid: 116063|app: 0|req: 419/818] 10.222.0.49 () {58 vars in 1235 bytes} [Tue Dec 14 13:03:35 2021] GET /compute/v2.1/servers/1b8e1f2f-c109-4413-9d56-33ef0b651f85 => generated 1723 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 14 13:03:35.600579 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.api.openstack.wsgi [None req-c582065c-c0c7-4734-831a-326fa78437f9 tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116064) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 14 13:03:35.602321 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.compute.api [None req-c582065c-c0c7-4734-831a-326fa78437f9 tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] [instance: 9b3b44a7-7c20-473c-841c-318e471fc6cd] Fetching instance by UUID {{(pid=116064) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 13:03:35.613865 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-c582065c-c0c7-4734-831a-326fa78437f9 tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 13:03:35.614602 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-c582065c-c0c7-4734-831a-326fa78437f9 tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 13:03:35.615870 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-c582065c-c0c7-4734-831a-326fa78437f9 tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 13:03:35.616750 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-c582065c-c0c7-4734-831a-326fa78437f9 tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 13:03:35.685203 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: INFO nova.api.openstack.requestlog [None req-c582065c-c0c7-4734-831a-326fa78437f9 tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] 10.222.0.49 "POST /compute/v2.1/servers/9b3b44a7-7c20-473c-841c-318e471fc6cd/action" status: 200 len: 38211 microversion: 2.20 time: 0.090632 Dec 14 13:03:35.686069 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: [pid: 116064|app: 0|req: 400/819] 10.222.0.49 () {62 vars in 1318 bytes} [Tue Dec 14 13:03:35 2021] POST /compute/v2.1/servers/9b3b44a7-7c20-473c-841c-318e471fc6cd/action => generated 38211 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 14 13:03:36.334140 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.api.openstack.wsgi [None req-7611a815-5525-4aed-910b-23bb96bada6f tempest-AttachVolumeTestJSON-709357402 tempest-AttachVolumeTestJSON-709357402-project] Calling method '>' {{(pid=116063) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 13:03:36.335134 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.compute.api [None req-7611a815-5525-4aed-910b-23bb96bada6f tempest-AttachVolumeTestJSON-709357402 tempest-AttachVolumeTestJSON-709357402-project] [instance: 1b8e1f2f-c109-4413-9d56-33ef0b651f85] Fetching instance by UUID {{(pid=116063) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 13:03:36.342448 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-7611a815-5525-4aed-910b-23bb96bada6f tempest-AttachVolumeTestJSON-709357402 tempest-AttachVolumeTestJSON-709357402-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 13:03:36.342923 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-7611a815-5525-4aed-910b-23bb96bada6f tempest-AttachVolumeTestJSON-709357402 tempest-AttachVolumeTestJSON-709357402-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 13:03:36.343740 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-7611a815-5525-4aed-910b-23bb96bada6f tempest-AttachVolumeTestJSON-709357402 tempest-AttachVolumeTestJSON-709357402-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 13:03:36.344193 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-7611a815-5525-4aed-910b-23bb96bada6f tempest-AttachVolumeTestJSON-709357402 tempest-AttachVolumeTestJSON-709357402-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 13:03:36.477199 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.policy [None req-7611a815-5525-4aed-910b-23bb96bada6f tempest-AttachVolumeTestJSON-709357402 tempest-AttachVolumeTestJSON-709357402-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '083128ec42474a3e82a2b0fc8c278f4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b1a390d20a54f4d9529d286ab7764a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116063) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 13:03:36.484966 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: INFO nova.api.openstack.requestlog [None req-7611a815-5525-4aed-910b-23bb96bada6f tempest-AttachVolumeTestJSON-709357402 tempest-AttachVolumeTestJSON-709357402-project] 10.222.0.49 "GET /compute/v2.1/servers/1b8e1f2f-c109-4413-9d56-33ef0b651f85" status: 200 len: 1723 microversion: 2.1 time: 0.157501 Dec 14 13:03:36.485538 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: [pid: 116063|app: 0|req: 420/820] 10.222.0.49 () {58 vars in 1235 bytes} [Tue Dec 14 13:03:36 2021] GET /compute/v2.1/servers/1b8e1f2f-c109-4413-9d56-33ef0b651f85 => generated 1723 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 14 13:03:36.703693 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.api.openstack.wsgi [None req-94ddcc0a-4f50-47c6-9f58-fa8a74cda66a tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116064) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 14 13:03:36.705360 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.compute.api [None req-94ddcc0a-4f50-47c6-9f58-fa8a74cda66a tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] [instance: 9b3b44a7-7c20-473c-841c-318e471fc6cd] Fetching instance by UUID {{(pid=116064) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 13:03:36.716911 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-94ddcc0a-4f50-47c6-9f58-fa8a74cda66a tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 13:03:36.717683 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-94ddcc0a-4f50-47c6-9f58-fa8a74cda66a tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 13:03:36.718971 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-94ddcc0a-4f50-47c6-9f58-fa8a74cda66a tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 13:03:36.719693 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-94ddcc0a-4f50-47c6-9f58-fa8a74cda66a tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 13:03:36.783558 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: INFO nova.api.openstack.requestlog [None req-94ddcc0a-4f50-47c6-9f58-fa8a74cda66a tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] 10.222.0.49 "POST /compute/v2.1/servers/9b3b44a7-7c20-473c-841c-318e471fc6cd/action" status: 200 len: 38211 microversion: 2.20 time: 0.086716 Dec 14 13:03:36.784196 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: [pid: 116064|app: 0|req: 401/821] 10.222.0.49 () {62 vars in 1318 bytes} [Tue Dec 14 13:03:36 2021] POST /compute/v2.1/servers/9b3b44a7-7c20-473c-841c-318e471fc6cd/action => generated 38211 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 14 13:03:37.508026 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.api.openstack.wsgi [None req-000bda07-1153-428b-80de-af16962a7f37 tempest-AttachVolumeTestJSON-709357402 tempest-AttachVolumeTestJSON-709357402-project] Calling method '>' {{(pid=116063) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 13:03:37.508749 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.compute.api [None req-000bda07-1153-428b-80de-af16962a7f37 tempest-AttachVolumeTestJSON-709357402 tempest-AttachVolumeTestJSON-709357402-project] [instance: 1b8e1f2f-c109-4413-9d56-33ef0b651f85] Fetching instance by UUID {{(pid=116063) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 13:03:37.516889 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-000bda07-1153-428b-80de-af16962a7f37 tempest-AttachVolumeTestJSON-709357402 tempest-AttachVolumeTestJSON-709357402-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 13:03:37.517481 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-000bda07-1153-428b-80de-af16962a7f37 tempest-AttachVolumeTestJSON-709357402 tempest-AttachVolumeTestJSON-709357402-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 13:03:37.518445 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-000bda07-1153-428b-80de-af16962a7f37 tempest-AttachVolumeTestJSON-709357402 tempest-AttachVolumeTestJSON-709357402-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 13:03:37.518983 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-000bda07-1153-428b-80de-af16962a7f37 tempest-AttachVolumeTestJSON-709357402 tempest-AttachVolumeTestJSON-709357402-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 13:03:37.666137 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.policy [None req-000bda07-1153-428b-80de-af16962a7f37 tempest-AttachVolumeTestJSON-709357402 tempest-AttachVolumeTestJSON-709357402-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '083128ec42474a3e82a2b0fc8c278f4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b1a390d20a54f4d9529d286ab7764a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116063) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 13:03:37.674770 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: INFO nova.api.openstack.requestlog [None req-000bda07-1153-428b-80de-af16962a7f37 tempest-AttachVolumeTestJSON-709357402 tempest-AttachVolumeTestJSON-709357402-project] 10.222.0.49 "GET /compute/v2.1/servers/1b8e1f2f-c109-4413-9d56-33ef0b651f85" status: 200 len: 1723 microversion: 2.1 time: 0.172853 Dec 14 13:03:37.675312 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: [pid: 116063|app: 0|req: 421/822] 10.222.0.49 () {58 vars in 1235 bytes} [Tue Dec 14 13:03:37 2021] GET /compute/v2.1/servers/1b8e1f2f-c109-4413-9d56-33ef0b651f85 => generated 1723 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 14 13:03:37.800911 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.api.openstack.wsgi [None req-93e49acd-1214-4ded-809a-213e56b52f65 tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116064) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 14 13:03:37.802563 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.compute.api [None req-93e49acd-1214-4ded-809a-213e56b52f65 tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] [instance: 9b3b44a7-7c20-473c-841c-318e471fc6cd] Fetching instance by UUID {{(pid=116064) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 13:03:37.810493 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-93e49acd-1214-4ded-809a-213e56b52f65 tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 13:03:37.810939 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-93e49acd-1214-4ded-809a-213e56b52f65 tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 13:03:37.811798 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-93e49acd-1214-4ded-809a-213e56b52f65 tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 13:03:37.812228 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-93e49acd-1214-4ded-809a-213e56b52f65 tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 13:03:37.887357 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: INFO nova.api.openstack.requestlog [None req-93e49acd-1214-4ded-809a-213e56b52f65 tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] 10.222.0.49 "POST /compute/v2.1/servers/9b3b44a7-7c20-473c-841c-318e471fc6cd/action" status: 200 len: 38352 microversion: 2.20 time: 0.092999 Dec 14 13:03:37.888022 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: [pid: 116064|app: 0|req: 402/823] 10.222.0.49 () {62 vars in 1318 bytes} [Tue Dec 14 13:03:37 2021] POST /compute/v2.1/servers/9b3b44a7-7c20-473c-841c-318e471fc6cd/action => generated 38352 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 14 13:03:37.898259 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.api.openstack.wsgi [None req-162fd77c-d0f2-4b9b-9526-dd05ccf96d0e tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] Calling method '>' {{(pid=116063) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 13:03:37.898771 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.compute.api [None req-162fd77c-d0f2-4b9b-9526-dd05ccf96d0e tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] [instance: 9b3b44a7-7c20-473c-841c-318e471fc6cd] Fetching instance by UUID {{(pid=116063) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 13:03:37.905145 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-162fd77c-d0f2-4b9b-9526-dd05ccf96d0e tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 13:03:37.905597 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-162fd77c-d0f2-4b9b-9526-dd05ccf96d0e tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 13:03:37.906376 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-162fd77c-d0f2-4b9b-9526-dd05ccf96d0e tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 13:03:37.906808 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-162fd77c-d0f2-4b9b-9526-dd05ccf96d0e tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 13:03:37.930715 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: INFO nova.api.openstack.requestlog [None req-162fd77c-d0f2-4b9b-9526-dd05ccf96d0e tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] 10.222.0.49 "GET /compute/v2.1/servers/9b3b44a7-7c20-473c-841c-318e471fc6cd/ips" status: 200 len: 152 microversion: 2.20 time: 0.036229 Dec 14 13:03:37.931287 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: [pid: 116063|app: 0|req: 422/824] 10.222.0.49 () {60 vars in 1288 bytes} [Tue Dec 14 13:03:37 2021] GET /compute/v2.1/servers/9b3b44a7-7c20-473c-841c-318e471fc6cd/ips => generated 152 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 14 13:03:38.500212 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.api.openstack.wsgi [None req-600d96d9-b435-4872-960a-af95c4e0ae36 tempest-TestMinimumBasicScenario-84513626 tempest-TestMinimumBasicScenario-84513626-project] Calling method '>' {{(pid=116064) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 13:03:38.500948 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.compute.api [None req-600d96d9-b435-4872-960a-af95c4e0ae36 tempest-TestMinimumBasicScenario-84513626 tempest-TestMinimumBasicScenario-84513626-project] [instance: dd367814-45bc-4808-b2de-d54f79eb7933] Fetching instance by UUID {{(pid=116064) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 13:03:38.507950 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-600d96d9-b435-4872-960a-af95c4e0ae36 tempest-TestMinimumBasicScenario-84513626 tempest-TestMinimumBasicScenario-84513626-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 13:03:38.508401 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-600d96d9-b435-4872-960a-af95c4e0ae36 tempest-TestMinimumBasicScenario-84513626 tempest-TestMinimumBasicScenario-84513626-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 13:03:38.509208 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-600d96d9-b435-4872-960a-af95c4e0ae36 tempest-TestMinimumBasicScenario-84513626 tempest-TestMinimumBasicScenario-84513626-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 13:03:38.509640 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-600d96d9-b435-4872-960a-af95c4e0ae36 tempest-TestMinimumBasicScenario-84513626 tempest-TestMinimumBasicScenario-84513626-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 13:03:38.644387 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.policy [None req-600d96d9-b435-4872-960a-af95c4e0ae36 tempest-TestMinimumBasicScenario-84513626 tempest-TestMinimumBasicScenario-84513626-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edf65e37b42d40b28c4e90bd92987016', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bcb503e37b2449484c788574e4c88f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116064) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 13:03:38.652510 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: INFO nova.api.openstack.requestlog [None req-600d96d9-b435-4872-960a-af95c4e0ae36 tempest-TestMinimumBasicScenario-84513626 tempest-TestMinimumBasicScenario-84513626-project] 10.222.0.49 "GET /compute/v2.1/servers/dd367814-45bc-4808-b2de-d54f79eb7933" status: 200 len: 1594 microversion: 2.1 time: 0.156658 Dec 14 13:03:38.653126 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: [pid: 116064|app: 0|req: 403/825] 10.222.0.49 () {58 vars in 1235 bytes} [Tue Dec 14 13:03:38 2021] GET /compute/v2.1/servers/dd367814-45bc-4808-b2de-d54f79eb7933 => generated 1594 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 14 13:03:38.691185 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.api.openstack.wsgi [None req-cd07cace-4485-48e4-9170-bf1de46682e2 tempest-AttachVolumeTestJSON-709357402 tempest-AttachVolumeTestJSON-709357402-project] Calling method '>' {{(pid=116063) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 13:03:38.692353 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.compute.api [None req-cd07cace-4485-48e4-9170-bf1de46682e2 tempest-AttachVolumeTestJSON-709357402 tempest-AttachVolumeTestJSON-709357402-project] [instance: 1b8e1f2f-c109-4413-9d56-33ef0b651f85] Fetching instance by UUID {{(pid=116063) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 13:03:38.698729 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-cd07cace-4485-48e4-9170-bf1de46682e2 tempest-AttachVolumeTestJSON-709357402 tempest-AttachVolumeTestJSON-709357402-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 13:03:38.699169 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-cd07cace-4485-48e4-9170-bf1de46682e2 tempest-AttachVolumeTestJSON-709357402 tempest-AttachVolumeTestJSON-709357402-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 13:03:38.699925 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-cd07cace-4485-48e4-9170-bf1de46682e2 tempest-AttachVolumeTestJSON-709357402 tempest-AttachVolumeTestJSON-709357402-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 13:03:38.700377 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-cd07cace-4485-48e4-9170-bf1de46682e2 tempest-AttachVolumeTestJSON-709357402 tempest-AttachVolumeTestJSON-709357402-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 13:03:38.851025 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.policy [None req-cd07cace-4485-48e4-9170-bf1de46682e2 tempest-AttachVolumeTestJSON-709357402 tempest-AttachVolumeTestJSON-709357402-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '083128ec42474a3e82a2b0fc8c278f4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b1a390d20a54f4d9529d286ab7764a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116063) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 13:03:38.861757 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: INFO nova.api.openstack.requestlog [None req-cd07cace-4485-48e4-9170-bf1de46682e2 tempest-AttachVolumeTestJSON-709357402 tempest-AttachVolumeTestJSON-709357402-project] 10.222.0.49 "GET /compute/v2.1/servers/1b8e1f2f-c109-4413-9d56-33ef0b651f85" status: 200 len: 1723 microversion: 2.1 time: 0.174090 Dec 14 13:03:38.862367 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: [pid: 116063|app: 0|req: 423/826] 10.222.0.49 () {58 vars in 1235 bytes} [Tue Dec 14 13:03:38 2021] GET /compute/v2.1/servers/1b8e1f2f-c109-4413-9d56-33ef0b651f85 => generated 1723 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 14 13:03:39.879034 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.api.openstack.wsgi [None req-f7d830f4-1963-4ec4-925e-4ac3ac30d0e9 tempest-AttachVolumeTestJSON-709357402 tempest-AttachVolumeTestJSON-709357402-project] Calling method '>' {{(pid=116064) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 13:03:39.879618 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.compute.api [None req-f7d830f4-1963-4ec4-925e-4ac3ac30d0e9 tempest-AttachVolumeTestJSON-709357402 tempest-AttachVolumeTestJSON-709357402-project] [instance: 1b8e1f2f-c109-4413-9d56-33ef0b651f85] Fetching instance by UUID {{(pid=116064) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 13:03:39.886432 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-f7d830f4-1963-4ec4-925e-4ac3ac30d0e9 tempest-AttachVolumeTestJSON-709357402 tempest-AttachVolumeTestJSON-709357402-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 13:03:39.886892 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-f7d830f4-1963-4ec4-925e-4ac3ac30d0e9 tempest-AttachVolumeTestJSON-709357402 tempest-AttachVolumeTestJSON-709357402-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 13:03:39.887663 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-f7d830f4-1963-4ec4-925e-4ac3ac30d0e9 tempest-AttachVolumeTestJSON-709357402 tempest-AttachVolumeTestJSON-709357402-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 13:03:39.888114 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-f7d830f4-1963-4ec4-925e-4ac3ac30d0e9 tempest-AttachVolumeTestJSON-709357402 tempest-AttachVolumeTestJSON-709357402-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 13:03:40.000697 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.api.openstack.wsgi [None req-7abdd5c8-0b77-4ca9-ba35-63507199a787 tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=116063) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 14 13:03:40.001293 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.compute.api [None req-7abdd5c8-0b77-4ca9-ba35-63507199a787 tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] [instance: 9b3b44a7-7c20-473c-841c-318e471fc6cd] Fetching instance by UUID {{(pid=116063) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 13:03:40.007791 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-7abdd5c8-0b77-4ca9-ba35-63507199a787 tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 13:03:40.008442 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-7abdd5c8-0b77-4ca9-ba35-63507199a787 tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 13:03:40.009486 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-7abdd5c8-0b77-4ca9-ba35-63507199a787 tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 13:03:40.009923 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-7abdd5c8-0b77-4ca9-ba35-63507199a787 tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 13:03:40.021055 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.policy [None req-f7d830f4-1963-4ec4-925e-4ac3ac30d0e9 tempest-AttachVolumeTestJSON-709357402 tempest-AttachVolumeTestJSON-709357402-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '083128ec42474a3e82a2b0fc8c278f4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b1a390d20a54f4d9529d286ab7764a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116064) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 13:03:40.029209 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: INFO nova.api.openstack.requestlog [None req-f7d830f4-1963-4ec4-925e-4ac3ac30d0e9 tempest-AttachVolumeTestJSON-709357402 tempest-AttachVolumeTestJSON-709357402-project] 10.222.0.49 "GET /compute/v2.1/servers/1b8e1f2f-c109-4413-9d56-33ef0b651f85" status: 200 len: 1723 microversion: 2.1 time: 0.153860 Dec 14 13:03:40.029877 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: [pid: 116064|app: 0|req: 404/827] 10.222.0.49 () {58 vars in 1235 bytes} [Tue Dec 14 13:03:39 2021] GET /compute/v2.1/servers/1b8e1f2f-c109-4413-9d56-33ef0b651f85 => generated 1723 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 14 13:03:40.033099 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.objects.instance [None req-7abdd5c8-0b77-4ca9-ba35-63507199a787 tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] Lazy-loading 'flavor' on Instance uuid 9b3b44a7-7c20-473c-841c-318e471fc6cd {{(pid=116063) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Dec 14 13:03:40.290757 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: INFO nova.api.openstack.requestlog [None req-7abdd5c8-0b77-4ca9-ba35-63507199a787 tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] 10.222.0.49 "POST /compute/v2.1/servers/9b3b44a7-7c20-473c-841c-318e471fc6cd/action" status: 202 len: 0 microversion: 2.20 time: 0.293654 Dec 14 13:03:40.291369 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: [pid: 116063|app: 0|req: 424/828] 10.222.0.49 () {62 vars in 1318 bytes} [Tue Dec 14 13:03:39 2021] POST /compute/v2.1/servers/9b3b44a7-7c20-473c-841c-318e471fc6cd/action => generated 0 bytes in 295 msecs (HTTP/1.1 202) 9 headers in 363 bytes (2 switches on core 0) Dec 14 13:03:40.301191 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.api.openstack.wsgi [None req-7b841bf9-3499-4047-99af-8ef80dc3cb5c tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] Calling method '>' {{(pid=116064) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 13:03:40.301877 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.compute.api [None req-7b841bf9-3499-4047-99af-8ef80dc3cb5c tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] [instance: 9b3b44a7-7c20-473c-841c-318e471fc6cd] Fetching instance by UUID {{(pid=116064) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 13:03:40.309454 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-7b841bf9-3499-4047-99af-8ef80dc3cb5c tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 13:03:40.310010 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-7b841bf9-3499-4047-99af-8ef80dc3cb5c tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 13:03:40.310807 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-7b841bf9-3499-4047-99af-8ef80dc3cb5c tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 13:03:40.311223 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-7b841bf9-3499-4047-99af-8ef80dc3cb5c tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 13:03:40.447278 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.policy [None req-7b841bf9-3499-4047-99af-8ef80dc3cb5c tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79d74a2ea1e541d28d085c15cec34032', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68a8770b8dbe489a8119016fbee64eb5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116064) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 13:03:40.455466 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.policy [None req-7b841bf9-3499-4047-99af-8ef80dc3cb5c tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '79d74a2ea1e541d28d085c15cec34032', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68a8770b8dbe489a8119016fbee64eb5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116064) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 13:03:40.456985 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.policy [None req-7b841bf9-3499-4047-99af-8ef80dc3cb5c tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '79d74a2ea1e541d28d085c15cec34032', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68a8770b8dbe489a8119016fbee64eb5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116064) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 13:03:40.458152 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: INFO nova.api.openstack.requestlog [None req-7b841bf9-3499-4047-99af-8ef80dc3cb5c tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] 10.222.0.49 "GET /compute/v2.1/servers/9b3b44a7-7c20-473c-841c-318e471fc6cd" status: 200 len: 1722 microversion: 2.20 time: 0.161286 Dec 14 13:03:40.458738 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: [pid: 116064|app: 0|req: 405/829] 10.222.0.49 () {60 vars in 1276 bytes} [Tue Dec 14 13:03:40 2021] GET /compute/v2.1/servers/9b3b44a7-7c20-473c-841c-318e471fc6cd => generated 1722 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Dec 14 13:03:40.692503 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.api.openstack.wsgi [req-c37da261-a558-4aef-a80b-1c06e1f80e70 req-e0bc7db0-db93-44c2-b6eb-d1d7adf11e22 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "dd367814-45bc-4808-b2de-d54f79eb7933", "tag": "fee608e1-5f95-4491-9016-8fcb3872f581"}]} {{(pid=116063) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 14 13:03:40.694443 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 14 13:03:40.694443 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: warnings.warn(msg) Dec 14 13:03:40.702649 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [req-c37da261-a558-4aef-a80b-1c06e1f80e70 req-e0bc7db0-db93-44c2-b6eb-d1d7adf11e22 service nova] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 13:03:40.703290 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [req-c37da261-a558-4aef-a80b-1c06e1f80e70 req-e0bc7db0-db93-44c2-b6eb-d1d7adf11e22 service nova] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 13:03:40.715010 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: INFO nova.api.openstack.compute.server_external_events [req-c37da261-a558-4aef-a80b-1c06e1f80e70 req-e0bc7db0-db93-44c2-b6eb-d1d7adf11e22 service nova] Creating event network-changed:fee608e1-5f95-4491-9016-8fcb3872f581 for instance dd367814-45bc-4808-b2de-d54f79eb7933 on hv-cinder-78447 Dec 14 13:03:40.720636 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: INFO nova.api.openstack.requestlog [req-c37da261-a558-4aef-a80b-1c06e1f80e70 req-e0bc7db0-db93-44c2-b6eb-d1d7adf11e22 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.100605 Dec 14 13:03:40.721281 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: [pid: 116063|app: 0|req: 425/830] 10.222.0.49 () {64 vars in 1317 bytes} [Tue Dec 14 13:03:40 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 14 13:03:41.048815 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.api.openstack.wsgi [None req-54efed2a-864c-4d81-8eda-7c07695e8895 tempest-AttachVolumeTestJSON-709357402 tempest-AttachVolumeTestJSON-709357402-project] Calling method '>' {{(pid=116064) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 13:03:41.049458 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.compute.api [None req-54efed2a-864c-4d81-8eda-7c07695e8895 tempest-AttachVolumeTestJSON-709357402 tempest-AttachVolumeTestJSON-709357402-project] [instance: 1b8e1f2f-c109-4413-9d56-33ef0b651f85] Fetching instance by UUID {{(pid=116064) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 13:03:41.056565 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-54efed2a-864c-4d81-8eda-7c07695e8895 tempest-AttachVolumeTestJSON-709357402 tempest-AttachVolumeTestJSON-709357402-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 13:03:41.057342 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-54efed2a-864c-4d81-8eda-7c07695e8895 tempest-AttachVolumeTestJSON-709357402 tempest-AttachVolumeTestJSON-709357402-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 13:03:41.058137 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-54efed2a-864c-4d81-8eda-7c07695e8895 tempest-AttachVolumeTestJSON-709357402 tempest-AttachVolumeTestJSON-709357402-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 13:03:41.058862 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-54efed2a-864c-4d81-8eda-7c07695e8895 tempest-AttachVolumeTestJSON-709357402 tempest-AttachVolumeTestJSON-709357402-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 13:03:41.278198 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.policy [None req-54efed2a-864c-4d81-8eda-7c07695e8895 tempest-AttachVolumeTestJSON-709357402 tempest-AttachVolumeTestJSON-709357402-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '083128ec42474a3e82a2b0fc8c278f4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b1a390d20a54f4d9529d286ab7764a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116064) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 13:03:41.288408 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: INFO nova.api.openstack.requestlog [None req-54efed2a-864c-4d81-8eda-7c07695e8895 tempest-AttachVolumeTestJSON-709357402 tempest-AttachVolumeTestJSON-709357402-project] 10.222.0.49 "GET /compute/v2.1/servers/1b8e1f2f-c109-4413-9d56-33ef0b651f85" status: 200 len: 1723 microversion: 2.1 time: 0.245786 Dec 14 13:03:41.290153 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: [pid: 116064|app: 0|req: 406/831] 10.222.0.49 () {58 vars in 1235 bytes} [Tue Dec 14 13:03:41 2021] GET /compute/v2.1/servers/1b8e1f2f-c109-4413-9d56-33ef0b651f85 => generated 1723 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 14 13:03:41.479163 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.api.openstack.wsgi [None req-6b785206-8f03-4087-afa5-bfd79a848f79 tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] Calling method '>' {{(pid=116063) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 13:03:41.484243 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.compute.api [None req-6b785206-8f03-4087-afa5-bfd79a848f79 tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] [instance: 9b3b44a7-7c20-473c-841c-318e471fc6cd] Fetching instance by UUID {{(pid=116063) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 13:03:41.491268 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-6b785206-8f03-4087-afa5-bfd79a848f79 tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 13:03:41.491722 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-6b785206-8f03-4087-afa5-bfd79a848f79 tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 13:03:41.492562 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-6b785206-8f03-4087-afa5-bfd79a848f79 tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 13:03:41.493014 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-6b785206-8f03-4087-afa5-bfd79a848f79 tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 13:03:41.687780 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.policy [None req-6b785206-8f03-4087-afa5-bfd79a848f79 tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79d74a2ea1e541d28d085c15cec34032', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68a8770b8dbe489a8119016fbee64eb5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116063) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 13:03:41.696685 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.policy [None req-6b785206-8f03-4087-afa5-bfd79a848f79 tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '79d74a2ea1e541d28d085c15cec34032', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68a8770b8dbe489a8119016fbee64eb5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116063) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 13:03:41.698234 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.policy [None req-6b785206-8f03-4087-afa5-bfd79a848f79 tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '79d74a2ea1e541d28d085c15cec34032', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68a8770b8dbe489a8119016fbee64eb5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116063) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 13:03:41.699429 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: INFO nova.api.openstack.requestlog [None req-6b785206-8f03-4087-afa5-bfd79a848f79 tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] 10.222.0.49 "GET /compute/v2.1/servers/9b3b44a7-7c20-473c-841c-318e471fc6cd" status: 200 len: 1722 microversion: 2.20 time: 0.225864 Dec 14 13:03:41.700141 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: [pid: 116063|app: 0|req: 426/832] 10.222.0.49 () {60 vars in 1276 bytes} [Tue Dec 14 13:03:41 2021] GET /compute/v2.1/servers/9b3b44a7-7c20-473c-841c-318e471fc6cd => generated 1722 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 14 13:03:41.742417 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.api.openstack.wsgi [None req-32387366-156a-442c-a4ea-03cf5c40ef0b tempest-TestMinimumBasicScenario-84513626 tempest-TestMinimumBasicScenario-84513626-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-secgroup-smoke-1782610082"}} {{(pid=116064) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 14 13:03:41.742991 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.compute.api [None req-32387366-156a-442c-a4ea-03cf5c40ef0b tempest-TestMinimumBasicScenario-84513626 tempest-TestMinimumBasicScenario-84513626-project] [instance: dd367814-45bc-4808-b2de-d54f79eb7933] Fetching instance by UUID {{(pid=116064) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 13:03:41.749149 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-32387366-156a-442c-a4ea-03cf5c40ef0b tempest-TestMinimumBasicScenario-84513626 tempest-TestMinimumBasicScenario-84513626-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 13:03:41.749589 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-32387366-156a-442c-a4ea-03cf5c40ef0b tempest-TestMinimumBasicScenario-84513626 tempest-TestMinimumBasicScenario-84513626-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 13:03:41.750356 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-32387366-156a-442c-a4ea-03cf5c40ef0b tempest-TestMinimumBasicScenario-84513626 tempest-TestMinimumBasicScenario-84513626-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 13:03:41.750785 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-32387366-156a-442c-a4ea-03cf5c40ef0b tempest-TestMinimumBasicScenario-84513626 tempest-TestMinimumBasicScenario-84513626-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 13:03:41.892170 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: INFO nova.network.security_group_api [None req-32387366-156a-442c-a4ea-03cf5c40ef0b tempest-TestMinimumBasicScenario-84513626 tempest-TestMinimumBasicScenario-84513626-project] Adding security group 8f3f2143-9262-42ac-8efb-3e90e10f7764 to port fee608e1-5f95-4491-9016-8fcb3872f581 Dec 14 13:03:42.307714 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.api.openstack.wsgi [None req-3f2833c9-1039-4985-8667-04cf3ff87d00 tempest-AttachVolumeTestJSON-709357402 tempest-AttachVolumeTestJSON-709357402-project] Calling method '>' {{(pid=116063) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 13:03:42.308325 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.compute.api [None req-3f2833c9-1039-4985-8667-04cf3ff87d00 tempest-AttachVolumeTestJSON-709357402 tempest-AttachVolumeTestJSON-709357402-project] [instance: 1b8e1f2f-c109-4413-9d56-33ef0b651f85] Fetching instance by UUID {{(pid=116063) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 13:03:42.314624 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-3f2833c9-1039-4985-8667-04cf3ff87d00 tempest-AttachVolumeTestJSON-709357402 tempest-AttachVolumeTestJSON-709357402-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 13:03:42.315072 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-3f2833c9-1039-4985-8667-04cf3ff87d00 tempest-AttachVolumeTestJSON-709357402 tempest-AttachVolumeTestJSON-709357402-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 13:03:42.315854 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-3f2833c9-1039-4985-8667-04cf3ff87d00 tempest-AttachVolumeTestJSON-709357402 tempest-AttachVolumeTestJSON-709357402-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 13:03:42.316284 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-3f2833c9-1039-4985-8667-04cf3ff87d00 tempest-AttachVolumeTestJSON-709357402 tempest-AttachVolumeTestJSON-709357402-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 13:03:42.560578 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.policy [None req-3f2833c9-1039-4985-8667-04cf3ff87d00 tempest-AttachVolumeTestJSON-709357402 tempest-AttachVolumeTestJSON-709357402-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '083128ec42474a3e82a2b0fc8c278f4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b1a390d20a54f4d9529d286ab7764a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116063) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 13:03:42.570924 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: INFO nova.api.openstack.requestlog [None req-3f2833c9-1039-4985-8667-04cf3ff87d00 tempest-AttachVolumeTestJSON-709357402 tempest-AttachVolumeTestJSON-709357402-project] 10.222.0.49 "GET /compute/v2.1/servers/1b8e1f2f-c109-4413-9d56-33ef0b651f85" status: 200 len: 1723 microversion: 2.1 time: 0.266994 Dec 14 13:03:42.571757 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: [pid: 116063|app: 0|req: 427/833] 10.222.0.49 () {58 vars in 1235 bytes} [Tue Dec 14 13:03:42 2021] GET /compute/v2.1/servers/1b8e1f2f-c109-4413-9d56-33ef0b651f85 => generated 1723 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 14 13:03:42.578658 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: INFO nova.api.openstack.requestlog [None req-32387366-156a-442c-a4ea-03cf5c40ef0b tempest-TestMinimumBasicScenario-84513626 tempest-TestMinimumBasicScenario-84513626-project] 10.222.0.49 "POST /compute/v2.1/servers/dd367814-45bc-4808-b2de-d54f79eb7933/action" status: 202 len: 0 microversion: 2.1 time: 0.839972 Dec 14 13:03:42.584307 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: [pid: 116064|app: 0|req: 407/834] 10.222.0.49 () {60 vars in 1277 bytes} [Tue Dec 14 13:03:41 2021] POST /compute/v2.1/servers/dd367814-45bc-4808-b2de-d54f79eb7933/action => generated 0 bytes in 846 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Dec 14 13:03:42.588183 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.api.openstack.wsgi [None req-da8d8d6d-09cd-42f2-9320-1b6b88212598 tempest-TestMinimumBasicScenario-84513626 tempest-TestMinimumBasicScenario-84513626-project] Calling method '>' {{(pid=116063) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 13:03:42.588789 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.compute.api [None req-da8d8d6d-09cd-42f2-9320-1b6b88212598 tempest-TestMinimumBasicScenario-84513626 tempest-TestMinimumBasicScenario-84513626-project] [instance: dd367814-45bc-4808-b2de-d54f79eb7933] Fetching instance by UUID {{(pid=116063) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 13:03:42.597302 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-da8d8d6d-09cd-42f2-9320-1b6b88212598 tempest-TestMinimumBasicScenario-84513626 tempest-TestMinimumBasicScenario-84513626-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 13:03:42.598029 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-da8d8d6d-09cd-42f2-9320-1b6b88212598 tempest-TestMinimumBasicScenario-84513626 tempest-TestMinimumBasicScenario-84513626-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 13:03:42.599042 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-da8d8d6d-09cd-42f2-9320-1b6b88212598 tempest-TestMinimumBasicScenario-84513626 tempest-TestMinimumBasicScenario-84513626-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 13:03:42.599621 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-da8d8d6d-09cd-42f2-9320-1b6b88212598 tempest-TestMinimumBasicScenario-84513626 tempest-TestMinimumBasicScenario-84513626-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 13:03:42.675461 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.api.openstack.wsgi [req-5b4d5078-eba6-48dd-ad31-451ce9d32f1c req-97bf578b-10a3-4738-a682-721b2015ce80 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "dd367814-45bc-4808-b2de-d54f79eb7933", "tag": "fee608e1-5f95-4491-9016-8fcb3872f581"}]} {{(pid=116064) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 14 13:03:42.677521 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 14 13:03:42.677521 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: warnings.warn(msg) Dec 14 13:03:42.686726 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [req-5b4d5078-eba6-48dd-ad31-451ce9d32f1c req-97bf578b-10a3-4738-a682-721b2015ce80 service nova] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 13:03:42.687327 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [req-5b4d5078-eba6-48dd-ad31-451ce9d32f1c req-97bf578b-10a3-4738-a682-721b2015ce80 service nova] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 13:03:42.704124 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: INFO nova.api.openstack.compute.server_external_events [req-5b4d5078-eba6-48dd-ad31-451ce9d32f1c req-97bf578b-10a3-4738-a682-721b2015ce80 service nova] Creating event network-changed:fee608e1-5f95-4491-9016-8fcb3872f581 for instance dd367814-45bc-4808-b2de-d54f79eb7933 on hv-cinder-78447 Dec 14 13:03:42.713770 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: INFO nova.api.openstack.requestlog [req-5b4d5078-eba6-48dd-ad31-451ce9d32f1c req-97bf578b-10a3-4738-a682-721b2015ce80 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.126539 Dec 14 13:03:42.715051 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: [pid: 116064|app: 0|req: 408/835] 10.222.0.49 () {64 vars in 1317 bytes} [Tue Dec 14 13:03:42 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Dec 14 13:03:42.722223 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.api.openstack.wsgi [None req-bb264117-03c7-43d3-bc9b-ec9f525e93a5 tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] Calling method '>' {{(pid=116064) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 13:03:42.723223 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.compute.api [None req-bb264117-03c7-43d3-bc9b-ec9f525e93a5 tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] [instance: 9b3b44a7-7c20-473c-841c-318e471fc6cd] Fetching instance by UUID {{(pid=116064) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 13:03:42.731122 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-bb264117-03c7-43d3-bc9b-ec9f525e93a5 tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 13:03:42.731917 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-bb264117-03c7-43d3-bc9b-ec9f525e93a5 tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 13:03:42.733014 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-bb264117-03c7-43d3-bc9b-ec9f525e93a5 tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 13:03:42.733630 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-bb264117-03c7-43d3-bc9b-ec9f525e93a5 tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 13:03:42.790071 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.policy [None req-da8d8d6d-09cd-42f2-9320-1b6b88212598 tempest-TestMinimumBasicScenario-84513626 tempest-TestMinimumBasicScenario-84513626-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edf65e37b42d40b28c4e90bd92987016', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bcb503e37b2449484c788574e4c88f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116063) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 13:03:42.799010 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: INFO nova.api.openstack.requestlog [None req-da8d8d6d-09cd-42f2-9320-1b6b88212598 tempest-TestMinimumBasicScenario-84513626 tempest-TestMinimumBasicScenario-84513626-project] 10.222.0.49 "GET /compute/v2.1/servers/dd367814-45bc-4808-b2de-d54f79eb7933" status: 200 len: 1759 microversion: 2.1 time: 0.214502 Dec 14 13:03:42.800905 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: [pid: 116063|app: 0|req: 428/836] 10.222.0.49 () {58 vars in 1235 bytes} [Tue Dec 14 13:03:42 2021] GET /compute/v2.1/servers/dd367814-45bc-4808-b2de-d54f79eb7933 => generated 1759 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 14 13:03:42.919616 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.policy [None req-bb264117-03c7-43d3-bc9b-ec9f525e93a5 tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79d74a2ea1e541d28d085c15cec34032', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68a8770b8dbe489a8119016fbee64eb5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116064) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 13:03:42.927720 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.policy [None req-bb264117-03c7-43d3-bc9b-ec9f525e93a5 tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '79d74a2ea1e541d28d085c15cec34032', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68a8770b8dbe489a8119016fbee64eb5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116064) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 13:03:42.929303 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.policy [None req-bb264117-03c7-43d3-bc9b-ec9f525e93a5 tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '79d74a2ea1e541d28d085c15cec34032', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68a8770b8dbe489a8119016fbee64eb5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116064) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 13:03:42.930457 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: INFO nova.api.openstack.requestlog [None req-bb264117-03c7-43d3-bc9b-ec9f525e93a5 tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] 10.222.0.49 "GET /compute/v2.1/servers/9b3b44a7-7c20-473c-841c-318e471fc6cd" status: 200 len: 1722 microversion: 2.20 time: 0.213878 Dec 14 13:03:42.931335 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: [pid: 116064|app: 0|req: 409/837] 10.222.0.49 () {60 vars in 1276 bytes} [Tue Dec 14 13:03:42 2021] GET /compute/v2.1/servers/9b3b44a7-7c20-473c-841c-318e471fc6cd => generated 1722 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 14 13:03:43.592548 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.api.openstack.wsgi [None req-f7d52fa2-09a9-4721-bc6f-51b098b4a2ff tempest-AttachVolumeTestJSON-709357402 tempest-AttachVolumeTestJSON-709357402-project] Calling method '>' {{(pid=116063) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 13:03:43.593536 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.compute.api [None req-f7d52fa2-09a9-4721-bc6f-51b098b4a2ff tempest-AttachVolumeTestJSON-709357402 tempest-AttachVolumeTestJSON-709357402-project] [instance: 1b8e1f2f-c109-4413-9d56-33ef0b651f85] Fetching instance by UUID {{(pid=116063) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 13:03:43.603008 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-f7d52fa2-09a9-4721-bc6f-51b098b4a2ff tempest-AttachVolumeTestJSON-709357402 tempest-AttachVolumeTestJSON-709357402-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 13:03:43.603465 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-f7d52fa2-09a9-4721-bc6f-51b098b4a2ff tempest-AttachVolumeTestJSON-709357402 tempest-AttachVolumeTestJSON-709357402-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 13:03:43.604245 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-f7d52fa2-09a9-4721-bc6f-51b098b4a2ff tempest-AttachVolumeTestJSON-709357402 tempest-AttachVolumeTestJSON-709357402-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 13:03:43.604680 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-f7d52fa2-09a9-4721-bc6f-51b098b4a2ff tempest-AttachVolumeTestJSON-709357402 tempest-AttachVolumeTestJSON-709357402-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 13:03:43.742360 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.policy [None req-f7d52fa2-09a9-4721-bc6f-51b098b4a2ff tempest-AttachVolumeTestJSON-709357402 tempest-AttachVolumeTestJSON-709357402-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '083128ec42474a3e82a2b0fc8c278f4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b1a390d20a54f4d9529d286ab7764a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116063) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 13:03:43.751021 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: INFO nova.api.openstack.requestlog [None req-f7d52fa2-09a9-4721-bc6f-51b098b4a2ff tempest-AttachVolumeTestJSON-709357402 tempest-AttachVolumeTestJSON-709357402-project] 10.222.0.49 "GET /compute/v2.1/servers/1b8e1f2f-c109-4413-9d56-33ef0b651f85" status: 200 len: 1723 microversion: 2.1 time: 0.164763 Dec 14 13:03:43.751587 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: [pid: 116063|app: 0|req: 429/838] 10.222.0.49 () {58 vars in 1235 bytes} [Tue Dec 14 13:03:43 2021] GET /compute/v2.1/servers/1b8e1f2f-c109-4413-9d56-33ef0b651f85 => generated 1723 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 14 13:03:43.953205 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.api.openstack.wsgi [None req-01e97db7-e251-4244-b540-7da236f87c08 tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] Calling method '>' {{(pid=116064) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 13:03:43.954209 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.compute.api [None req-01e97db7-e251-4244-b540-7da236f87c08 tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] [instance: 9b3b44a7-7c20-473c-841c-318e471fc6cd] Fetching instance by UUID {{(pid=116064) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 13:03:43.963438 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-01e97db7-e251-4244-b540-7da236f87c08 tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 13:03:43.963887 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-01e97db7-e251-4244-b540-7da236f87c08 tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 13:03:43.964657 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-01e97db7-e251-4244-b540-7da236f87c08 tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 13:03:43.965118 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-01e97db7-e251-4244-b540-7da236f87c08 tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 13:03:44.095895 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.policy [None req-01e97db7-e251-4244-b540-7da236f87c08 tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79d74a2ea1e541d28d085c15cec34032', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68a8770b8dbe489a8119016fbee64eb5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116064) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 13:03:44.103792 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.policy [None req-01e97db7-e251-4244-b540-7da236f87c08 tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '79d74a2ea1e541d28d085c15cec34032', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68a8770b8dbe489a8119016fbee64eb5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116064) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 13:03:44.105311 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.policy [None req-01e97db7-e251-4244-b540-7da236f87c08 tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '79d74a2ea1e541d28d085c15cec34032', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68a8770b8dbe489a8119016fbee64eb5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116064) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 13:03:44.106458 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: INFO nova.api.openstack.requestlog [None req-01e97db7-e251-4244-b540-7da236f87c08 tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] 10.222.0.49 "GET /compute/v2.1/servers/9b3b44a7-7c20-473c-841c-318e471fc6cd" status: 200 len: 1722 microversion: 2.20 time: 0.159592 Dec 14 13:03:44.106994 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: [pid: 116064|app: 0|req: 410/839] 10.222.0.49 () {60 vars in 1276 bytes} [Tue Dec 14 13:03:43 2021] GET /compute/v2.1/servers/9b3b44a7-7c20-473c-841c-318e471fc6cd => generated 1722 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 14 13:03:44.767751 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.api.openstack.wsgi [None req-9f92328d-b14e-4d89-8bd9-a21a57d601c1 tempest-AttachVolumeTestJSON-709357402 tempest-AttachVolumeTestJSON-709357402-project] Calling method '>' {{(pid=116063) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 13:03:44.768328 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.compute.api [None req-9f92328d-b14e-4d89-8bd9-a21a57d601c1 tempest-AttachVolumeTestJSON-709357402 tempest-AttachVolumeTestJSON-709357402-project] [instance: 1b8e1f2f-c109-4413-9d56-33ef0b651f85] Fetching instance by UUID {{(pid=116063) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 13:03:44.775444 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-9f92328d-b14e-4d89-8bd9-a21a57d601c1 tempest-AttachVolumeTestJSON-709357402 tempest-AttachVolumeTestJSON-709357402-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 13:03:44.775899 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-9f92328d-b14e-4d89-8bd9-a21a57d601c1 tempest-AttachVolumeTestJSON-709357402 tempest-AttachVolumeTestJSON-709357402-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 13:03:44.776687 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-9f92328d-b14e-4d89-8bd9-a21a57d601c1 tempest-AttachVolumeTestJSON-709357402 tempest-AttachVolumeTestJSON-709357402-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 13:03:44.777159 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-9f92328d-b14e-4d89-8bd9-a21a57d601c1 tempest-AttachVolumeTestJSON-709357402 tempest-AttachVolumeTestJSON-709357402-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 13:03:44.914037 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.policy [None req-9f92328d-b14e-4d89-8bd9-a21a57d601c1 tempest-AttachVolumeTestJSON-709357402 tempest-AttachVolumeTestJSON-709357402-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '083128ec42474a3e82a2b0fc8c278f4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b1a390d20a54f4d9529d286ab7764a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116063) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 13:03:44.922876 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: INFO nova.api.openstack.requestlog [None req-9f92328d-b14e-4d89-8bd9-a21a57d601c1 tempest-AttachVolumeTestJSON-709357402 tempest-AttachVolumeTestJSON-709357402-project] 10.222.0.49 "GET /compute/v2.1/servers/1b8e1f2f-c109-4413-9d56-33ef0b651f85" status: 200 len: 1723 microversion: 2.1 time: 0.159021 Dec 14 13:03:44.923453 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: [pid: 116063|app: 0|req: 430/840] 10.222.0.49 () {58 vars in 1235 bytes} [Tue Dec 14 13:03:44 2021] GET /compute/v2.1/servers/1b8e1f2f-c109-4413-9d56-33ef0b651f85 => generated 1723 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 14 13:03:45.128548 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.api.openstack.wsgi [None req-735292cb-b246-4d43-a387-5a121bd3b6ed tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] Calling method '>' {{(pid=116064) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 13:03:45.129594 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.compute.api [None req-735292cb-b246-4d43-a387-5a121bd3b6ed tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] [instance: 9b3b44a7-7c20-473c-841c-318e471fc6cd] Fetching instance by UUID {{(pid=116064) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 13:03:45.140249 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-735292cb-b246-4d43-a387-5a121bd3b6ed tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 13:03:45.141098 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-735292cb-b246-4d43-a387-5a121bd3b6ed tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 13:03:45.142385 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-735292cb-b246-4d43-a387-5a121bd3b6ed tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 13:03:45.143106 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-735292cb-b246-4d43-a387-5a121bd3b6ed tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 13:03:45.282571 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.policy [None req-735292cb-b246-4d43-a387-5a121bd3b6ed tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79d74a2ea1e541d28d085c15cec34032', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68a8770b8dbe489a8119016fbee64eb5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116064) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 13:03:45.290748 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.policy [None req-735292cb-b246-4d43-a387-5a121bd3b6ed tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '79d74a2ea1e541d28d085c15cec34032', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68a8770b8dbe489a8119016fbee64eb5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116064) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 13:03:45.292242 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.policy [None req-735292cb-b246-4d43-a387-5a121bd3b6ed tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '79d74a2ea1e541d28d085c15cec34032', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68a8770b8dbe489a8119016fbee64eb5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116064) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 13:03:45.293799 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: INFO nova.api.openstack.requestlog [None req-735292cb-b246-4d43-a387-5a121bd3b6ed tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] 10.222.0.49 "GET /compute/v2.1/servers/9b3b44a7-7c20-473c-841c-318e471fc6cd" status: 200 len: 1722 microversion: 2.20 time: 0.171437 Dec 14 13:03:45.294370 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: [pid: 116064|app: 0|req: 411/841] 10.222.0.49 () {60 vars in 1276 bytes} [Tue Dec 14 13:03:45 2021] GET /compute/v2.1/servers/9b3b44a7-7c20-473c-841c-318e471fc6cd => generated 1722 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 14 13:03:45.950361 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.api.openstack.wsgi [None req-bba6c531-183f-4c2a-a088-a9e41473d36f tempest-AttachVolumeTestJSON-709357402 tempest-AttachVolumeTestJSON-709357402-project] Calling method '>' {{(pid=116063) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 13:03:45.951343 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.compute.api [None req-bba6c531-183f-4c2a-a088-a9e41473d36f tempest-AttachVolumeTestJSON-709357402 tempest-AttachVolumeTestJSON-709357402-project] [instance: 1b8e1f2f-c109-4413-9d56-33ef0b651f85] Fetching instance by UUID {{(pid=116063) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 13:03:45.961683 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-bba6c531-183f-4c2a-a088-a9e41473d36f tempest-AttachVolumeTestJSON-709357402 tempest-AttachVolumeTestJSON-709357402-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 13:03:45.962122 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-bba6c531-183f-4c2a-a088-a9e41473d36f tempest-AttachVolumeTestJSON-709357402 tempest-AttachVolumeTestJSON-709357402-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 13:03:45.962884 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-bba6c531-183f-4c2a-a088-a9e41473d36f tempest-AttachVolumeTestJSON-709357402 tempest-AttachVolumeTestJSON-709357402-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 13:03:45.963312 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-bba6c531-183f-4c2a-a088-a9e41473d36f tempest-AttachVolumeTestJSON-709357402 tempest-AttachVolumeTestJSON-709357402-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 13:03:46.093799 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.policy [None req-bba6c531-183f-4c2a-a088-a9e41473d36f tempest-AttachVolumeTestJSON-709357402 tempest-AttachVolumeTestJSON-709357402-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '083128ec42474a3e82a2b0fc8c278f4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b1a390d20a54f4d9529d286ab7764a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116063) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 13:03:46.101719 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: INFO nova.api.openstack.requestlog [None req-bba6c531-183f-4c2a-a088-a9e41473d36f tempest-AttachVolumeTestJSON-709357402 tempest-AttachVolumeTestJSON-709357402-project] 10.222.0.49 "GET /compute/v2.1/servers/1b8e1f2f-c109-4413-9d56-33ef0b651f85" status: 200 len: 1723 microversion: 2.1 time: 0.157684 Dec 14 13:03:46.102291 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: [pid: 116063|app: 0|req: 431/842] 10.222.0.49 () {58 vars in 1235 bytes} [Tue Dec 14 13:03:45 2021] GET /compute/v2.1/servers/1b8e1f2f-c109-4413-9d56-33ef0b651f85 => generated 1723 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 14 13:03:46.315591 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.api.openstack.wsgi [None req-dcc7d3c3-6a02-4b36-8ab4-f451a24074a4 tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] Calling method '>' {{(pid=116064) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 13:03:46.316411 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.compute.api [None req-dcc7d3c3-6a02-4b36-8ab4-f451a24074a4 tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] [instance: 9b3b44a7-7c20-473c-841c-318e471fc6cd] Fetching instance by UUID {{(pid=116064) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 13:03:46.324643 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-dcc7d3c3-6a02-4b36-8ab4-f451a24074a4 tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 13:03:46.325129 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-dcc7d3c3-6a02-4b36-8ab4-f451a24074a4 tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 13:03:46.325905 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-dcc7d3c3-6a02-4b36-8ab4-f451a24074a4 tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 13:03:46.326340 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-dcc7d3c3-6a02-4b36-8ab4-f451a24074a4 tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 13:03:46.468303 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.policy [None req-dcc7d3c3-6a02-4b36-8ab4-f451a24074a4 tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79d74a2ea1e541d28d085c15cec34032', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68a8770b8dbe489a8119016fbee64eb5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116064) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 13:03:46.478715 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.policy [None req-dcc7d3c3-6a02-4b36-8ab4-f451a24074a4 tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '79d74a2ea1e541d28d085c15cec34032', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68a8770b8dbe489a8119016fbee64eb5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116064) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 13:03:46.480197 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.policy [None req-dcc7d3c3-6a02-4b36-8ab4-f451a24074a4 tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '79d74a2ea1e541d28d085c15cec34032', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68a8770b8dbe489a8119016fbee64eb5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116064) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 13:03:46.481419 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: INFO nova.api.openstack.requestlog [None req-dcc7d3c3-6a02-4b36-8ab4-f451a24074a4 tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] 10.222.0.49 "GET /compute/v2.1/servers/9b3b44a7-7c20-473c-841c-318e471fc6cd" status: 200 len: 1722 microversion: 2.20 time: 0.172226 Dec 14 13:03:46.481986 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: [pid: 116064|app: 0|req: 412/843] 10.222.0.49 () {60 vars in 1276 bytes} [Tue Dec 14 13:03:46 2021] GET /compute/v2.1/servers/9b3b44a7-7c20-473c-841c-318e471fc6cd => generated 1722 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 14 13:03:47.124518 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.api.openstack.wsgi [None req-a82a7cf5-1a78-48bf-9263-e94f143cc8fd tempest-AttachVolumeTestJSON-709357402 tempest-AttachVolumeTestJSON-709357402-project] Calling method '>' {{(pid=116063) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 13:03:47.125155 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.compute.api [None req-a82a7cf5-1a78-48bf-9263-e94f143cc8fd tempest-AttachVolumeTestJSON-709357402 tempest-AttachVolumeTestJSON-709357402-project] [instance: 1b8e1f2f-c109-4413-9d56-33ef0b651f85] Fetching instance by UUID {{(pid=116063) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 13:03:47.132530 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-a82a7cf5-1a78-48bf-9263-e94f143cc8fd tempest-AttachVolumeTestJSON-709357402 tempest-AttachVolumeTestJSON-709357402-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 13:03:47.133007 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-a82a7cf5-1a78-48bf-9263-e94f143cc8fd tempest-AttachVolumeTestJSON-709357402 tempest-AttachVolumeTestJSON-709357402-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 13:03:47.133782 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-a82a7cf5-1a78-48bf-9263-e94f143cc8fd tempest-AttachVolumeTestJSON-709357402 tempest-AttachVolumeTestJSON-709357402-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 13:03:47.134205 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-a82a7cf5-1a78-48bf-9263-e94f143cc8fd tempest-AttachVolumeTestJSON-709357402 tempest-AttachVolumeTestJSON-709357402-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 13:03:47.266861 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.policy [None req-a82a7cf5-1a78-48bf-9263-e94f143cc8fd tempest-AttachVolumeTestJSON-709357402 tempest-AttachVolumeTestJSON-709357402-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '083128ec42474a3e82a2b0fc8c278f4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b1a390d20a54f4d9529d286ab7764a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116063) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 13:03:47.275198 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: INFO nova.api.openstack.requestlog [None req-a82a7cf5-1a78-48bf-9263-e94f143cc8fd tempest-AttachVolumeTestJSON-709357402 tempest-AttachVolumeTestJSON-709357402-project] 10.222.0.49 "GET /compute/v2.1/servers/1b8e1f2f-c109-4413-9d56-33ef0b651f85" status: 200 len: 1723 microversion: 2.1 time: 0.154855 Dec 14 13:03:47.275741 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: [pid: 116063|app: 0|req: 432/844] 10.222.0.49 () {58 vars in 1235 bytes} [Tue Dec 14 13:03:47 2021] GET /compute/v2.1/servers/1b8e1f2f-c109-4413-9d56-33ef0b651f85 => generated 1723 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 14 13:03:47.504203 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.api.openstack.wsgi [None req-af315ae7-0417-4562-8823-6f6eb530fadc tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] Calling method '>' {{(pid=116064) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 13:03:47.505162 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.compute.api [None req-af315ae7-0417-4562-8823-6f6eb530fadc tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] [instance: 9b3b44a7-7c20-473c-841c-318e471fc6cd] Fetching instance by UUID {{(pid=116064) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 13:03:47.516379 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-af315ae7-0417-4562-8823-6f6eb530fadc tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 13:03:47.517181 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-af315ae7-0417-4562-8823-6f6eb530fadc tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 13:03:47.518470 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-af315ae7-0417-4562-8823-6f6eb530fadc tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 13:03:47.519186 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-af315ae7-0417-4562-8823-6f6eb530fadc tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 13:03:47.667190 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.policy [None req-af315ae7-0417-4562-8823-6f6eb530fadc tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79d74a2ea1e541d28d085c15cec34032', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68a8770b8dbe489a8119016fbee64eb5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116064) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 13:03:47.675353 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.policy [None req-af315ae7-0417-4562-8823-6f6eb530fadc tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '79d74a2ea1e541d28d085c15cec34032', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68a8770b8dbe489a8119016fbee64eb5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116064) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 13:03:47.676842 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.policy [None req-af315ae7-0417-4562-8823-6f6eb530fadc tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '79d74a2ea1e541d28d085c15cec34032', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68a8770b8dbe489a8119016fbee64eb5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116064) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 13:03:47.678010 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: INFO nova.api.openstack.requestlog [None req-af315ae7-0417-4562-8823-6f6eb530fadc tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] 10.222.0.49 "GET /compute/v2.1/servers/9b3b44a7-7c20-473c-841c-318e471fc6cd" status: 200 len: 1722 microversion: 2.20 time: 0.180240 Dec 14 13:03:47.678578 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: [pid: 116064|app: 0|req: 413/845] 10.222.0.49 () {60 vars in 1276 bytes} [Tue Dec 14 13:03:47 2021] GET /compute/v2.1/servers/9b3b44a7-7c20-473c-841c-318e471fc6cd => generated 1722 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 14 13:03:48.296904 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.api.openstack.wsgi [None req-b57c5674-252f-40e8-8c20-95573fa42eb0 tempest-AttachVolumeTestJSON-709357402 tempest-AttachVolumeTestJSON-709357402-project] Calling method '>' {{(pid=116063) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 13:03:48.297966 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.compute.api [None req-b57c5674-252f-40e8-8c20-95573fa42eb0 tempest-AttachVolumeTestJSON-709357402 tempest-AttachVolumeTestJSON-709357402-project] [instance: 1b8e1f2f-c109-4413-9d56-33ef0b651f85] Fetching instance by UUID {{(pid=116063) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 13:03:48.307751 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-b57c5674-252f-40e8-8c20-95573fa42eb0 tempest-AttachVolumeTestJSON-709357402 tempest-AttachVolumeTestJSON-709357402-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 13:03:48.308203 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-b57c5674-252f-40e8-8c20-95573fa42eb0 tempest-AttachVolumeTestJSON-709357402 tempest-AttachVolumeTestJSON-709357402-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 13:03:48.309068 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-b57c5674-252f-40e8-8c20-95573fa42eb0 tempest-AttachVolumeTestJSON-709357402 tempest-AttachVolumeTestJSON-709357402-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 13:03:48.309506 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-b57c5674-252f-40e8-8c20-95573fa42eb0 tempest-AttachVolumeTestJSON-709357402 tempest-AttachVolumeTestJSON-709357402-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 13:03:48.451145 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.policy [None req-b57c5674-252f-40e8-8c20-95573fa42eb0 tempest-AttachVolumeTestJSON-709357402 tempest-AttachVolumeTestJSON-709357402-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '083128ec42474a3e82a2b0fc8c278f4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b1a390d20a54f4d9529d286ab7764a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116063) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 13:03:48.459003 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: INFO nova.api.openstack.requestlog [None req-b57c5674-252f-40e8-8c20-95573fa42eb0 tempest-AttachVolumeTestJSON-709357402 tempest-AttachVolumeTestJSON-709357402-project] 10.222.0.49 "GET /compute/v2.1/servers/1b8e1f2f-c109-4413-9d56-33ef0b651f85" status: 200 len: 1723 microversion: 2.1 time: 0.168650 Dec 14 13:03:48.459550 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: [pid: 116063|app: 0|req: 433/846] 10.222.0.49 () {58 vars in 1235 bytes} [Tue Dec 14 13:03:48 2021] GET /compute/v2.1/servers/1b8e1f2f-c109-4413-9d56-33ef0b651f85 => generated 1723 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 14 13:03:48.698387 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.api.openstack.wsgi [None req-68cc49ea-bee9-43a9-ab05-c312c2b9cfc7 tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] Calling method '>' {{(pid=116064) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 13:03:48.699052 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.compute.api [None req-68cc49ea-bee9-43a9-ab05-c312c2b9cfc7 tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] [instance: 9b3b44a7-7c20-473c-841c-318e471fc6cd] Fetching instance by UUID {{(pid=116064) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 13:03:48.706384 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-68cc49ea-bee9-43a9-ab05-c312c2b9cfc7 tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 13:03:48.706877 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-68cc49ea-bee9-43a9-ab05-c312c2b9cfc7 tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 13:03:48.707730 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-68cc49ea-bee9-43a9-ab05-c312c2b9cfc7 tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 13:03:48.708207 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-68cc49ea-bee9-43a9-ab05-c312c2b9cfc7 tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 13:03:48.848926 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.policy [None req-68cc49ea-bee9-43a9-ab05-c312c2b9cfc7 tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79d74a2ea1e541d28d085c15cec34032', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68a8770b8dbe489a8119016fbee64eb5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116064) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 13:03:48.857719 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.policy [None req-68cc49ea-bee9-43a9-ab05-c312c2b9cfc7 tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '79d74a2ea1e541d28d085c15cec34032', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68a8770b8dbe489a8119016fbee64eb5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116064) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 13:03:48.859222 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.policy [None req-68cc49ea-bee9-43a9-ab05-c312c2b9cfc7 tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '79d74a2ea1e541d28d085c15cec34032', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68a8770b8dbe489a8119016fbee64eb5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116064) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 13:03:48.860901 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: INFO nova.api.openstack.requestlog [None req-68cc49ea-bee9-43a9-ab05-c312c2b9cfc7 tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] 10.222.0.49 "GET /compute/v2.1/servers/9b3b44a7-7c20-473c-841c-318e471fc6cd" status: 200 len: 1722 microversion: 2.20 time: 0.167913 Dec 14 13:03:48.861616 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: [pid: 116064|app: 0|req: 414/847] 10.222.0.49 () {60 vars in 1276 bytes} [Tue Dec 14 13:03:48 2021] GET /compute/v2.1/servers/9b3b44a7-7c20-473c-841c-318e471fc6cd => generated 1722 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 14 13:03:49.489568 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.api.openstack.wsgi [None req-ce18f046-49e7-412e-8a9a-07be1bb5f682 tempest-AttachVolumeTestJSON-709357402 tempest-AttachVolumeTestJSON-709357402-project] Calling method '>' {{(pid=116063) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 13:03:49.490545 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.compute.api [None req-ce18f046-49e7-412e-8a9a-07be1bb5f682 tempest-AttachVolumeTestJSON-709357402 tempest-AttachVolumeTestJSON-709357402-project] [instance: 1b8e1f2f-c109-4413-9d56-33ef0b651f85] Fetching instance by UUID {{(pid=116063) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 13:03:49.501488 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-ce18f046-49e7-412e-8a9a-07be1bb5f682 tempest-AttachVolumeTestJSON-709357402 tempest-AttachVolumeTestJSON-709357402-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 13:03:49.502228 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-ce18f046-49e7-412e-8a9a-07be1bb5f682 tempest-AttachVolumeTestJSON-709357402 tempest-AttachVolumeTestJSON-709357402-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 13:03:49.503550 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-ce18f046-49e7-412e-8a9a-07be1bb5f682 tempest-AttachVolumeTestJSON-709357402 tempest-AttachVolumeTestJSON-709357402-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 13:03:49.504261 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-ce18f046-49e7-412e-8a9a-07be1bb5f682 tempest-AttachVolumeTestJSON-709357402 tempest-AttachVolumeTestJSON-709357402-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 13:03:49.642875 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.policy [None req-ce18f046-49e7-412e-8a9a-07be1bb5f682 tempest-AttachVolumeTestJSON-709357402 tempest-AttachVolumeTestJSON-709357402-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '083128ec42474a3e82a2b0fc8c278f4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b1a390d20a54f4d9529d286ab7764a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116063) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 13:03:49.651230 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: INFO nova.api.openstack.requestlog [None req-ce18f046-49e7-412e-8a9a-07be1bb5f682 tempest-AttachVolumeTestJSON-709357402 tempest-AttachVolumeTestJSON-709357402-project] 10.222.0.49 "GET /compute/v2.1/servers/1b8e1f2f-c109-4413-9d56-33ef0b651f85" status: 200 len: 1723 microversion: 2.1 time: 0.168013 Dec 14 13:03:49.651808 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: [pid: 116063|app: 0|req: 434/848] 10.222.0.49 () {58 vars in 1235 bytes} [Tue Dec 14 13:03:49 2021] GET /compute/v2.1/servers/1b8e1f2f-c109-4413-9d56-33ef0b651f85 => generated 1723 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 14 13:03:49.882353 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.api.openstack.wsgi [None req-180d7a8f-95c7-4117-a735-32badbc641b4 tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] Calling method '>' {{(pid=116064) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 13:03:49.882960 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.compute.api [None req-180d7a8f-95c7-4117-a735-32badbc641b4 tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] [instance: 9b3b44a7-7c20-473c-841c-318e471fc6cd] Fetching instance by UUID {{(pid=116064) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 13:03:49.892728 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-180d7a8f-95c7-4117-a735-32badbc641b4 tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 13:03:49.893437 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-180d7a8f-95c7-4117-a735-32badbc641b4 tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 13:03:49.894542 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-180d7a8f-95c7-4117-a735-32badbc641b4 tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 13:03:49.895054 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-180d7a8f-95c7-4117-a735-32badbc641b4 tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 13:03:50.036686 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.policy [None req-180d7a8f-95c7-4117-a735-32badbc641b4 tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79d74a2ea1e541d28d085c15cec34032', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68a8770b8dbe489a8119016fbee64eb5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116064) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 13:03:50.045411 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.policy [None req-180d7a8f-95c7-4117-a735-32badbc641b4 tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '79d74a2ea1e541d28d085c15cec34032', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68a8770b8dbe489a8119016fbee64eb5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116064) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 13:03:50.046839 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.policy [None req-180d7a8f-95c7-4117-a735-32badbc641b4 tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '79d74a2ea1e541d28d085c15cec34032', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68a8770b8dbe489a8119016fbee64eb5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116064) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 13:03:50.047988 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: INFO nova.api.openstack.requestlog [None req-180d7a8f-95c7-4117-a735-32badbc641b4 tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] 10.222.0.49 "GET /compute/v2.1/servers/9b3b44a7-7c20-473c-841c-318e471fc6cd" status: 200 len: 1722 microversion: 2.20 time: 0.171693 Dec 14 13:03:50.048558 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: [pid: 116064|app: 0|req: 415/849] 10.222.0.49 () {60 vars in 1276 bytes} [Tue Dec 14 13:03:49 2021] GET /compute/v2.1/servers/9b3b44a7-7c20-473c-841c-318e471fc6cd => generated 1722 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 14 13:03:50.668568 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.api.openstack.wsgi [None req-eebb70ca-a81c-491c-9e9d-3c34d6c5e440 tempest-AttachVolumeTestJSON-709357402 tempest-AttachVolumeTestJSON-709357402-project] Calling method '>' {{(pid=116063) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 13:03:50.669290 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.compute.api [None req-eebb70ca-a81c-491c-9e9d-3c34d6c5e440 tempest-AttachVolumeTestJSON-709357402 tempest-AttachVolumeTestJSON-709357402-project] [instance: 1b8e1f2f-c109-4413-9d56-33ef0b651f85] Fetching instance by UUID {{(pid=116063) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 13:03:50.675922 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-eebb70ca-a81c-491c-9e9d-3c34d6c5e440 tempest-AttachVolumeTestJSON-709357402 tempest-AttachVolumeTestJSON-709357402-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 13:03:50.676371 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-eebb70ca-a81c-491c-9e9d-3c34d6c5e440 tempest-AttachVolumeTestJSON-709357402 tempest-AttachVolumeTestJSON-709357402-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 13:03:50.677186 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-eebb70ca-a81c-491c-9e9d-3c34d6c5e440 tempest-AttachVolumeTestJSON-709357402 tempest-AttachVolumeTestJSON-709357402-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 13:03:50.677619 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-eebb70ca-a81c-491c-9e9d-3c34d6c5e440 tempest-AttachVolumeTestJSON-709357402 tempest-AttachVolumeTestJSON-709357402-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 13:03:50.819482 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.policy [None req-eebb70ca-a81c-491c-9e9d-3c34d6c5e440 tempest-AttachVolumeTestJSON-709357402 tempest-AttachVolumeTestJSON-709357402-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '083128ec42474a3e82a2b0fc8c278f4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b1a390d20a54f4d9529d286ab7764a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116063) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 13:03:50.827891 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: INFO nova.api.openstack.requestlog [None req-eebb70ca-a81c-491c-9e9d-3c34d6c5e440 tempest-AttachVolumeTestJSON-709357402 tempest-AttachVolumeTestJSON-709357402-project] 10.222.0.49 "GET /compute/v2.1/servers/1b8e1f2f-c109-4413-9d56-33ef0b651f85" status: 200 len: 1723 microversion: 2.1 time: 0.163464 Dec 14 13:03:50.828450 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: [pid: 116063|app: 0|req: 435/850] 10.222.0.49 () {58 vars in 1235 bytes} [Tue Dec 14 13:03:50 2021] GET /compute/v2.1/servers/1b8e1f2f-c109-4413-9d56-33ef0b651f85 => generated 1723 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 14 13:03:51.070112 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.api.openstack.wsgi [None req-7180a63c-37c6-4d91-a5ef-969b302de95c tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] Calling method '>' {{(pid=116064) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 13:03:51.071102 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.compute.api [None req-7180a63c-37c6-4d91-a5ef-969b302de95c tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] [instance: 9b3b44a7-7c20-473c-841c-318e471fc6cd] Fetching instance by UUID {{(pid=116064) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 13:03:51.082048 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-7180a63c-37c6-4d91-a5ef-969b302de95c tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 13:03:51.082844 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-7180a63c-37c6-4d91-a5ef-969b302de95c tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 13:03:51.084122 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-7180a63c-37c6-4d91-a5ef-969b302de95c tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 13:03:51.084836 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-7180a63c-37c6-4d91-a5ef-969b302de95c tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 13:03:51.229553 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.policy [None req-7180a63c-37c6-4d91-a5ef-969b302de95c tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79d74a2ea1e541d28d085c15cec34032', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68a8770b8dbe489a8119016fbee64eb5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116064) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 13:03:51.237720 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.policy [None req-7180a63c-37c6-4d91-a5ef-969b302de95c tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '79d74a2ea1e541d28d085c15cec34032', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68a8770b8dbe489a8119016fbee64eb5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116064) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 13:03:51.239215 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.policy [None req-7180a63c-37c6-4d91-a5ef-969b302de95c tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '79d74a2ea1e541d28d085c15cec34032', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68a8770b8dbe489a8119016fbee64eb5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116064) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 13:03:51.240371 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: INFO nova.api.openstack.requestlog [None req-7180a63c-37c6-4d91-a5ef-969b302de95c tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] 10.222.0.49 "GET /compute/v2.1/servers/9b3b44a7-7c20-473c-841c-318e471fc6cd" status: 200 len: 1722 microversion: 2.20 time: 0.176508 Dec 14 13:03:51.241001 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: [pid: 116064|app: 0|req: 416/851] 10.222.0.49 () {60 vars in 1276 bytes} [Tue Dec 14 13:03:51 2021] GET /compute/v2.1/servers/9b3b44a7-7c20-473c-841c-318e471fc6cd => generated 1722 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 14 13:03:51.849033 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.api.openstack.wsgi [None req-b5191f1d-064d-4434-baf5-6eef97ec741a tempest-AttachVolumeTestJSON-709357402 tempest-AttachVolumeTestJSON-709357402-project] Calling method '>' {{(pid=116063) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 13:03:51.850945 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.compute.api [None req-b5191f1d-064d-4434-baf5-6eef97ec741a tempest-AttachVolumeTestJSON-709357402 tempest-AttachVolumeTestJSON-709357402-project] [instance: 1b8e1f2f-c109-4413-9d56-33ef0b651f85] Fetching instance by UUID {{(pid=116063) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 13:03:51.862250 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-b5191f1d-064d-4434-baf5-6eef97ec741a tempest-AttachVolumeTestJSON-709357402 tempest-AttachVolumeTestJSON-709357402-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 13:03:51.862992 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-b5191f1d-064d-4434-baf5-6eef97ec741a tempest-AttachVolumeTestJSON-709357402 tempest-AttachVolumeTestJSON-709357402-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 13:03:51.864527 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-b5191f1d-064d-4434-baf5-6eef97ec741a tempest-AttachVolumeTestJSON-709357402 tempest-AttachVolumeTestJSON-709357402-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 13:03:51.865282 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-b5191f1d-064d-4434-baf5-6eef97ec741a tempest-AttachVolumeTestJSON-709357402 tempest-AttachVolumeTestJSON-709357402-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 13:03:52.005716 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.policy [None req-b5191f1d-064d-4434-baf5-6eef97ec741a tempest-AttachVolumeTestJSON-709357402 tempest-AttachVolumeTestJSON-709357402-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '083128ec42474a3e82a2b0fc8c278f4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b1a390d20a54f4d9529d286ab7764a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116063) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 13:03:52.017874 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: INFO nova.api.openstack.requestlog [None req-b5191f1d-064d-4434-baf5-6eef97ec741a tempest-AttachVolumeTestJSON-709357402 tempest-AttachVolumeTestJSON-709357402-project] 10.222.0.49 "GET /compute/v2.1/servers/1b8e1f2f-c109-4413-9d56-33ef0b651f85" status: 200 len: 1723 microversion: 2.1 time: 0.174740 Dec 14 13:03:52.018656 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: [pid: 116063|app: 0|req: 436/852] 10.222.0.49 () {58 vars in 1235 bytes} [Tue Dec 14 13:03:51 2021] GET /compute/v2.1/servers/1b8e1f2f-c109-4413-9d56-33ef0b651f85 => generated 1723 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 14 13:03:52.262387 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.api.openstack.wsgi [None req-eaae8dd2-0a92-4b8f-9f47-7bd7ef8dd216 tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] Calling method '>' {{(pid=116064) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 13:03:52.263118 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.compute.api [None req-eaae8dd2-0a92-4b8f-9f47-7bd7ef8dd216 tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] [instance: 9b3b44a7-7c20-473c-841c-318e471fc6cd] Fetching instance by UUID {{(pid=116064) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 13:03:52.272240 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-eaae8dd2-0a92-4b8f-9f47-7bd7ef8dd216 tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 13:03:52.272912 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-eaae8dd2-0a92-4b8f-9f47-7bd7ef8dd216 tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 13:03:52.274187 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-eaae8dd2-0a92-4b8f-9f47-7bd7ef8dd216 tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 13:03:52.274927 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-eaae8dd2-0a92-4b8f-9f47-7bd7ef8dd216 tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 13:03:52.408616 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.policy [None req-eaae8dd2-0a92-4b8f-9f47-7bd7ef8dd216 tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79d74a2ea1e541d28d085c15cec34032', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68a8770b8dbe489a8119016fbee64eb5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116064) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 13:03:52.417354 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.policy [None req-eaae8dd2-0a92-4b8f-9f47-7bd7ef8dd216 tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '79d74a2ea1e541d28d085c15cec34032', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68a8770b8dbe489a8119016fbee64eb5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116064) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 13:03:52.419197 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.policy [None req-eaae8dd2-0a92-4b8f-9f47-7bd7ef8dd216 tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '79d74a2ea1e541d28d085c15cec34032', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68a8770b8dbe489a8119016fbee64eb5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116064) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 13:03:52.420344 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: INFO nova.api.openstack.requestlog [None req-eaae8dd2-0a92-4b8f-9f47-7bd7ef8dd216 tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] 10.222.0.49 "GET /compute/v2.1/servers/9b3b44a7-7c20-473c-841c-318e471fc6cd" status: 200 len: 1722 microversion: 2.20 time: 0.163880 Dec 14 13:03:52.420994 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: [pid: 116064|app: 0|req: 417/853] 10.222.0.49 () {60 vars in 1276 bytes} [Tue Dec 14 13:03:52 2021] GET /compute/v2.1/servers/9b3b44a7-7c20-473c-841c-318e471fc6cd => generated 1722 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 14 13:03:53.040050 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.api.openstack.wsgi [None req-e2ef0a6e-b0b0-4f27-a472-a7ae1d55b889 tempest-AttachVolumeTestJSON-709357402 tempest-AttachVolumeTestJSON-709357402-project] Calling method '>' {{(pid=116063) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 13:03:53.040937 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.compute.api [None req-e2ef0a6e-b0b0-4f27-a472-a7ae1d55b889 tempest-AttachVolumeTestJSON-709357402 tempest-AttachVolumeTestJSON-709357402-project] [instance: 1b8e1f2f-c109-4413-9d56-33ef0b651f85] Fetching instance by UUID {{(pid=116063) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 13:03:53.048500 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-e2ef0a6e-b0b0-4f27-a472-a7ae1d55b889 tempest-AttachVolumeTestJSON-709357402 tempest-AttachVolumeTestJSON-709357402-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 13:03:53.048979 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-e2ef0a6e-b0b0-4f27-a472-a7ae1d55b889 tempest-AttachVolumeTestJSON-709357402 tempest-AttachVolumeTestJSON-709357402-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 13:03:53.049755 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-e2ef0a6e-b0b0-4f27-a472-a7ae1d55b889 tempest-AttachVolumeTestJSON-709357402 tempest-AttachVolumeTestJSON-709357402-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 13:03:53.050183 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-e2ef0a6e-b0b0-4f27-a472-a7ae1d55b889 tempest-AttachVolumeTestJSON-709357402 tempest-AttachVolumeTestJSON-709357402-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 13:03:53.185775 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.policy [None req-e2ef0a6e-b0b0-4f27-a472-a7ae1d55b889 tempest-AttachVolumeTestJSON-709357402 tempest-AttachVolumeTestJSON-709357402-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '083128ec42474a3e82a2b0fc8c278f4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b1a390d20a54f4d9529d286ab7764a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116063) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 13:03:53.194412 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: INFO nova.api.openstack.requestlog [None req-e2ef0a6e-b0b0-4f27-a472-a7ae1d55b889 tempest-AttachVolumeTestJSON-709357402 tempest-AttachVolumeTestJSON-709357402-project] 10.222.0.49 "GET /compute/v2.1/servers/1b8e1f2f-c109-4413-9d56-33ef0b651f85" status: 200 len: 1723 microversion: 2.1 time: 0.159392 Dec 14 13:03:53.194955 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: [pid: 116063|app: 0|req: 437/854] 10.222.0.49 () {58 vars in 1235 bytes} [Tue Dec 14 13:03:53 2021] GET /compute/v2.1/servers/1b8e1f2f-c109-4413-9d56-33ef0b651f85 => generated 1723 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 14 13:03:53.442605 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.api.openstack.wsgi [None req-2f385ba5-3575-4596-8b09-8155a03b8ef8 tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] Calling method '>' {{(pid=116064) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 13:03:53.443498 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.compute.api [None req-2f385ba5-3575-4596-8b09-8155a03b8ef8 tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] [instance: 9b3b44a7-7c20-473c-841c-318e471fc6cd] Fetching instance by UUID {{(pid=116064) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 13:03:53.454270 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-2f385ba5-3575-4596-8b09-8155a03b8ef8 tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 13:03:53.455007 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-2f385ba5-3575-4596-8b09-8155a03b8ef8 tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 13:03:53.456326 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-2f385ba5-3575-4596-8b09-8155a03b8ef8 tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 13:03:53.457085 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-2f385ba5-3575-4596-8b09-8155a03b8ef8 tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 13:03:53.604342 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.policy [None req-2f385ba5-3575-4596-8b09-8155a03b8ef8 tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79d74a2ea1e541d28d085c15cec34032', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68a8770b8dbe489a8119016fbee64eb5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116064) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 13:03:53.613273 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.policy [None req-2f385ba5-3575-4596-8b09-8155a03b8ef8 tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '79d74a2ea1e541d28d085c15cec34032', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68a8770b8dbe489a8119016fbee64eb5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116064) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 13:03:53.614727 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.policy [None req-2f385ba5-3575-4596-8b09-8155a03b8ef8 tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '79d74a2ea1e541d28d085c15cec34032', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68a8770b8dbe489a8119016fbee64eb5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116064) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 13:03:53.615914 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: INFO nova.api.openstack.requestlog [None req-2f385ba5-3575-4596-8b09-8155a03b8ef8 tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] 10.222.0.49 "GET /compute/v2.1/servers/9b3b44a7-7c20-473c-841c-318e471fc6cd" status: 200 len: 1722 microversion: 2.20 time: 0.179684 Dec 14 13:03:53.616497 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: [pid: 116064|app: 0|req: 418/855] 10.222.0.49 () {60 vars in 1276 bytes} [Tue Dec 14 13:03:53 2021] GET /compute/v2.1/servers/9b3b44a7-7c20-473c-841c-318e471fc6cd => generated 1722 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 14 13:03:54.216008 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.api.openstack.wsgi [None req-4795de26-cca2-4e8b-b0c1-200791c24a39 tempest-AttachVolumeTestJSON-709357402 tempest-AttachVolumeTestJSON-709357402-project] Calling method '>' {{(pid=116063) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 13:03:54.216920 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.compute.api [None req-4795de26-cca2-4e8b-b0c1-200791c24a39 tempest-AttachVolumeTestJSON-709357402 tempest-AttachVolumeTestJSON-709357402-project] [instance: 1b8e1f2f-c109-4413-9d56-33ef0b651f85] Fetching instance by UUID {{(pid=116063) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 13:03:54.227677 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-4795de26-cca2-4e8b-b0c1-200791c24a39 tempest-AttachVolumeTestJSON-709357402 tempest-AttachVolumeTestJSON-709357402-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 13:03:54.228428 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-4795de26-cca2-4e8b-b0c1-200791c24a39 tempest-AttachVolumeTestJSON-709357402 tempest-AttachVolumeTestJSON-709357402-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 13:03:54.229769 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-4795de26-cca2-4e8b-b0c1-200791c24a39 tempest-AttachVolumeTestJSON-709357402 tempest-AttachVolumeTestJSON-709357402-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 13:03:54.230488 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-4795de26-cca2-4e8b-b0c1-200791c24a39 tempest-AttachVolumeTestJSON-709357402 tempest-AttachVolumeTestJSON-709357402-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 13:03:54.375183 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.policy [None req-4795de26-cca2-4e8b-b0c1-200791c24a39 tempest-AttachVolumeTestJSON-709357402 tempest-AttachVolumeTestJSON-709357402-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '083128ec42474a3e82a2b0fc8c278f4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b1a390d20a54f4d9529d286ab7764a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116063) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 13:03:54.386764 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: INFO nova.api.openstack.requestlog [None req-4795de26-cca2-4e8b-b0c1-200791c24a39 tempest-AttachVolumeTestJSON-709357402 tempest-AttachVolumeTestJSON-709357402-project] 10.222.0.49 "GET /compute/v2.1/servers/1b8e1f2f-c109-4413-9d56-33ef0b651f85" status: 200 len: 1723 microversion: 2.1 time: 0.177205 Dec 14 13:03:54.387558 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: [pid: 116063|app: 0|req: 438/856] 10.222.0.49 () {58 vars in 1235 bytes} [Tue Dec 14 13:03:54 2021] GET /compute/v2.1/servers/1b8e1f2f-c109-4413-9d56-33ef0b651f85 => generated 1723 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 14 13:03:54.639132 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.api.openstack.wsgi [None req-b23af6aa-6a8f-41bf-b6c9-b70c5959e73d tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] Calling method '>' {{(pid=116064) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 13:03:54.639838 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.compute.api [None req-b23af6aa-6a8f-41bf-b6c9-b70c5959e73d tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] [instance: 9b3b44a7-7c20-473c-841c-318e471fc6cd] Fetching instance by UUID {{(pid=116064) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 13:03:54.647481 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-b23af6aa-6a8f-41bf-b6c9-b70c5959e73d tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 13:03:54.648005 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-b23af6aa-6a8f-41bf-b6c9-b70c5959e73d tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 13:03:54.648790 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-b23af6aa-6a8f-41bf-b6c9-b70c5959e73d tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 13:03:54.649250 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-b23af6aa-6a8f-41bf-b6c9-b70c5959e73d tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 13:03:54.790106 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.policy [None req-b23af6aa-6a8f-41bf-b6c9-b70c5959e73d tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79d74a2ea1e541d28d085c15cec34032', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68a8770b8dbe489a8119016fbee64eb5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116064) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 13:03:54.798911 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.policy [None req-b23af6aa-6a8f-41bf-b6c9-b70c5959e73d tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '79d74a2ea1e541d28d085c15cec34032', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68a8770b8dbe489a8119016fbee64eb5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116064) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 13:03:54.800398 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.policy [None req-b23af6aa-6a8f-41bf-b6c9-b70c5959e73d tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '79d74a2ea1e541d28d085c15cec34032', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68a8770b8dbe489a8119016fbee64eb5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116064) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 13:03:54.801727 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: INFO nova.api.openstack.requestlog [None req-b23af6aa-6a8f-41bf-b6c9-b70c5959e73d tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] 10.222.0.49 "GET /compute/v2.1/servers/9b3b44a7-7c20-473c-841c-318e471fc6cd" status: 200 len: 1722 microversion: 2.20 time: 0.168840 Dec 14 13:03:54.802304 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: [pid: 116064|app: 0|req: 419/857] 10.222.0.49 () {60 vars in 1276 bytes} [Tue Dec 14 13:03:54 2021] GET /compute/v2.1/servers/9b3b44a7-7c20-473c-841c-318e471fc6cd => generated 1722 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 14 13:03:55.407735 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.api.openstack.wsgi [None req-94a91704-4e71-44b3-80b2-fa12fde7fb53 tempest-AttachVolumeTestJSON-709357402 tempest-AttachVolumeTestJSON-709357402-project] Calling method '>' {{(pid=116063) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 13:03:55.408686 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.compute.api [None req-94a91704-4e71-44b3-80b2-fa12fde7fb53 tempest-AttachVolumeTestJSON-709357402 tempest-AttachVolumeTestJSON-709357402-project] [instance: 1b8e1f2f-c109-4413-9d56-33ef0b651f85] Fetching instance by UUID {{(pid=116063) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 13:03:55.419193 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-94a91704-4e71-44b3-80b2-fa12fde7fb53 tempest-AttachVolumeTestJSON-709357402 tempest-AttachVolumeTestJSON-709357402-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 13:03:55.419641 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-94a91704-4e71-44b3-80b2-fa12fde7fb53 tempest-AttachVolumeTestJSON-709357402 tempest-AttachVolumeTestJSON-709357402-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 13:03:55.420417 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-94a91704-4e71-44b3-80b2-fa12fde7fb53 tempest-AttachVolumeTestJSON-709357402 tempest-AttachVolumeTestJSON-709357402-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 13:03:55.420879 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-94a91704-4e71-44b3-80b2-fa12fde7fb53 tempest-AttachVolumeTestJSON-709357402 tempest-AttachVolumeTestJSON-709357402-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 13:03:55.555077 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.policy [None req-94a91704-4e71-44b3-80b2-fa12fde7fb53 tempest-AttachVolumeTestJSON-709357402 tempest-AttachVolumeTestJSON-709357402-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '083128ec42474a3e82a2b0fc8c278f4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b1a390d20a54f4d9529d286ab7764a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116063) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 13:03:55.563569 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: INFO nova.api.openstack.requestlog [None req-94a91704-4e71-44b3-80b2-fa12fde7fb53 tempest-AttachVolumeTestJSON-709357402 tempest-AttachVolumeTestJSON-709357402-project] 10.222.0.49 "GET /compute/v2.1/servers/1b8e1f2f-c109-4413-9d56-33ef0b651f85" status: 200 len: 1723 microversion: 2.1 time: 0.161959 Dec 14 13:03:55.564156 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: [pid: 116063|app: 0|req: 439/858] 10.222.0.49 () {58 vars in 1235 bytes} [Tue Dec 14 13:03:55 2021] GET /compute/v2.1/servers/1b8e1f2f-c109-4413-9d56-33ef0b651f85 => generated 1723 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 14 13:03:55.819863 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.api.openstack.wsgi [None req-55bbc515-f14b-4fbf-bff3-0626809d1cf7 tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] Calling method '>' {{(pid=116064) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 13:03:55.820466 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.compute.api [None req-55bbc515-f14b-4fbf-bff3-0626809d1cf7 tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] [instance: 9b3b44a7-7c20-473c-841c-318e471fc6cd] Fetching instance by UUID {{(pid=116064) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 13:03:55.827286 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-55bbc515-f14b-4fbf-bff3-0626809d1cf7 tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 13:03:55.827743 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-55bbc515-f14b-4fbf-bff3-0626809d1cf7 tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 13:03:55.828524 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-55bbc515-f14b-4fbf-bff3-0626809d1cf7 tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 13:03:55.828996 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-55bbc515-f14b-4fbf-bff3-0626809d1cf7 tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 13:03:55.964662 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.policy [None req-55bbc515-f14b-4fbf-bff3-0626809d1cf7 tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79d74a2ea1e541d28d085c15cec34032', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68a8770b8dbe489a8119016fbee64eb5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116064) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 13:03:55.972725 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.policy [None req-55bbc515-f14b-4fbf-bff3-0626809d1cf7 tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '79d74a2ea1e541d28d085c15cec34032', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68a8770b8dbe489a8119016fbee64eb5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116064) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 13:03:55.974246 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.policy [None req-55bbc515-f14b-4fbf-bff3-0626809d1cf7 tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '79d74a2ea1e541d28d085c15cec34032', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68a8770b8dbe489a8119016fbee64eb5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116064) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 13:03:55.975390 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: INFO nova.api.openstack.requestlog [None req-55bbc515-f14b-4fbf-bff3-0626809d1cf7 tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] 10.222.0.49 "GET /compute/v2.1/servers/9b3b44a7-7c20-473c-841c-318e471fc6cd" status: 200 len: 1743 microversion: 2.20 time: 0.159469 Dec 14 13:03:55.975969 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: [pid: 116064|app: 0|req: 420/859] 10.222.0.49 () {60 vars in 1276 bytes} [Tue Dec 14 13:03:55 2021] GET /compute/v2.1/servers/9b3b44a7-7c20-473c-841c-318e471fc6cd => generated 1743 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 14 13:03:56.583154 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.api.openstack.wsgi [None req-15fc77a3-1bb2-40bb-9615-4502cd0f2043 tempest-AttachVolumeTestJSON-709357402 tempest-AttachVolumeTestJSON-709357402-project] Calling method '>' {{(pid=116063) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 13:03:56.583802 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.compute.api [None req-15fc77a3-1bb2-40bb-9615-4502cd0f2043 tempest-AttachVolumeTestJSON-709357402 tempest-AttachVolumeTestJSON-709357402-project] [instance: 1b8e1f2f-c109-4413-9d56-33ef0b651f85] Fetching instance by UUID {{(pid=116063) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 13:03:56.592838 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-15fc77a3-1bb2-40bb-9615-4502cd0f2043 tempest-AttachVolumeTestJSON-709357402 tempest-AttachVolumeTestJSON-709357402-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 13:03:56.593413 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-15fc77a3-1bb2-40bb-9615-4502cd0f2043 tempest-AttachVolumeTestJSON-709357402 tempest-AttachVolumeTestJSON-709357402-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 13:03:56.594189 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-15fc77a3-1bb2-40bb-9615-4502cd0f2043 tempest-AttachVolumeTestJSON-709357402 tempest-AttachVolumeTestJSON-709357402-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 13:03:56.594619 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-15fc77a3-1bb2-40bb-9615-4502cd0f2043 tempest-AttachVolumeTestJSON-709357402 tempest-AttachVolumeTestJSON-709357402-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 13:03:56.722225 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.policy [None req-15fc77a3-1bb2-40bb-9615-4502cd0f2043 tempest-AttachVolumeTestJSON-709357402 tempest-AttachVolumeTestJSON-709357402-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '083128ec42474a3e82a2b0fc8c278f4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b1a390d20a54f4d9529d286ab7764a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116063) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 13:03:56.730011 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: INFO nova.api.openstack.requestlog [None req-15fc77a3-1bb2-40bb-9615-4502cd0f2043 tempest-AttachVolumeTestJSON-709357402 tempest-AttachVolumeTestJSON-709357402-project] 10.222.0.49 "GET /compute/v2.1/servers/1b8e1f2f-c109-4413-9d56-33ef0b651f85" status: 200 len: 1700 microversion: 2.1 time: 0.152787 Dec 14 13:03:56.730701 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: [pid: 116063|app: 0|req: 440/860] 10.222.0.49 () {58 vars in 1235 bytes} [Tue Dec 14 13:03:56 2021] GET /compute/v2.1/servers/1b8e1f2f-c109-4413-9d56-33ef0b651f85 => generated 1700 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 14 13:03:56.746644 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.api.openstack.wsgi [None req-bc83f4a0-fdf3-4c02-b4cb-88500db1ff5e tempest-AttachVolumeTestJSON-709357402 tempest-AttachVolumeTestJSON-709357402-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=116064) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 14 13:03:56.753373 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-bc83f4a0-fdf3-4c02-b4cb-88500db1ff5e tempest-AttachVolumeTestJSON-709357402 tempest-AttachVolumeTestJSON-709357402-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 13:03:56.753820 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-bc83f4a0-fdf3-4c02-b4cb-88500db1ff5e tempest-AttachVolumeTestJSON-709357402 tempest-AttachVolumeTestJSON-709357402-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 13:03:56.812287 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.compute.api [None req-bc83f4a0-fdf3-4c02-b4cb-88500db1ff5e tempest-AttachVolumeTestJSON-709357402 tempest-AttachVolumeTestJSON-709357402-project] [instance: 1b8e1f2f-c109-4413-9d56-33ef0b651f85] Going to try to start instance {{(pid=116064) start /opt/stack/nova/nova/compute/api.py:2677}} Dec 14 13:03:56.856973 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: INFO nova.api.openstack.requestlog [None req-bc83f4a0-fdf3-4c02-b4cb-88500db1ff5e tempest-AttachVolumeTestJSON-709357402 tempest-AttachVolumeTestJSON-709357402-project] 10.222.0.49 "POST /compute/v2.1/servers/1b8e1f2f-c109-4413-9d56-33ef0b651f85/action" status: 202 len: 0 microversion: 2.1 time: 0.113983 Dec 14 13:03:56.857618 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: [pid: 116064|app: 0|req: 421/861] 10.222.0.49 () {60 vars in 1277 bytes} [Tue Dec 14 13:03:56 2021] POST /compute/v2.1/servers/1b8e1f2f-c109-4413-9d56-33ef0b651f85/action => generated 0 bytes in 115 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Dec 14 13:03:56.866323 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.api.openstack.wsgi [None req-f5e07517-15ef-4c53-9a30-6a12a96e9c3e tempest-AttachVolumeTestJSON-709357402 tempest-AttachVolumeTestJSON-709357402-project] Calling method '>' {{(pid=116063) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 13:03:56.867004 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.compute.api [None req-f5e07517-15ef-4c53-9a30-6a12a96e9c3e tempest-AttachVolumeTestJSON-709357402 tempest-AttachVolumeTestJSON-709357402-project] [instance: 1b8e1f2f-c109-4413-9d56-33ef0b651f85] Fetching instance by UUID {{(pid=116063) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 13:03:56.873236 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-f5e07517-15ef-4c53-9a30-6a12a96e9c3e tempest-AttachVolumeTestJSON-709357402 tempest-AttachVolumeTestJSON-709357402-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 13:03:56.873742 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-f5e07517-15ef-4c53-9a30-6a12a96e9c3e tempest-AttachVolumeTestJSON-709357402 tempest-AttachVolumeTestJSON-709357402-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 13:03:56.874652 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-f5e07517-15ef-4c53-9a30-6a12a96e9c3e tempest-AttachVolumeTestJSON-709357402 tempest-AttachVolumeTestJSON-709357402-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 13:03:56.875043 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-f5e07517-15ef-4c53-9a30-6a12a96e9c3e tempest-AttachVolumeTestJSON-709357402 tempest-AttachVolumeTestJSON-709357402-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 13:03:56.993681 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.api.openstack.wsgi [None req-29490c53-503d-42e4-8acf-14225ee81b7c tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] Calling method '>' {{(pid=116064) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 13:03:56.994591 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.compute.api [None req-29490c53-503d-42e4-8acf-14225ee81b7c tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] [instance: 9b3b44a7-7c20-473c-841c-318e471fc6cd] Fetching instance by UUID {{(pid=116064) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 13:03:57.000908 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-29490c53-503d-42e4-8acf-14225ee81b7c tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 13:03:57.001476 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-29490c53-503d-42e4-8acf-14225ee81b7c tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 13:03:57.002271 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-29490c53-503d-42e4-8acf-14225ee81b7c tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 13:03:57.002885 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-29490c53-503d-42e4-8acf-14225ee81b7c tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 13:03:57.008727 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.policy [None req-f5e07517-15ef-4c53-9a30-6a12a96e9c3e tempest-AttachVolumeTestJSON-709357402 tempest-AttachVolumeTestJSON-709357402-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '083128ec42474a3e82a2b0fc8c278f4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b1a390d20a54f4d9529d286ab7764a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116063) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 13:03:57.017257 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: INFO nova.api.openstack.requestlog [None req-f5e07517-15ef-4c53-9a30-6a12a96e9c3e tempest-AttachVolumeTestJSON-709357402 tempest-AttachVolumeTestJSON-709357402-project] 10.222.0.49 "GET /compute/v2.1/servers/1b8e1f2f-c109-4413-9d56-33ef0b651f85" status: 200 len: 1709 microversion: 2.1 time: 0.155148 Dec 14 13:03:57.020947 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: [pid: 116063|app: 0|req: 441/862] 10.222.0.49 () {58 vars in 1235 bytes} [Tue Dec 14 13:03:56 2021] GET /compute/v2.1/servers/1b8e1f2f-c109-4413-9d56-33ef0b651f85 => generated 1709 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 14 13:03:57.139034 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.policy [None req-29490c53-503d-42e4-8acf-14225ee81b7c tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79d74a2ea1e541d28d085c15cec34032', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68a8770b8dbe489a8119016fbee64eb5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116064) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 13:03:57.146842 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.policy [None req-29490c53-503d-42e4-8acf-14225ee81b7c tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '79d74a2ea1e541d28d085c15cec34032', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68a8770b8dbe489a8119016fbee64eb5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116064) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 13:03:57.148341 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.policy [None req-29490c53-503d-42e4-8acf-14225ee81b7c tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '79d74a2ea1e541d28d085c15cec34032', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68a8770b8dbe489a8119016fbee64eb5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116064) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 13:03:57.155882 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: INFO nova.api.openstack.requestlog [None req-29490c53-503d-42e4-8acf-14225ee81b7c tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] 10.222.0.49 "GET /compute/v2.1/servers/9b3b44a7-7c20-473c-841c-318e471fc6cd" status: 200 len: 1743 microversion: 2.20 time: 0.166201 Dec 14 13:03:57.156470 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: [pid: 116064|app: 0|req: 422/863] 10.222.0.49 () {60 vars in 1276 bytes} [Tue Dec 14 13:03:56 2021] GET /compute/v2.1/servers/9b3b44a7-7c20-473c-841c-318e471fc6cd => generated 1743 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Dec 14 13:03:58.035337 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.api.openstack.wsgi [None req-ebfcce7e-1462-4718-a86d-a3638cb119cb tempest-AttachVolumeTestJSON-709357402 tempest-AttachVolumeTestJSON-709357402-project] Calling method '>' {{(pid=116063) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 13:03:58.036640 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.compute.api [None req-ebfcce7e-1462-4718-a86d-a3638cb119cb tempest-AttachVolumeTestJSON-709357402 tempest-AttachVolumeTestJSON-709357402-project] [instance: 1b8e1f2f-c109-4413-9d56-33ef0b651f85] Fetching instance by UUID {{(pid=116063) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 13:03:58.044510 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-ebfcce7e-1462-4718-a86d-a3638cb119cb tempest-AttachVolumeTestJSON-709357402 tempest-AttachVolumeTestJSON-709357402-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 13:03:58.045330 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-ebfcce7e-1462-4718-a86d-a3638cb119cb tempest-AttachVolumeTestJSON-709357402 tempest-AttachVolumeTestJSON-709357402-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 13:03:58.046104 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-ebfcce7e-1462-4718-a86d-a3638cb119cb tempest-AttachVolumeTestJSON-709357402 tempest-AttachVolumeTestJSON-709357402-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 13:03:58.046538 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-ebfcce7e-1462-4718-a86d-a3638cb119cb tempest-AttachVolumeTestJSON-709357402 tempest-AttachVolumeTestJSON-709357402-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 13:03:58.174720 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.api.openstack.wsgi [None req-407a48b8-b734-4e4b-82e5-4223208d59ce tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] Calling method '>' {{(pid=116064) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 13:03:58.175968 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.compute.api [None req-407a48b8-b734-4e4b-82e5-4223208d59ce tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] [instance: 9b3b44a7-7c20-473c-841c-318e471fc6cd] Fetching instance by UUID {{(pid=116064) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 13:03:58.182414 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-407a48b8-b734-4e4b-82e5-4223208d59ce tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 13:03:58.182871 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-407a48b8-b734-4e4b-82e5-4223208d59ce tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 13:03:58.184476 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-407a48b8-b734-4e4b-82e5-4223208d59ce tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 13:03:58.184904 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-407a48b8-b734-4e4b-82e5-4223208d59ce tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 13:03:58.186782 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.policy [None req-ebfcce7e-1462-4718-a86d-a3638cb119cb tempest-AttachVolumeTestJSON-709357402 tempest-AttachVolumeTestJSON-709357402-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '083128ec42474a3e82a2b0fc8c278f4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b1a390d20a54f4d9529d286ab7764a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116063) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 13:03:58.204723 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: INFO nova.api.openstack.requestlog [None req-ebfcce7e-1462-4718-a86d-a3638cb119cb tempest-AttachVolumeTestJSON-709357402 tempest-AttachVolumeTestJSON-709357402-project] 10.222.0.49 "GET /compute/v2.1/servers/1b8e1f2f-c109-4413-9d56-33ef0b651f85" status: 200 len: 1709 microversion: 2.1 time: 0.173179 Dec 14 13:03:58.205644 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: [pid: 116063|app: 0|req: 442/864] 10.222.0.49 () {58 vars in 1235 bytes} [Tue Dec 14 13:03:58 2021] GET /compute/v2.1/servers/1b8e1f2f-c109-4413-9d56-33ef0b651f85 => generated 1709 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 14 13:03:58.327407 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.policy [None req-407a48b8-b734-4e4b-82e5-4223208d59ce tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79d74a2ea1e541d28d085c15cec34032', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68a8770b8dbe489a8119016fbee64eb5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116064) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 13:03:58.337007 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.policy [None req-407a48b8-b734-4e4b-82e5-4223208d59ce tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '79d74a2ea1e541d28d085c15cec34032', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68a8770b8dbe489a8119016fbee64eb5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116064) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 13:03:58.339770 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.policy [None req-407a48b8-b734-4e4b-82e5-4223208d59ce tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '79d74a2ea1e541d28d085c15cec34032', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68a8770b8dbe489a8119016fbee64eb5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116064) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 13:03:58.341158 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: INFO nova.api.openstack.requestlog [None req-407a48b8-b734-4e4b-82e5-4223208d59ce tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] 10.222.0.49 "GET /compute/v2.1/servers/9b3b44a7-7c20-473c-841c-318e471fc6cd" status: 200 len: 1738 microversion: 2.20 time: 0.170378 Dec 14 13:03:58.341739 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: [pid: 116064|app: 0|req: 423/865] 10.222.0.49 () {60 vars in 1276 bytes} [Tue Dec 14 13:03:58 2021] GET /compute/v2.1/servers/9b3b44a7-7c20-473c-841c-318e471fc6cd => generated 1738 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 14 13:03:59.222990 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.api.openstack.wsgi [None req-290a2645-170d-4858-a3ae-0ba58561771f tempest-AttachVolumeTestJSON-709357402 tempest-AttachVolumeTestJSON-709357402-project] Calling method '>' {{(pid=116063) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 13:03:59.223809 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.compute.api [None req-290a2645-170d-4858-a3ae-0ba58561771f tempest-AttachVolumeTestJSON-709357402 tempest-AttachVolumeTestJSON-709357402-project] [instance: 1b8e1f2f-c109-4413-9d56-33ef0b651f85] Fetching instance by UUID {{(pid=116063) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 13:03:59.230372 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-290a2645-170d-4858-a3ae-0ba58561771f tempest-AttachVolumeTestJSON-709357402 tempest-AttachVolumeTestJSON-709357402-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 13:03:59.230999 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-290a2645-170d-4858-a3ae-0ba58561771f tempest-AttachVolumeTestJSON-709357402 tempest-AttachVolumeTestJSON-709357402-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 13:03:59.232072 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-290a2645-170d-4858-a3ae-0ba58561771f tempest-AttachVolumeTestJSON-709357402 tempest-AttachVolumeTestJSON-709357402-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 13:03:59.232710 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-290a2645-170d-4858-a3ae-0ba58561771f tempest-AttachVolumeTestJSON-709357402 tempest-AttachVolumeTestJSON-709357402-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 13:03:59.359833 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.api.openstack.wsgi [None req-ef465a18-2e73-4edb-a762-5dc22305908c tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] Calling method '>' {{(pid=116064) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 13:03:59.362918 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.compute.api [None req-ef465a18-2e73-4edb-a762-5dc22305908c tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] [instance: 9b3b44a7-7c20-473c-841c-318e471fc6cd] Fetching instance by UUID {{(pid=116064) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 13:03:59.370045 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-ef465a18-2e73-4edb-a762-5dc22305908c tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 13:03:59.370848 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-ef465a18-2e73-4edb-a762-5dc22305908c tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 13:03:59.371933 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-ef465a18-2e73-4edb-a762-5dc22305908c tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 13:03:59.372568 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-ef465a18-2e73-4edb-a762-5dc22305908c tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 13:03:59.382240 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.policy [None req-290a2645-170d-4858-a3ae-0ba58561771f tempest-AttachVolumeTestJSON-709357402 tempest-AttachVolumeTestJSON-709357402-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '083128ec42474a3e82a2b0fc8c278f4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b1a390d20a54f4d9529d286ab7764a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116063) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 13:03:59.392393 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: INFO nova.api.openstack.requestlog [None req-290a2645-170d-4858-a3ae-0ba58561771f tempest-AttachVolumeTestJSON-709357402 tempest-AttachVolumeTestJSON-709357402-project] 10.222.0.49 "GET /compute/v2.1/servers/1b8e1f2f-c109-4413-9d56-33ef0b651f85" status: 200 len: 1713 microversion: 2.1 time: 0.173192 Dec 14 13:03:59.393351 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: [pid: 116063|app: 0|req: 443/866] 10.222.0.49 () {58 vars in 1235 bytes} [Tue Dec 14 13:03:59 2021] GET /compute/v2.1/servers/1b8e1f2f-c109-4413-9d56-33ef0b651f85 => generated 1713 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 14 13:03:59.558564 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.policy [None req-ef465a18-2e73-4edb-a762-5dc22305908c tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79d74a2ea1e541d28d085c15cec34032', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68a8770b8dbe489a8119016fbee64eb5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116064) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 13:03:59.573773 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.policy [None req-ef465a18-2e73-4edb-a762-5dc22305908c tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '79d74a2ea1e541d28d085c15cec34032', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68a8770b8dbe489a8119016fbee64eb5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116064) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 13:03:59.575591 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.policy [None req-ef465a18-2e73-4edb-a762-5dc22305908c tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '79d74a2ea1e541d28d085c15cec34032', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68a8770b8dbe489a8119016fbee64eb5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116064) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 13:03:59.576766 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: INFO nova.api.openstack.requestlog [None req-ef465a18-2e73-4edb-a762-5dc22305908c tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] 10.222.0.49 "GET /compute/v2.1/servers/9b3b44a7-7c20-473c-841c-318e471fc6cd" status: 200 len: 1738 microversion: 2.20 time: 0.220923 Dec 14 13:03:59.577427 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: [pid: 116064|app: 0|req: 424/867] 10.222.0.49 () {60 vars in 1276 bytes} [Tue Dec 14 13:03:59 2021] GET /compute/v2.1/servers/9b3b44a7-7c20-473c-841c-318e471fc6cd => generated 1738 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 14 13:03:59.968599 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.api.openstack.wsgi [req-a69e1018-411e-408f-86d4-26da739fccec req-d6547037-f543-4c57-aecf-834faab772f3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9b3b44a7-7c20-473c-841c-318e471fc6cd", "name": "network-vif-plugged", "status": "completed", "tag": "0ed44ee3-2630-4f50-9391-4bb374b76e1d"}]} {{(pid=116063) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 14 13:03:59.970368 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 14 13:03:59.970368 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: warnings.warn(msg) Dec 14 13:03:59.987052 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [req-a69e1018-411e-408f-86d4-26da739fccec req-d6547037-f543-4c57-aecf-834faab772f3 service nova] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 13:03:59.987590 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [req-a69e1018-411e-408f-86d4-26da739fccec req-d6547037-f543-4c57-aecf-834faab772f3 service nova] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 13:04:00.001150 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: INFO nova.api.openstack.compute.server_external_events [req-a69e1018-411e-408f-86d4-26da739fccec req-d6547037-f543-4c57-aecf-834faab772f3 service nova] Creating event network-vif-plugged:0ed44ee3-2630-4f50-9391-4bb374b76e1d for instance 9b3b44a7-7c20-473c-841c-318e471fc6cd on hv-cinder-78447 Dec 14 13:04:00.007067 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: INFO nova.api.openstack.requestlog [req-a69e1018-411e-408f-86d4-26da739fccec req-d6547037-f543-4c57-aecf-834faab772f3 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.119530 Dec 14 13:04:00.008766 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: [pid: 116063|app: 0|req: 444/868] 10.222.0.49 () {64 vars in 1317 bytes} [Tue Dec 14 13:03:59 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 14 13:04:00.595553 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.api.openstack.wsgi [None req-34e06a81-7299-471e-bd0a-e68540a24812 tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] Calling method '>' {{(pid=116064) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 13:04:00.596192 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.compute.api [None req-34e06a81-7299-471e-bd0a-e68540a24812 tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] [instance: 9b3b44a7-7c20-473c-841c-318e471fc6cd] Fetching instance by UUID {{(pid=116064) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 13:04:00.602322 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-34e06a81-7299-471e-bd0a-e68540a24812 tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 13:04:00.602766 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-34e06a81-7299-471e-bd0a-e68540a24812 tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 13:04:00.603788 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-34e06a81-7299-471e-bd0a-e68540a24812 tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 13:04:00.604245 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-34e06a81-7299-471e-bd0a-e68540a24812 tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 13:04:00.748007 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.policy [None req-34e06a81-7299-471e-bd0a-e68540a24812 tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79d74a2ea1e541d28d085c15cec34032', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68a8770b8dbe489a8119016fbee64eb5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116064) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 13:04:00.757838 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.policy [None req-34e06a81-7299-471e-bd0a-e68540a24812 tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '79d74a2ea1e541d28d085c15cec34032', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68a8770b8dbe489a8119016fbee64eb5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116064) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 13:04:00.759509 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.policy [None req-34e06a81-7299-471e-bd0a-e68540a24812 tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '79d74a2ea1e541d28d085c15cec34032', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68a8770b8dbe489a8119016fbee64eb5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116064) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 13:04:00.760738 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: INFO nova.api.openstack.requestlog [None req-34e06a81-7299-471e-bd0a-e68540a24812 tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] 10.222.0.49 "GET /compute/v2.1/servers/9b3b44a7-7c20-473c-841c-318e471fc6cd" status: 200 len: 1738 microversion: 2.20 time: 0.169060 Dec 14 13:04:00.761417 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: [pid: 116064|app: 0|req: 425/869] 10.222.0.49 () {60 vars in 1276 bytes} [Tue Dec 14 13:04:00 2021] GET /compute/v2.1/servers/9b3b44a7-7c20-473c-841c-318e471fc6cd => generated 1738 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 14 13:04:01.781755 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.api.openstack.wsgi [None req-e0dd3f56-3e48-41d8-b3a9-88186c8eef30 tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] Calling method '>' {{(pid=116063) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 13:04:01.782479 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.compute.api [None req-e0dd3f56-3e48-41d8-b3a9-88186c8eef30 tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] [instance: 9b3b44a7-7c20-473c-841c-318e471fc6cd] Fetching instance by UUID {{(pid=116063) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 13:04:01.791868 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-e0dd3f56-3e48-41d8-b3a9-88186c8eef30 tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 13:04:01.792288 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-e0dd3f56-3e48-41d8-b3a9-88186c8eef30 tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 13:04:01.793641 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-e0dd3f56-3e48-41d8-b3a9-88186c8eef30 tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 13:04:01.794218 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-e0dd3f56-3e48-41d8-b3a9-88186c8eef30 tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 13:04:01.943704 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.policy [None req-e0dd3f56-3e48-41d8-b3a9-88186c8eef30 tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79d74a2ea1e541d28d085c15cec34032', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68a8770b8dbe489a8119016fbee64eb5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116063) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 13:04:01.953120 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.policy [None req-e0dd3f56-3e48-41d8-b3a9-88186c8eef30 tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '79d74a2ea1e541d28d085c15cec34032', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68a8770b8dbe489a8119016fbee64eb5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116063) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 13:04:01.954928 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.policy [None req-e0dd3f56-3e48-41d8-b3a9-88186c8eef30 tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '79d74a2ea1e541d28d085c15cec34032', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68a8770b8dbe489a8119016fbee64eb5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116063) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 13:04:01.956315 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: INFO nova.api.openstack.requestlog [None req-e0dd3f56-3e48-41d8-b3a9-88186c8eef30 tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] 10.222.0.49 "GET /compute/v2.1/servers/9b3b44a7-7c20-473c-841c-318e471fc6cd" status: 200 len: 1738 microversion: 2.20 time: 0.179383 Dec 14 13:04:01.957442 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: [pid: 116063|app: 0|req: 445/870] 10.222.0.49 () {60 vars in 1276 bytes} [Tue Dec 14 13:04:01 2021] GET /compute/v2.1/servers/9b3b44a7-7c20-473c-841c-318e471fc6cd => generated 1738 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 14 13:04:02.975582 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.api.openstack.wsgi [None req-f227fb5f-647e-4674-9eeb-f4a6bacfc46f tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] Calling method '>' {{(pid=116064) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 13:04:02.976189 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.compute.api [None req-f227fb5f-647e-4674-9eeb-f4a6bacfc46f tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] [instance: 9b3b44a7-7c20-473c-841c-318e471fc6cd] Fetching instance by UUID {{(pid=116064) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 13:04:02.983833 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-f227fb5f-647e-4674-9eeb-f4a6bacfc46f tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 13:04:02.984349 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-f227fb5f-647e-4674-9eeb-f4a6bacfc46f tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 13:04:02.985433 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-f227fb5f-647e-4674-9eeb-f4a6bacfc46f tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 13:04:02.986132 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-f227fb5f-647e-4674-9eeb-f4a6bacfc46f tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 13:04:03.139332 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.policy [None req-f227fb5f-647e-4674-9eeb-f4a6bacfc46f tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79d74a2ea1e541d28d085c15cec34032', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68a8770b8dbe489a8119016fbee64eb5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116064) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 13:04:03.147520 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.policy [None req-f227fb5f-647e-4674-9eeb-f4a6bacfc46f tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '79d74a2ea1e541d28d085c15cec34032', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68a8770b8dbe489a8119016fbee64eb5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116064) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 13:04:03.149064 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.policy [None req-f227fb5f-647e-4674-9eeb-f4a6bacfc46f tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '79d74a2ea1e541d28d085c15cec34032', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68a8770b8dbe489a8119016fbee64eb5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116064) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 13:04:03.150226 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: INFO nova.api.openstack.requestlog [None req-f227fb5f-647e-4674-9eeb-f4a6bacfc46f tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] 10.222.0.49 "GET /compute/v2.1/servers/9b3b44a7-7c20-473c-841c-318e471fc6cd" status: 200 len: 1738 microversion: 2.20 time: 0.179060 Dec 14 13:04:03.157116 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: [pid: 116064|app: 0|req: 426/871] 10.222.0.49 () {60 vars in 1276 bytes} [Tue Dec 14 13:04:02 2021] GET /compute/v2.1/servers/9b3b44a7-7c20-473c-841c-318e471fc6cd => generated 1738 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 14 13:04:04.169139 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.api.openstack.wsgi [None req-7de57299-2966-4776-9329-1b51bd7095aa tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] Calling method '>' {{(pid=116063) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 13:04:04.169699 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.compute.api [None req-7de57299-2966-4776-9329-1b51bd7095aa tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] [instance: 9b3b44a7-7c20-473c-841c-318e471fc6cd] Fetching instance by UUID {{(pid=116063) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 13:04:04.177569 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-7de57299-2966-4776-9329-1b51bd7095aa tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 13:04:04.178267 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-7de57299-2966-4776-9329-1b51bd7095aa tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 13:04:04.179541 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-7de57299-2966-4776-9329-1b51bd7095aa tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 13:04:04.180329 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-7de57299-2966-4776-9329-1b51bd7095aa tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 13:04:04.327110 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.policy [None req-7de57299-2966-4776-9329-1b51bd7095aa tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79d74a2ea1e541d28d085c15cec34032', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68a8770b8dbe489a8119016fbee64eb5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116063) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 13:04:04.335907 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.policy [None req-7de57299-2966-4776-9329-1b51bd7095aa tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '79d74a2ea1e541d28d085c15cec34032', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68a8770b8dbe489a8119016fbee64eb5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116063) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 13:04:04.337540 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.policy [None req-7de57299-2966-4776-9329-1b51bd7095aa tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '79d74a2ea1e541d28d085c15cec34032', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68a8770b8dbe489a8119016fbee64eb5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116063) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 13:04:04.338775 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: INFO nova.api.openstack.requestlog [None req-7de57299-2966-4776-9329-1b51bd7095aa tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] 10.222.0.49 "GET /compute/v2.1/servers/9b3b44a7-7c20-473c-841c-318e471fc6cd" status: 200 len: 1738 microversion: 2.20 time: 0.174012 Dec 14 13:04:04.339565 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: [pid: 116063|app: 0|req: 446/872] 10.222.0.49 () {60 vars in 1276 bytes} [Tue Dec 14 13:04:04 2021] GET /compute/v2.1/servers/9b3b44a7-7c20-473c-841c-318e471fc6cd => generated 1738 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 14 13:04:05.356929 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.api.openstack.wsgi [None req-a9df745d-3810-4207-9696-a9ea700bc9a1 tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] Calling method '>' {{(pid=116064) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 13:04:05.358264 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.compute.api [None req-a9df745d-3810-4207-9696-a9ea700bc9a1 tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] [instance: 9b3b44a7-7c20-473c-841c-318e471fc6cd] Fetching instance by UUID {{(pid=116064) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 13:04:05.360818 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.api.openstack.wsgi [None req-41e00468-7534-4065-8ef5-f1a6a9313feb tempest-TestMinimumBasicScenario-84513626 tempest-TestMinimumBasicScenario-84513626-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=116063) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 14 13:04:05.362095 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.compute.api [None req-41e00468-7534-4065-8ef5-f1a6a9313feb tempest-TestMinimumBasicScenario-84513626 tempest-TestMinimumBasicScenario-84513626-project] [instance: dd367814-45bc-4808-b2de-d54f79eb7933] Fetching instance by UUID {{(pid=116063) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 13:04:05.367424 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-a9df745d-3810-4207-9696-a9ea700bc9a1 tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 13:04:05.368667 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-a9df745d-3810-4207-9696-a9ea700bc9a1 tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 13:04:05.369028 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-41e00468-7534-4065-8ef5-f1a6a9313feb tempest-TestMinimumBasicScenario-84513626 tempest-TestMinimumBasicScenario-84513626-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 13:04:05.369551 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-41e00468-7534-4065-8ef5-f1a6a9313feb tempest-TestMinimumBasicScenario-84513626 tempest-TestMinimumBasicScenario-84513626-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 13:04:05.370211 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-a9df745d-3810-4207-9696-a9ea700bc9a1 tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 13:04:05.370490 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-41e00468-7534-4065-8ef5-f1a6a9313feb tempest-TestMinimumBasicScenario-84513626 tempest-TestMinimumBasicScenario-84513626-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 13:04:05.371037 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-41e00468-7534-4065-8ef5-f1a6a9313feb tempest-TestMinimumBasicScenario-84513626 tempest-TestMinimumBasicScenario-84513626-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 13:04:05.371314 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-a9df745d-3810-4207-9696-a9ea700bc9a1 tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 13:04:05.472122 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: INFO nova.api.openstack.requestlog [None req-41e00468-7534-4065-8ef5-f1a6a9313feb tempest-TestMinimumBasicScenario-84513626 tempest-TestMinimumBasicScenario-84513626-project] 10.222.0.49 "POST /compute/v2.1/servers/dd367814-45bc-4808-b2de-d54f79eb7933/action" status: 202 len: 0 microversion: 2.1 time: 0.115068 Dec 14 13:04:05.475773 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: [pid: 116063|app: 0|req: 447/873] 10.222.0.49 () {60 vars in 1277 bytes} [Tue Dec 14 13:04:05 2021] POST /compute/v2.1/servers/dd367814-45bc-4808-b2de-d54f79eb7933/action => generated 0 bytes in 117 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Dec 14 13:04:05.481521 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.api.openstack.wsgi [None req-85e8d29e-7807-4310-b829-9c3105324636 tempest-TestMinimumBasicScenario-84513626 tempest-TestMinimumBasicScenario-84513626-project] Calling method '>' {{(pid=116063) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 13:04:05.482417 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.compute.api [None req-85e8d29e-7807-4310-b829-9c3105324636 tempest-TestMinimumBasicScenario-84513626 tempest-TestMinimumBasicScenario-84513626-project] [instance: dd367814-45bc-4808-b2de-d54f79eb7933] Fetching instance by UUID {{(pid=116063) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 13:04:05.501130 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-85e8d29e-7807-4310-b829-9c3105324636 tempest-TestMinimumBasicScenario-84513626 tempest-TestMinimumBasicScenario-84513626-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 13:04:05.501678 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-85e8d29e-7807-4310-b829-9c3105324636 tempest-TestMinimumBasicScenario-84513626 tempest-TestMinimumBasicScenario-84513626-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 13:04:05.502786 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-85e8d29e-7807-4310-b829-9c3105324636 tempest-TestMinimumBasicScenario-84513626 tempest-TestMinimumBasicScenario-84513626-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 13:04:05.503943 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-85e8d29e-7807-4310-b829-9c3105324636 tempest-TestMinimumBasicScenario-84513626 tempest-TestMinimumBasicScenario-84513626-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 13:04:05.579364 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.policy [None req-a9df745d-3810-4207-9696-a9ea700bc9a1 tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79d74a2ea1e541d28d085c15cec34032', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68a8770b8dbe489a8119016fbee64eb5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116064) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 13:04:05.587960 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.policy [None req-a9df745d-3810-4207-9696-a9ea700bc9a1 tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '79d74a2ea1e541d28d085c15cec34032', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68a8770b8dbe489a8119016fbee64eb5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116064) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 13:04:05.593661 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.policy [None req-a9df745d-3810-4207-9696-a9ea700bc9a1 tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '79d74a2ea1e541d28d085c15cec34032', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68a8770b8dbe489a8119016fbee64eb5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116064) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 13:04:05.606202 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: INFO nova.api.openstack.requestlog [None req-a9df745d-3810-4207-9696-a9ea700bc9a1 tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] 10.222.0.49 "GET /compute/v2.1/servers/9b3b44a7-7c20-473c-841c-318e471fc6cd" status: 200 len: 1738 microversion: 2.20 time: 0.252885 Dec 14 13:04:05.607276 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: [pid: 116064|app: 0|req: 427/874] 10.222.0.49 () {60 vars in 1276 bytes} [Tue Dec 14 13:04:05 2021] GET /compute/v2.1/servers/9b3b44a7-7c20-473c-841c-318e471fc6cd => generated 1738 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 14 13:04:05.711207 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.policy [None req-85e8d29e-7807-4310-b829-9c3105324636 tempest-TestMinimumBasicScenario-84513626 tempest-TestMinimumBasicScenario-84513626-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edf65e37b42d40b28c4e90bd92987016', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bcb503e37b2449484c788574e4c88f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116063) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 13:04:05.723235 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: INFO nova.api.openstack.requestlog [None req-85e8d29e-7807-4310-b829-9c3105324636 tempest-TestMinimumBasicScenario-84513626 tempest-TestMinimumBasicScenario-84513626-project] 10.222.0.49 "GET /compute/v2.1/servers/dd367814-45bc-4808-b2de-d54f79eb7933" status: 200 len: 1751 microversion: 2.1 time: 0.245221 Dec 14 13:04:05.734379 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: [pid: 116063|app: 0|req: 448/875] 10.222.0.49 () {58 vars in 1235 bytes} [Tue Dec 14 13:04:05 2021] GET /compute/v2.1/servers/dd367814-45bc-4808-b2de-d54f79eb7933 => generated 1751 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 14 13:04:06.625412 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.api.openstack.wsgi [None req-e24d9105-2e6d-4f12-b196-4cf2bd2b883f tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] Calling method '>' {{(pid=116064) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 13:04:06.626128 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.compute.api [None req-e24d9105-2e6d-4f12-b196-4cf2bd2b883f tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] [instance: 9b3b44a7-7c20-473c-841c-318e471fc6cd] Fetching instance by UUID {{(pid=116064) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 13:04:06.632962 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-e24d9105-2e6d-4f12-b196-4cf2bd2b883f tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 13:04:06.633683 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-e24d9105-2e6d-4f12-b196-4cf2bd2b883f tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 13:04:06.634689 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-e24d9105-2e6d-4f12-b196-4cf2bd2b883f tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 13:04:06.635122 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-e24d9105-2e6d-4f12-b196-4cf2bd2b883f tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 13:04:06.741560 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.api.openstack.wsgi [None req-84726ce4-4a85-4904-aa45-0c8c28eaab0d tempest-TestMinimumBasicScenario-84513626 tempest-TestMinimumBasicScenario-84513626-project] Calling method '>' {{(pid=116063) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 13:04:06.742186 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.compute.api [None req-84726ce4-4a85-4904-aa45-0c8c28eaab0d tempest-TestMinimumBasicScenario-84513626 tempest-TestMinimumBasicScenario-84513626-project] [instance: dd367814-45bc-4808-b2de-d54f79eb7933] Fetching instance by UUID {{(pid=116063) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 13:04:06.748596 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-84726ce4-4a85-4904-aa45-0c8c28eaab0d tempest-TestMinimumBasicScenario-84513626 tempest-TestMinimumBasicScenario-84513626-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 13:04:06.749320 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-84726ce4-4a85-4904-aa45-0c8c28eaab0d tempest-TestMinimumBasicScenario-84513626 tempest-TestMinimumBasicScenario-84513626-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 13:04:06.750117 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-84726ce4-4a85-4904-aa45-0c8c28eaab0d tempest-TestMinimumBasicScenario-84513626 tempest-TestMinimumBasicScenario-84513626-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 13:04:06.750780 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-84726ce4-4a85-4904-aa45-0c8c28eaab0d tempest-TestMinimumBasicScenario-84513626 tempest-TestMinimumBasicScenario-84513626-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 13:04:06.829019 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.policy [None req-e24d9105-2e6d-4f12-b196-4cf2bd2b883f tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79d74a2ea1e541d28d085c15cec34032', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68a8770b8dbe489a8119016fbee64eb5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116064) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 13:04:06.841176 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.policy [None req-e24d9105-2e6d-4f12-b196-4cf2bd2b883f tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '79d74a2ea1e541d28d085c15cec34032', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68a8770b8dbe489a8119016fbee64eb5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116064) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 13:04:06.849292 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.policy [None req-e24d9105-2e6d-4f12-b196-4cf2bd2b883f tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '79d74a2ea1e541d28d085c15cec34032', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68a8770b8dbe489a8119016fbee64eb5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116064) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 13:04:06.850534 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: INFO nova.api.openstack.requestlog [None req-e24d9105-2e6d-4f12-b196-4cf2bd2b883f tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] 10.222.0.49 "GET /compute/v2.1/servers/9b3b44a7-7c20-473c-841c-318e471fc6cd" status: 200 len: 1738 microversion: 2.20 time: 0.229034 Dec 14 13:04:06.861536 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: [pid: 116064|app: 0|req: 428/876] 10.222.0.49 () {60 vars in 1276 bytes} [Tue Dec 14 13:04:06 2021] GET /compute/v2.1/servers/9b3b44a7-7c20-473c-841c-318e471fc6cd => generated 1738 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 14 13:04:06.929485 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.policy [None req-84726ce4-4a85-4904-aa45-0c8c28eaab0d tempest-TestMinimumBasicScenario-84513626 tempest-TestMinimumBasicScenario-84513626-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edf65e37b42d40b28c4e90bd92987016', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bcb503e37b2449484c788574e4c88f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116063) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 13:04:06.940194 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: INFO nova.api.openstack.requestlog [None req-84726ce4-4a85-4904-aa45-0c8c28eaab0d tempest-TestMinimumBasicScenario-84513626 tempest-TestMinimumBasicScenario-84513626-project] 10.222.0.49 "GET /compute/v2.1/servers/dd367814-45bc-4808-b2de-d54f79eb7933" status: 200 len: 1756 microversion: 2.1 time: 0.202421 Dec 14 13:04:06.950040 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: [pid: 116063|app: 0|req: 449/877] 10.222.0.49 () {58 vars in 1235 bytes} [Tue Dec 14 13:04:06 2021] GET /compute/v2.1/servers/dd367814-45bc-4808-b2de-d54f79eb7933 => generated 1756 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 14 13:04:07.871288 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.api.openstack.wsgi [None req-9ea5c736-8a39-4bf3-84e1-35b418e3b5c5 tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] Calling method '>' {{(pid=116064) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 13:04:07.871994 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.compute.api [None req-9ea5c736-8a39-4bf3-84e1-35b418e3b5c5 tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] [instance: 9b3b44a7-7c20-473c-841c-318e471fc6cd] Fetching instance by UUID {{(pid=116064) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 13:04:07.881140 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-9ea5c736-8a39-4bf3-84e1-35b418e3b5c5 tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 13:04:07.881789 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-9ea5c736-8a39-4bf3-84e1-35b418e3b5c5 tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 13:04:07.882923 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-9ea5c736-8a39-4bf3-84e1-35b418e3b5c5 tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 13:04:07.883494 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-9ea5c736-8a39-4bf3-84e1-35b418e3b5c5 tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 13:04:07.957804 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.api.openstack.wsgi [None req-061e34b0-1e47-47d8-b655-b0cbdf31277b tempest-TestMinimumBasicScenario-84513626 tempest-TestMinimumBasicScenario-84513626-project] Calling method '>' {{(pid=116063) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 13:04:07.958400 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.compute.api [None req-061e34b0-1e47-47d8-b655-b0cbdf31277b tempest-TestMinimumBasicScenario-84513626 tempest-TestMinimumBasicScenario-84513626-project] [instance: dd367814-45bc-4808-b2de-d54f79eb7933] Fetching instance by UUID {{(pid=116063) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 13:04:07.964780 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-061e34b0-1e47-47d8-b655-b0cbdf31277b tempest-TestMinimumBasicScenario-84513626 tempest-TestMinimumBasicScenario-84513626-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 13:04:07.965257 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-061e34b0-1e47-47d8-b655-b0cbdf31277b tempest-TestMinimumBasicScenario-84513626 tempest-TestMinimumBasicScenario-84513626-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 13:04:07.966041 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-061e34b0-1e47-47d8-b655-b0cbdf31277b tempest-TestMinimumBasicScenario-84513626 tempest-TestMinimumBasicScenario-84513626-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 13:04:07.966953 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-061e34b0-1e47-47d8-b655-b0cbdf31277b tempest-TestMinimumBasicScenario-84513626 tempest-TestMinimumBasicScenario-84513626-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 13:04:08.043480 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.policy [None req-9ea5c736-8a39-4bf3-84e1-35b418e3b5c5 tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79d74a2ea1e541d28d085c15cec34032', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68a8770b8dbe489a8119016fbee64eb5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116064) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 13:04:08.052831 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.policy [None req-9ea5c736-8a39-4bf3-84e1-35b418e3b5c5 tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '79d74a2ea1e541d28d085c15cec34032', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68a8770b8dbe489a8119016fbee64eb5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116064) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 13:04:08.055417 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.policy [None req-9ea5c736-8a39-4bf3-84e1-35b418e3b5c5 tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '79d74a2ea1e541d28d085c15cec34032', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68a8770b8dbe489a8119016fbee64eb5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116064) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 13:04:08.057062 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: INFO nova.api.openstack.requestlog [None req-9ea5c736-8a39-4bf3-84e1-35b418e3b5c5 tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] 10.222.0.49 "GET /compute/v2.1/servers/9b3b44a7-7c20-473c-841c-318e471fc6cd" status: 200 len: 1720 microversion: 2.20 time: 0.191768 Dec 14 13:04:08.057990 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: [pid: 116064|app: 0|req: 429/878] 10.222.0.49 () {60 vars in 1276 bytes} [Tue Dec 14 13:04:07 2021] GET /compute/v2.1/servers/9b3b44a7-7c20-473c-841c-318e471fc6cd => generated 1720 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 14 13:04:08.130105 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.policy [None req-061e34b0-1e47-47d8-b655-b0cbdf31277b tempest-TestMinimumBasicScenario-84513626 tempest-TestMinimumBasicScenario-84513626-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edf65e37b42d40b28c4e90bd92987016', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bcb503e37b2449484c788574e4c88f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116063) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 13:04:08.138098 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: INFO nova.api.openstack.requestlog [None req-061e34b0-1e47-47d8-b655-b0cbdf31277b tempest-TestMinimumBasicScenario-84513626 tempest-TestMinimumBasicScenario-84513626-project] 10.222.0.49 "GET /compute/v2.1/servers/dd367814-45bc-4808-b2de-d54f79eb7933" status: 200 len: 1756 microversion: 2.1 time: 0.184110 Dec 14 13:04:08.138665 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: [pid: 116063|app: 0|req: 450/879] 10.222.0.49 () {58 vars in 1235 bytes} [Tue Dec 14 13:04:07 2021] GET /compute/v2.1/servers/dd367814-45bc-4808-b2de-d54f79eb7933 => generated 1756 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 14 13:04:09.079432 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.api.openstack.wsgi [None req-0e8866bb-01f5-4ea1-bd88-13904c528dab tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] Calling method '>' {{(pid=116064) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 13:04:09.080446 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.compute.api [None req-0e8866bb-01f5-4ea1-bd88-13904c528dab tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] [instance: 9b3b44a7-7c20-473c-841c-318e471fc6cd] Fetching instance by UUID {{(pid=116064) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 13:04:09.090809 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-0e8866bb-01f5-4ea1-bd88-13904c528dab tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 13:04:09.091274 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-0e8866bb-01f5-4ea1-bd88-13904c528dab tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 13:04:09.092063 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-0e8866bb-01f5-4ea1-bd88-13904c528dab tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 13:04:09.092500 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-0e8866bb-01f5-4ea1-bd88-13904c528dab tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 13:04:09.156312 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.api.openstack.wsgi [None req-8857789b-8d5d-47fa-aa7b-71aa0430c7c3 tempest-TestMinimumBasicScenario-84513626 tempest-TestMinimumBasicScenario-84513626-project] Calling method '>' {{(pid=116063) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 13:04:09.156908 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.compute.api [None req-8857789b-8d5d-47fa-aa7b-71aa0430c7c3 tempest-TestMinimumBasicScenario-84513626 tempest-TestMinimumBasicScenario-84513626-project] [instance: dd367814-45bc-4808-b2de-d54f79eb7933] Fetching instance by UUID {{(pid=116063) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 13:04:09.163566 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-8857789b-8d5d-47fa-aa7b-71aa0430c7c3 tempest-TestMinimumBasicScenario-84513626 tempest-TestMinimumBasicScenario-84513626-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 13:04:09.164012 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-8857789b-8d5d-47fa-aa7b-71aa0430c7c3 tempest-TestMinimumBasicScenario-84513626 tempest-TestMinimumBasicScenario-84513626-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 13:04:09.164752 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-8857789b-8d5d-47fa-aa7b-71aa0430c7c3 tempest-TestMinimumBasicScenario-84513626 tempest-TestMinimumBasicScenario-84513626-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 13:04:09.165209 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-8857789b-8d5d-47fa-aa7b-71aa0430c7c3 tempest-TestMinimumBasicScenario-84513626 tempest-TestMinimumBasicScenario-84513626-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 13:04:09.258046 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.policy [None req-0e8866bb-01f5-4ea1-bd88-13904c528dab tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79d74a2ea1e541d28d085c15cec34032', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68a8770b8dbe489a8119016fbee64eb5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116064) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 13:04:09.266626 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.policy [None req-0e8866bb-01f5-4ea1-bd88-13904c528dab tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '79d74a2ea1e541d28d085c15cec34032', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68a8770b8dbe489a8119016fbee64eb5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116064) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 13:04:09.268224 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.policy [None req-0e8866bb-01f5-4ea1-bd88-13904c528dab tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '79d74a2ea1e541d28d085c15cec34032', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68a8770b8dbe489a8119016fbee64eb5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116064) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 13:04:09.269355 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: INFO nova.api.openstack.requestlog [None req-0e8866bb-01f5-4ea1-bd88-13904c528dab tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] 10.222.0.49 "GET /compute/v2.1/servers/9b3b44a7-7c20-473c-841c-318e471fc6cd" status: 200 len: 1720 microversion: 2.20 time: 0.196317 Dec 14 13:04:09.269990 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: [pid: 116064|app: 0|req: 430/880] 10.222.0.49 () {60 vars in 1276 bytes} [Tue Dec 14 13:04:09 2021] GET /compute/v2.1/servers/9b3b44a7-7c20-473c-841c-318e471fc6cd => generated 1720 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 14 13:04:09.343829 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.policy [None req-8857789b-8d5d-47fa-aa7b-71aa0430c7c3 tempest-TestMinimumBasicScenario-84513626 tempest-TestMinimumBasicScenario-84513626-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edf65e37b42d40b28c4e90bd92987016', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bcb503e37b2449484c788574e4c88f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116063) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 13:04:09.352804 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: INFO nova.api.openstack.requestlog [None req-8857789b-8d5d-47fa-aa7b-71aa0430c7c3 tempest-TestMinimumBasicScenario-84513626 tempest-TestMinimumBasicScenario-84513626-project] 10.222.0.49 "GET /compute/v2.1/servers/dd367814-45bc-4808-b2de-d54f79eb7933" status: 200 len: 1756 microversion: 2.1 time: 0.200267 Dec 14 13:04:09.353409 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: [pid: 116063|app: 0|req: 451/881] 10.222.0.49 () {58 vars in 1235 bytes} [Tue Dec 14 13:04:09 2021] GET /compute/v2.1/servers/dd367814-45bc-4808-b2de-d54f79eb7933 => generated 1756 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 14 13:04:10.290758 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.api.openstack.wsgi [None req-755c136a-537b-47da-b785-58b2463dd9f3 tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] Calling method '>' {{(pid=116064) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 13:04:10.291347 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.compute.api [None req-755c136a-537b-47da-b785-58b2463dd9f3 tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] [instance: 9b3b44a7-7c20-473c-841c-318e471fc6cd] Fetching instance by UUID {{(pid=116064) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 13:04:10.299384 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-755c136a-537b-47da-b785-58b2463dd9f3 tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 13:04:10.300453 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-755c136a-537b-47da-b785-58b2463dd9f3 tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 13:04:10.301279 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-755c136a-537b-47da-b785-58b2463dd9f3 tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 13:04:10.301702 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-755c136a-537b-47da-b785-58b2463dd9f3 tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 13:04:10.369766 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.api.openstack.wsgi [None req-10b857c1-61c1-4f65-aa9b-fd3ab01b89d5 tempest-TestMinimumBasicScenario-84513626 tempest-TestMinimumBasicScenario-84513626-project] Calling method '>' {{(pid=116063) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 13:04:10.370363 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.compute.api [None req-10b857c1-61c1-4f65-aa9b-fd3ab01b89d5 tempest-TestMinimumBasicScenario-84513626 tempest-TestMinimumBasicScenario-84513626-project] [instance: dd367814-45bc-4808-b2de-d54f79eb7933] Fetching instance by UUID {{(pid=116063) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 13:04:10.376624 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-10b857c1-61c1-4f65-aa9b-fd3ab01b89d5 tempest-TestMinimumBasicScenario-84513626 tempest-TestMinimumBasicScenario-84513626-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 13:04:10.377130 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-10b857c1-61c1-4f65-aa9b-fd3ab01b89d5 tempest-TestMinimumBasicScenario-84513626 tempest-TestMinimumBasicScenario-84513626-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 13:04:10.377905 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-10b857c1-61c1-4f65-aa9b-fd3ab01b89d5 tempest-TestMinimumBasicScenario-84513626 tempest-TestMinimumBasicScenario-84513626-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 13:04:10.378336 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-10b857c1-61c1-4f65-aa9b-fd3ab01b89d5 tempest-TestMinimumBasicScenario-84513626 tempest-TestMinimumBasicScenario-84513626-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 13:04:10.462198 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.policy [None req-755c136a-537b-47da-b785-58b2463dd9f3 tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79d74a2ea1e541d28d085c15cec34032', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68a8770b8dbe489a8119016fbee64eb5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116064) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 13:04:10.470036 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.policy [None req-755c136a-537b-47da-b785-58b2463dd9f3 tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '79d74a2ea1e541d28d085c15cec34032', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68a8770b8dbe489a8119016fbee64eb5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116064) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 13:04:10.471544 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.policy [None req-755c136a-537b-47da-b785-58b2463dd9f3 tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '79d74a2ea1e541d28d085c15cec34032', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68a8770b8dbe489a8119016fbee64eb5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116064) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 13:04:10.472709 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: INFO nova.api.openstack.requestlog [None req-755c136a-537b-47da-b785-58b2463dd9f3 tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] 10.222.0.49 "GET /compute/v2.1/servers/9b3b44a7-7c20-473c-841c-318e471fc6cd" status: 200 len: 1723 microversion: 2.20 time: 0.186511 Dec 14 13:04:10.473314 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: [pid: 116064|app: 0|req: 431/882] 10.222.0.49 () {60 vars in 1276 bytes} [Tue Dec 14 13:04:10 2021] GET /compute/v2.1/servers/9b3b44a7-7c20-473c-841c-318e471fc6cd => generated 1723 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 14 13:04:10.490188 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.api.openstack.wsgi [None req-d3cb0ea2-f56e-469a-b073-ca3f8d19aabc tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "d9e207f1-5939-4333-82cb-d61545a23cc4"}} {{(pid=116064) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 14 13:04:10.491238 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.compute.api [None req-d3cb0ea2-f56e-469a-b073-ca3f8d19aabc tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] [instance: 9b3b44a7-7c20-473c-841c-318e471fc6cd] Fetching instance by UUID {{(pid=116064) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 13:04:10.497610 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-d3cb0ea2-f56e-469a-b073-ca3f8d19aabc tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 13:04:10.498062 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-d3cb0ea2-f56e-469a-b073-ca3f8d19aabc tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 13:04:10.498841 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-d3cb0ea2-f56e-469a-b073-ca3f8d19aabc tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 13:04:10.499278 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-d3cb0ea2-f56e-469a-b073-ca3f8d19aabc tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 13:04:10.543753 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.policy [None req-10b857c1-61c1-4f65-aa9b-fd3ab01b89d5 tempest-TestMinimumBasicScenario-84513626 tempest-TestMinimumBasicScenario-84513626-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edf65e37b42d40b28c4e90bd92987016', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bcb503e37b2449484c788574e4c88f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116063) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 13:04:10.552702 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: INFO nova.api.openstack.requestlog [None req-10b857c1-61c1-4f65-aa9b-fd3ab01b89d5 tempest-TestMinimumBasicScenario-84513626 tempest-TestMinimumBasicScenario-84513626-project] 10.222.0.49 "GET /compute/v2.1/servers/dd367814-45bc-4808-b2de-d54f79eb7933" status: 200 len: 1756 microversion: 2.1 time: 0.186542 Dec 14 13:04:10.553368 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: [pid: 116063|app: 0|req: 452/883] 10.222.0.49 () {58 vars in 1235 bytes} [Tue Dec 14 13:04:10 2021] GET /compute/v2.1/servers/dd367814-45bc-4808-b2de-d54f79eb7933 => generated 1756 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 14 13:04:10.927706 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: INFO nova.api.openstack.requestlog [None req-d3cb0ea2-f56e-469a-b073-ca3f8d19aabc tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] 10.222.0.49 "POST /compute/v2.1/servers/9b3b44a7-7c20-473c-841c-318e471fc6cd/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.441125 Dec 14 13:04:10.928294 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: [pid: 116064|app: 0|req: 432/884] 10.222.0.49 () {62 vars in 1363 bytes} [Tue Dec 14 13:04:10 2021] POST /compute/v2.1/servers/9b3b44a7-7c20-473c-841c-318e471fc6cd/os-volume_attachments => generated 188 bytes in 442 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 14 13:04:11.039119 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.api.openstack.wsgi [None req-a68af6db-e064-4ab9-8de0-4984f511f082 tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] Calling method '>' {{(pid=116063) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 13:04:11.039633 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.compute.api [None req-a68af6db-e064-4ab9-8de0-4984f511f082 tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] [instance: 9b3b44a7-7c20-473c-841c-318e471fc6cd] Fetching instance by UUID {{(pid=116063) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 13:04:11.046242 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-a68af6db-e064-4ab9-8de0-4984f511f082 tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 13:04:11.046687 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-a68af6db-e064-4ab9-8de0-4984f511f082 tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 13:04:11.047451 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-a68af6db-e064-4ab9-8de0-4984f511f082 tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 13:04:11.047878 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-a68af6db-e064-4ab9-8de0-4984f511f082 tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 13:04:11.298215 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: INFO nova.api.openstack.requestlog [None req-a68af6db-e064-4ab9-8de0-4984f511f082 tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] 10.222.0.49 "DELETE /compute/v2.1/servers/9b3b44a7-7c20-473c-841c-318e471fc6cd/os-volume_attachments/d9e207f1-5939-4333-82cb-d61545a23cc4" status: 202 len: 0 microversion: 2.20 time: 0.262740 Dec 14 13:04:11.298804 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: [pid: 116063|app: 0|req: 453/885] 10.222.0.49 () {60 vars in 1456 bytes} [Tue Dec 14 13:04:11 2021] DELETE /compute/v2.1/servers/9b3b44a7-7c20-473c-841c-318e471fc6cd/os-volume_attachments/d9e207f1-5939-4333-82cb-d61545a23cc4 => generated 0 bytes in 264 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Dec 14 13:04:11.355100 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.api.openstack.wsgi [None req-d3546743-41f1-4fb4-abb1-475e0b6057da tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=116064) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 14 13:04:11.355647 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.compute.api [None req-d3546743-41f1-4fb4-abb1-475e0b6057da tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] [instance: 9b3b44a7-7c20-473c-841c-318e471fc6cd] Fetching instance by UUID {{(pid=116064) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 13:04:11.362332 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-d3546743-41f1-4fb4-abb1-475e0b6057da tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 13:04:11.362774 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-d3546743-41f1-4fb4-abb1-475e0b6057da tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 13:04:11.363546 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-d3546743-41f1-4fb4-abb1-475e0b6057da tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 13:04:11.363979 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-d3546743-41f1-4fb4-abb1-475e0b6057da tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 13:04:11.523254 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: INFO nova.api.openstack.requestlog [None req-d3546743-41f1-4fb4-abb1-475e0b6057da tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] 10.222.0.49 "POST /compute/v2.1/servers/9b3b44a7-7c20-473c-841c-318e471fc6cd/action" status: 202 len: 0 microversion: 2.20 time: 0.171472 Dec 14 13:04:11.523761 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: [pid: 116064|app: 0|req: 433/886] 10.222.0.49 () {62 vars in 1318 bytes} [Tue Dec 14 13:04:11 2021] POST /compute/v2.1/servers/9b3b44a7-7c20-473c-841c-318e471fc6cd/action => generated 0 bytes in 173 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Dec 14 13:04:11.532634 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.api.openstack.wsgi [None req-1fb07807-d852-48c9-8c8f-6e6cde04661b tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] Calling method '>' {{(pid=116063) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 13:04:11.533262 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.compute.api [None req-1fb07807-d852-48c9-8c8f-6e6cde04661b tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] [instance: 9b3b44a7-7c20-473c-841c-318e471fc6cd] Fetching instance by UUID {{(pid=116063) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 13:04:11.540097 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-1fb07807-d852-48c9-8c8f-6e6cde04661b tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 13:04:11.540538 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-1fb07807-d852-48c9-8c8f-6e6cde04661b tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 13:04:11.541335 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-1fb07807-d852-48c9-8c8f-6e6cde04661b tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 13:04:11.541762 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-1fb07807-d852-48c9-8c8f-6e6cde04661b tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 13:04:11.570137 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.api.openstack.wsgi [None req-18ceef2c-4aae-423f-972f-0c27fcb8a64b tempest-TestMinimumBasicScenario-84513626 tempest-TestMinimumBasicScenario-84513626-project] Calling method '>' {{(pid=116064) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 13:04:11.570848 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.compute.api [None req-18ceef2c-4aae-423f-972f-0c27fcb8a64b tempest-TestMinimumBasicScenario-84513626 tempest-TestMinimumBasicScenario-84513626-project] [instance: dd367814-45bc-4808-b2de-d54f79eb7933] Fetching instance by UUID {{(pid=116064) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 13:04:11.577740 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-18ceef2c-4aae-423f-972f-0c27fcb8a64b tempest-TestMinimumBasicScenario-84513626 tempest-TestMinimumBasicScenario-84513626-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 13:04:11.578192 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-18ceef2c-4aae-423f-972f-0c27fcb8a64b tempest-TestMinimumBasicScenario-84513626 tempest-TestMinimumBasicScenario-84513626-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 13:04:11.578983 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-18ceef2c-4aae-423f-972f-0c27fcb8a64b tempest-TestMinimumBasicScenario-84513626 tempest-TestMinimumBasicScenario-84513626-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 13:04:11.580128 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-18ceef2c-4aae-423f-972f-0c27fcb8a64b tempest-TestMinimumBasicScenario-84513626 tempest-TestMinimumBasicScenario-84513626-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 13:04:11.711718 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.policy [None req-1fb07807-d852-48c9-8c8f-6e6cde04661b tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79d74a2ea1e541d28d085c15cec34032', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68a8770b8dbe489a8119016fbee64eb5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116063) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 13:04:11.725818 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.policy [None req-1fb07807-d852-48c9-8c8f-6e6cde04661b tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '79d74a2ea1e541d28d085c15cec34032', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68a8770b8dbe489a8119016fbee64eb5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116063) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 13:04:11.727331 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.policy [None req-1fb07807-d852-48c9-8c8f-6e6cde04661b tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '79d74a2ea1e541d28d085c15cec34032', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68a8770b8dbe489a8119016fbee64eb5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116063) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 13:04:11.728972 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: INFO nova.api.openstack.requestlog [None req-1fb07807-d852-48c9-8c8f-6e6cde04661b tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] 10.222.0.49 "GET /compute/v2.1/servers/9b3b44a7-7c20-473c-841c-318e471fc6cd" status: 200 len: 1671 microversion: 2.20 time: 0.199921 Dec 14 13:04:11.729723 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: [pid: 116063|app: 0|req: 454/887] 10.222.0.49 () {60 vars in 1276 bytes} [Tue Dec 14 13:04:11 2021] GET /compute/v2.1/servers/9b3b44a7-7c20-473c-841c-318e471fc6cd => generated 1671 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 14 13:04:11.775088 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.policy [None req-18ceef2c-4aae-423f-972f-0c27fcb8a64b tempest-TestMinimumBasicScenario-84513626 tempest-TestMinimumBasicScenario-84513626-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edf65e37b42d40b28c4e90bd92987016', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bcb503e37b2449484c788574e4c88f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116064) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 13:04:11.783001 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: INFO nova.api.openstack.requestlog [None req-18ceef2c-4aae-423f-972f-0c27fcb8a64b tempest-TestMinimumBasicScenario-84513626 tempest-TestMinimumBasicScenario-84513626-project] 10.222.0.49 "GET /compute/v2.1/servers/dd367814-45bc-4808-b2de-d54f79eb7933" status: 200 len: 1756 microversion: 2.1 time: 0.216720 Dec 14 13:04:11.783574 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: [pid: 116064|app: 0|req: 434/888] 10.222.0.49 () {58 vars in 1235 bytes} [Tue Dec 14 13:04:11 2021] GET /compute/v2.1/servers/dd367814-45bc-4808-b2de-d54f79eb7933 => generated 1756 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 14 13:04:11.866107 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.api.openstack.wsgi [req-1a575ecf-69ab-418d-b34d-c3a4e9276e61 req-667711f8-3bb7-4679-8ff6-2789a5082820 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9b3b44a7-7c20-473c-841c-318e471fc6cd", "name": "network-vif-unplugged", "status": "completed", "tag": "0ed44ee3-2630-4f50-9391-4bb374b76e1d"}]} {{(pid=116063) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 14 13:04:11.868246 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 14 13:04:11.868246 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: warnings.warn(msg) Dec 14 13:04:11.875382 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [req-1a575ecf-69ab-418d-b34d-c3a4e9276e61 req-667711f8-3bb7-4679-8ff6-2789a5082820 service nova] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 13:04:11.875816 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [req-1a575ecf-69ab-418d-b34d-c3a4e9276e61 req-667711f8-3bb7-4679-8ff6-2789a5082820 service nova] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 13:04:11.887220 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.api.openstack.compute.server_external_events [req-1a575ecf-69ab-418d-b34d-c3a4e9276e61 req-667711f8-3bb7-4679-8ff6-2789a5082820 service nova] Unable to find a host for instance 9b3b44a7-7c20-473c-841c-318e471fc6cd. Dropping event network-vif-unplugged {{(pid=116063) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:138}} Dec 14 13:04:11.888311 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: INFO nova.api.openstack.requestlog [req-1a575ecf-69ab-418d-b34d-c3a4e9276e61 req-667711f8-3bb7-4679-8ff6-2789a5082820 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.026208 Dec 14 13:04:11.889221 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: [pid: 116063|app: 0|req: 455/889] 10.222.0.49 () {64 vars in 1317 bytes} [Tue Dec 14 13:04:11 2021] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 28 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) Dec 14 13:04:12.748003 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.api.openstack.wsgi [None req-09ee1e56-7c82-48e5-820c-af3ef80f73a2 tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] Calling method '>' {{(pid=116064) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 13:04:12.748591 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.compute.api [None req-09ee1e56-7c82-48e5-820c-af3ef80f73a2 tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] [instance: 9b3b44a7-7c20-473c-841c-318e471fc6cd] Fetching instance by UUID {{(pid=116064) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 13:04:12.755468 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-09ee1e56-7c82-48e5-820c-af3ef80f73a2 tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 13:04:12.755917 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-09ee1e56-7c82-48e5-820c-af3ef80f73a2 tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 13:04:12.756697 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-09ee1e56-7c82-48e5-820c-af3ef80f73a2 tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 13:04:12.757162 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-09ee1e56-7c82-48e5-820c-af3ef80f73a2 tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 13:04:12.800398 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.api.openstack.wsgi [None req-89b3c2c1-86d9-4d4c-a882-3edfebe649da tempest-TestMinimumBasicScenario-84513626 tempest-TestMinimumBasicScenario-84513626-project] Calling method '>' {{(pid=116063) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 13:04:12.801034 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.compute.api [None req-89b3c2c1-86d9-4d4c-a882-3edfebe649da tempest-TestMinimumBasicScenario-84513626 tempest-TestMinimumBasicScenario-84513626-project] [instance: dd367814-45bc-4808-b2de-d54f79eb7933] Fetching instance by UUID {{(pid=116063) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 13:04:12.816279 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-89b3c2c1-86d9-4d4c-a882-3edfebe649da tempest-TestMinimumBasicScenario-84513626 tempest-TestMinimumBasicScenario-84513626-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 13:04:12.816728 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-89b3c2c1-86d9-4d4c-a882-3edfebe649da tempest-TestMinimumBasicScenario-84513626 tempest-TestMinimumBasicScenario-84513626-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 13:04:12.817559 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-89b3c2c1-86d9-4d4c-a882-3edfebe649da tempest-TestMinimumBasicScenario-84513626 tempest-TestMinimumBasicScenario-84513626-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 13:04:12.817995 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-89b3c2c1-86d9-4d4c-a882-3edfebe649da tempest-TestMinimumBasicScenario-84513626 tempest-TestMinimumBasicScenario-84513626-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 13:04:12.922818 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.policy [None req-09ee1e56-7c82-48e5-820c-af3ef80f73a2 tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79d74a2ea1e541d28d085c15cec34032', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68a8770b8dbe489a8119016fbee64eb5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116064) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 13:04:12.930985 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.policy [None req-09ee1e56-7c82-48e5-820c-af3ef80f73a2 tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '79d74a2ea1e541d28d085c15cec34032', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68a8770b8dbe489a8119016fbee64eb5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116064) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 13:04:12.932471 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.policy [None req-09ee1e56-7c82-48e5-820c-af3ef80f73a2 tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '79d74a2ea1e541d28d085c15cec34032', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68a8770b8dbe489a8119016fbee64eb5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116064) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 13:04:12.933809 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: INFO nova.api.openstack.requestlog [None req-09ee1e56-7c82-48e5-820c-af3ef80f73a2 tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] 10.222.0.49 "GET /compute/v2.1/servers/9b3b44a7-7c20-473c-841c-318e471fc6cd" status: 200 len: 1729 microversion: 2.20 time: 0.189986 Dec 14 13:04:12.935322 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: [pid: 116064|app: 0|req: 435/890] 10.222.0.49 () {60 vars in 1276 bytes} [Tue Dec 14 13:04:12 2021] GET /compute/v2.1/servers/9b3b44a7-7c20-473c-841c-318e471fc6cd => generated 1729 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 14 13:04:12.995062 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.policy [None req-89b3c2c1-86d9-4d4c-a882-3edfebe649da tempest-TestMinimumBasicScenario-84513626 tempest-TestMinimumBasicScenario-84513626-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edf65e37b42d40b28c4e90bd92987016', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bcb503e37b2449484c788574e4c88f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116063) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 13:04:13.003140 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: INFO nova.api.openstack.requestlog [None req-89b3c2c1-86d9-4d4c-a882-3edfebe649da tempest-TestMinimumBasicScenario-84513626 tempest-TestMinimumBasicScenario-84513626-project] 10.222.0.49 "GET /compute/v2.1/servers/dd367814-45bc-4808-b2de-d54f79eb7933" status: 200 len: 1756 microversion: 2.1 time: 0.206267 Dec 14 13:04:13.003737 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: [pid: 116063|app: 0|req: 456/891] 10.222.0.49 () {58 vars in 1235 bytes} [Tue Dec 14 13:04:12 2021] GET /compute/v2.1/servers/dd367814-45bc-4808-b2de-d54f79eb7933 => generated 1756 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 14 13:04:13.952798 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.api.openstack.wsgi [None req-441a30c8-39ae-4338-baf3-494c217e1d37 tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] Calling method '>' {{(pid=116064) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 13:04:13.953427 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.compute.api [None req-441a30c8-39ae-4338-baf3-494c217e1d37 tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] [instance: 9b3b44a7-7c20-473c-841c-318e471fc6cd] Fetching instance by UUID {{(pid=116064) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 13:04:13.965548 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-441a30c8-39ae-4338-baf3-494c217e1d37 tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 13:04:13.966251 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-441a30c8-39ae-4338-baf3-494c217e1d37 tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 13:04:13.967489 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-441a30c8-39ae-4338-baf3-494c217e1d37 tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 13:04:13.968218 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-441a30c8-39ae-4338-baf3-494c217e1d37 tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 13:04:14.019512 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.api.openstack.wsgi [None req-fc2a1b19-4268-46cc-8be1-5725d71122e5 tempest-TestMinimumBasicScenario-84513626 tempest-TestMinimumBasicScenario-84513626-project] Calling method '>' {{(pid=116063) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 13:04:14.020361 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.compute.api [None req-fc2a1b19-4268-46cc-8be1-5725d71122e5 tempest-TestMinimumBasicScenario-84513626 tempest-TestMinimumBasicScenario-84513626-project] [instance: dd367814-45bc-4808-b2de-d54f79eb7933] Fetching instance by UUID {{(pid=116063) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 13:04:14.027610 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-fc2a1b19-4268-46cc-8be1-5725d71122e5 tempest-TestMinimumBasicScenario-84513626 tempest-TestMinimumBasicScenario-84513626-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 13:04:14.028054 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-fc2a1b19-4268-46cc-8be1-5725d71122e5 tempest-TestMinimumBasicScenario-84513626 tempest-TestMinimumBasicScenario-84513626-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 13:04:14.028824 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-fc2a1b19-4268-46cc-8be1-5725d71122e5 tempest-TestMinimumBasicScenario-84513626 tempest-TestMinimumBasicScenario-84513626-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 13:04:14.029296 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-fc2a1b19-4268-46cc-8be1-5725d71122e5 tempest-TestMinimumBasicScenario-84513626 tempest-TestMinimumBasicScenario-84513626-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 13:04:14.134078 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.policy [None req-441a30c8-39ae-4338-baf3-494c217e1d37 tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79d74a2ea1e541d28d085c15cec34032', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68a8770b8dbe489a8119016fbee64eb5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116064) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 13:04:14.143252 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.policy [None req-441a30c8-39ae-4338-baf3-494c217e1d37 tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '79d74a2ea1e541d28d085c15cec34032', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68a8770b8dbe489a8119016fbee64eb5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116064) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 13:04:14.145675 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.policy [None req-441a30c8-39ae-4338-baf3-494c217e1d37 tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '79d74a2ea1e541d28d085c15cec34032', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68a8770b8dbe489a8119016fbee64eb5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116064) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 13:04:14.146881 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: INFO nova.api.openstack.requestlog [None req-441a30c8-39ae-4338-baf3-494c217e1d37 tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] 10.222.0.49 "GET /compute/v2.1/servers/9b3b44a7-7c20-473c-841c-318e471fc6cd" status: 200 len: 1729 microversion: 2.20 time: 0.197869 Dec 14 13:04:14.158922 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: [pid: 116064|app: 0|req: 436/892] 10.222.0.49 () {60 vars in 1276 bytes} [Tue Dec 14 13:04:13 2021] GET /compute/v2.1/servers/9b3b44a7-7c20-473c-841c-318e471fc6cd => generated 1729 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 14 13:04:14.224273 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.policy [None req-fc2a1b19-4268-46cc-8be1-5725d71122e5 tempest-TestMinimumBasicScenario-84513626 tempest-TestMinimumBasicScenario-84513626-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edf65e37b42d40b28c4e90bd92987016', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bcb503e37b2449484c788574e4c88f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116063) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 13:04:14.233691 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: INFO nova.api.openstack.requestlog [None req-fc2a1b19-4268-46cc-8be1-5725d71122e5 tempest-TestMinimumBasicScenario-84513626 tempest-TestMinimumBasicScenario-84513626-project] 10.222.0.49 "GET /compute/v2.1/servers/dd367814-45bc-4808-b2de-d54f79eb7933" status: 200 len: 1756 microversion: 2.1 time: 0.217834 Dec 14 13:04:14.234709 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: [pid: 116063|app: 0|req: 457/893] 10.222.0.49 () {58 vars in 1235 bytes} [Tue Dec 14 13:04:14 2021] GET /compute/v2.1/servers/dd367814-45bc-4808-b2de-d54f79eb7933 => generated 1756 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 14 13:04:15.169897 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.api.openstack.wsgi [None req-8a658653-0b5d-4dc0-947e-e76f778ebd45 tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] Calling method '>' {{(pid=116064) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 13:04:15.170773 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.compute.api [None req-8a658653-0b5d-4dc0-947e-e76f778ebd45 tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] [instance: 9b3b44a7-7c20-473c-841c-318e471fc6cd] Fetching instance by UUID {{(pid=116064) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 13:04:15.183142 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-8a658653-0b5d-4dc0-947e-e76f778ebd45 tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 13:04:15.183597 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-8a658653-0b5d-4dc0-947e-e76f778ebd45 tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 13:04:15.184402 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-8a658653-0b5d-4dc0-947e-e76f778ebd45 tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 13:04:15.184838 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-8a658653-0b5d-4dc0-947e-e76f778ebd45 tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 13:04:15.251415 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.api.openstack.wsgi [None req-076c73c9-c92f-4bb4-a689-38a346c9ebce tempest-TestMinimumBasicScenario-84513626 tempest-TestMinimumBasicScenario-84513626-project] Calling method '>' {{(pid=116063) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 13:04:15.252036 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.compute.api [None req-076c73c9-c92f-4bb4-a689-38a346c9ebce tempest-TestMinimumBasicScenario-84513626 tempest-TestMinimumBasicScenario-84513626-project] [instance: dd367814-45bc-4808-b2de-d54f79eb7933] Fetching instance by UUID {{(pid=116063) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 13:04:15.258489 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-076c73c9-c92f-4bb4-a689-38a346c9ebce tempest-TestMinimumBasicScenario-84513626 tempest-TestMinimumBasicScenario-84513626-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 13:04:15.259632 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-076c73c9-c92f-4bb4-a689-38a346c9ebce tempest-TestMinimumBasicScenario-84513626 tempest-TestMinimumBasicScenario-84513626-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 13:04:15.259914 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-076c73c9-c92f-4bb4-a689-38a346c9ebce tempest-TestMinimumBasicScenario-84513626 tempest-TestMinimumBasicScenario-84513626-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 13:04:15.260599 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-076c73c9-c92f-4bb4-a689-38a346c9ebce tempest-TestMinimumBasicScenario-84513626 tempest-TestMinimumBasicScenario-84513626-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 13:04:15.354905 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.policy [None req-8a658653-0b5d-4dc0-947e-e76f778ebd45 tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79d74a2ea1e541d28d085c15cec34032', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68a8770b8dbe489a8119016fbee64eb5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116064) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 13:04:15.371045 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.policy [None req-8a658653-0b5d-4dc0-947e-e76f778ebd45 tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '79d74a2ea1e541d28d085c15cec34032', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68a8770b8dbe489a8119016fbee64eb5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116064) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 13:04:15.373858 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.policy [None req-8a658653-0b5d-4dc0-947e-e76f778ebd45 tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '79d74a2ea1e541d28d085c15cec34032', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68a8770b8dbe489a8119016fbee64eb5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116064) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 13:04:15.375083 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: INFO nova.api.openstack.requestlog [None req-8a658653-0b5d-4dc0-947e-e76f778ebd45 tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] 10.222.0.49 "GET /compute/v2.1/servers/9b3b44a7-7c20-473c-841c-318e471fc6cd" status: 200 len: 1729 microversion: 2.20 time: 0.211869 Dec 14 13:04:15.375866 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: [pid: 116064|app: 0|req: 437/894] 10.222.0.49 () {60 vars in 1276 bytes} [Tue Dec 14 13:04:15 2021] GET /compute/v2.1/servers/9b3b44a7-7c20-473c-841c-318e471fc6cd => generated 1729 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 14 13:04:15.445383 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.policy [None req-076c73c9-c92f-4bb4-a689-38a346c9ebce tempest-TestMinimumBasicScenario-84513626 tempest-TestMinimumBasicScenario-84513626-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edf65e37b42d40b28c4e90bd92987016', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bcb503e37b2449484c788574e4c88f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116063) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 13:04:15.454458 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: INFO nova.api.openstack.requestlog [None req-076c73c9-c92f-4bb4-a689-38a346c9ebce tempest-TestMinimumBasicScenario-84513626 tempest-TestMinimumBasicScenario-84513626-project] 10.222.0.49 "GET /compute/v2.1/servers/dd367814-45bc-4808-b2de-d54f79eb7933" status: 200 len: 1756 microversion: 2.1 time: 0.206746 Dec 14 13:04:15.455331 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: [pid: 116063|app: 0|req: 458/895] 10.222.0.49 () {58 vars in 1235 bytes} [Tue Dec 14 13:04:15 2021] GET /compute/v2.1/servers/dd367814-45bc-4808-b2de-d54f79eb7933 => generated 1756 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 14 13:04:16.396464 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.api.openstack.wsgi [None req-6e60da55-013a-4370-bcd3-2b22ec4929ea tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] Calling method '>' {{(pid=116064) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 13:04:16.397411 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.compute.api [None req-6e60da55-013a-4370-bcd3-2b22ec4929ea tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] [instance: 9b3b44a7-7c20-473c-841c-318e471fc6cd] Fetching instance by UUID {{(pid=116064) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 13:04:16.407231 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-6e60da55-013a-4370-bcd3-2b22ec4929ea tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 13:04:16.407928 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-6e60da55-013a-4370-bcd3-2b22ec4929ea tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 13:04:16.409181 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-6e60da55-013a-4370-bcd3-2b22ec4929ea tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 13:04:16.410055 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-6e60da55-013a-4370-bcd3-2b22ec4929ea tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 13:04:16.471912 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.api.openstack.wsgi [None req-2fa1b9ad-fd57-4f6b-9033-3d87dcbb42e7 tempest-TestMinimumBasicScenario-84513626 tempest-TestMinimumBasicScenario-84513626-project] Calling method '>' {{(pid=116063) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 13:04:16.472525 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.compute.api [None req-2fa1b9ad-fd57-4f6b-9033-3d87dcbb42e7 tempest-TestMinimumBasicScenario-84513626 tempest-TestMinimumBasicScenario-84513626-project] [instance: dd367814-45bc-4808-b2de-d54f79eb7933] Fetching instance by UUID {{(pid=116063) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 13:04:16.478868 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-2fa1b9ad-fd57-4f6b-9033-3d87dcbb42e7 tempest-TestMinimumBasicScenario-84513626 tempest-TestMinimumBasicScenario-84513626-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 13:04:16.479314 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-2fa1b9ad-fd57-4f6b-9033-3d87dcbb42e7 tempest-TestMinimumBasicScenario-84513626 tempest-TestMinimumBasicScenario-84513626-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 13:04:16.480152 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-2fa1b9ad-fd57-4f6b-9033-3d87dcbb42e7 tempest-TestMinimumBasicScenario-84513626 tempest-TestMinimumBasicScenario-84513626-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 13:04:16.480579 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-2fa1b9ad-fd57-4f6b-9033-3d87dcbb42e7 tempest-TestMinimumBasicScenario-84513626 tempest-TestMinimumBasicScenario-84513626-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 13:04:16.574809 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.policy [None req-6e60da55-013a-4370-bcd3-2b22ec4929ea tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79d74a2ea1e541d28d085c15cec34032', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68a8770b8dbe489a8119016fbee64eb5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116064) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 13:04:16.582865 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.policy [None req-6e60da55-013a-4370-bcd3-2b22ec4929ea tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '79d74a2ea1e541d28d085c15cec34032', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68a8770b8dbe489a8119016fbee64eb5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116064) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 13:04:16.584369 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.policy [None req-6e60da55-013a-4370-bcd3-2b22ec4929ea tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '79d74a2ea1e541d28d085c15cec34032', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68a8770b8dbe489a8119016fbee64eb5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116064) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 13:04:16.585571 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: INFO nova.api.openstack.requestlog [None req-6e60da55-013a-4370-bcd3-2b22ec4929ea tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] 10.222.0.49 "GET /compute/v2.1/servers/9b3b44a7-7c20-473c-841c-318e471fc6cd" status: 200 len: 1729 microversion: 2.20 time: 0.194840 Dec 14 13:04:16.586112 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: [pid: 116064|app: 0|req: 438/896] 10.222.0.49 () {60 vars in 1276 bytes} [Tue Dec 14 13:04:16 2021] GET /compute/v2.1/servers/9b3b44a7-7c20-473c-841c-318e471fc6cd => generated 1729 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Dec 14 13:04:16.661692 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.policy [None req-2fa1b9ad-fd57-4f6b-9033-3d87dcbb42e7 tempest-TestMinimumBasicScenario-84513626 tempest-TestMinimumBasicScenario-84513626-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edf65e37b42d40b28c4e90bd92987016', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bcb503e37b2449484c788574e4c88f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116063) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 13:04:16.671108 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: INFO nova.api.openstack.requestlog [None req-2fa1b9ad-fd57-4f6b-9033-3d87dcbb42e7 tempest-TestMinimumBasicScenario-84513626 tempest-TestMinimumBasicScenario-84513626-project] 10.222.0.49 "GET /compute/v2.1/servers/dd367814-45bc-4808-b2de-d54f79eb7933" status: 200 len: 1756 microversion: 2.1 time: 0.202768 Dec 14 13:04:16.671686 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: [pid: 116063|app: 0|req: 459/897] 10.222.0.49 () {58 vars in 1235 bytes} [Tue Dec 14 13:04:16 2021] GET /compute/v2.1/servers/dd367814-45bc-4808-b2de-d54f79eb7933 => generated 1756 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 14 13:04:17.603886 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.api.openstack.wsgi [None req-fb600a43-6404-4473-9a19-9fa56b7f7515 tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] Calling method '>' {{(pid=116064) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 13:04:17.604666 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.compute.api [None req-fb600a43-6404-4473-9a19-9fa56b7f7515 tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] [instance: 9b3b44a7-7c20-473c-841c-318e471fc6cd] Fetching instance by UUID {{(pid=116064) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 13:04:17.611173 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-fb600a43-6404-4473-9a19-9fa56b7f7515 tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 13:04:17.611623 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-fb600a43-6404-4473-9a19-9fa56b7f7515 tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 13:04:17.612399 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-fb600a43-6404-4473-9a19-9fa56b7f7515 tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 13:04:17.612827 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-fb600a43-6404-4473-9a19-9fa56b7f7515 tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 13:04:17.689305 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.api.openstack.wsgi [None req-79167b1e-865d-4ecc-80f2-b5f5c4dea22c tempest-TestMinimumBasicScenario-84513626 tempest-TestMinimumBasicScenario-84513626-project] Calling method '>' {{(pid=116063) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 13:04:17.690933 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.compute.api [None req-79167b1e-865d-4ecc-80f2-b5f5c4dea22c tempest-TestMinimumBasicScenario-84513626 tempest-TestMinimumBasicScenario-84513626-project] [instance: dd367814-45bc-4808-b2de-d54f79eb7933] Fetching instance by UUID {{(pid=116063) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 13:04:17.699256 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-79167b1e-865d-4ecc-80f2-b5f5c4dea22c tempest-TestMinimumBasicScenario-84513626 tempest-TestMinimumBasicScenario-84513626-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 13:04:17.699853 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-79167b1e-865d-4ecc-80f2-b5f5c4dea22c tempest-TestMinimumBasicScenario-84513626 tempest-TestMinimumBasicScenario-84513626-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 13:04:17.700719 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-79167b1e-865d-4ecc-80f2-b5f5c4dea22c tempest-TestMinimumBasicScenario-84513626 tempest-TestMinimumBasicScenario-84513626-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 13:04:17.701200 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-79167b1e-865d-4ecc-80f2-b5f5c4dea22c tempest-TestMinimumBasicScenario-84513626 tempest-TestMinimumBasicScenario-84513626-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 13:04:17.789906 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.policy [None req-fb600a43-6404-4473-9a19-9fa56b7f7515 tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79d74a2ea1e541d28d085c15cec34032', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68a8770b8dbe489a8119016fbee64eb5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116064) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 13:04:17.808117 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.policy [None req-fb600a43-6404-4473-9a19-9fa56b7f7515 tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '79d74a2ea1e541d28d085c15cec34032', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68a8770b8dbe489a8119016fbee64eb5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116064) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 13:04:17.814277 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.policy [None req-fb600a43-6404-4473-9a19-9fa56b7f7515 tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '79d74a2ea1e541d28d085c15cec34032', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68a8770b8dbe489a8119016fbee64eb5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116064) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 13:04:17.815483 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: INFO nova.api.openstack.requestlog [None req-fb600a43-6404-4473-9a19-9fa56b7f7515 tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] 10.222.0.49 "GET /compute/v2.1/servers/9b3b44a7-7c20-473c-841c-318e471fc6cd" status: 200 len: 1729 microversion: 2.20 time: 0.215439 Dec 14 13:04:17.816134 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: [pid: 116064|app: 0|req: 439/898] 10.222.0.49 () {60 vars in 1276 bytes} [Tue Dec 14 13:04:17 2021] GET /compute/v2.1/servers/9b3b44a7-7c20-473c-841c-318e471fc6cd => generated 1729 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 14 13:04:17.877439 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.policy [None req-79167b1e-865d-4ecc-80f2-b5f5c4dea22c tempest-TestMinimumBasicScenario-84513626 tempest-TestMinimumBasicScenario-84513626-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edf65e37b42d40b28c4e90bd92987016', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bcb503e37b2449484c788574e4c88f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116063) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 13:04:17.887105 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: INFO nova.api.openstack.requestlog [None req-79167b1e-865d-4ecc-80f2-b5f5c4dea22c tempest-TestMinimumBasicScenario-84513626 tempest-TestMinimumBasicScenario-84513626-project] 10.222.0.49 "GET /compute/v2.1/servers/dd367814-45bc-4808-b2de-d54f79eb7933" status: 200 len: 1756 microversion: 2.1 time: 0.202090 Dec 14 13:04:17.888083 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: [pid: 116063|app: 0|req: 460/899] 10.222.0.49 () {58 vars in 1235 bytes} [Tue Dec 14 13:04:17 2021] GET /compute/v2.1/servers/dd367814-45bc-4808-b2de-d54f79eb7933 => generated 1756 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 14 13:04:18.833815 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.api.openstack.wsgi [None req-bbec44e1-db5f-4422-a979-78b033b4dd95 tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] Calling method '>' {{(pid=116064) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 13:04:18.834530 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.compute.api [None req-bbec44e1-db5f-4422-a979-78b033b4dd95 tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] [instance: 9b3b44a7-7c20-473c-841c-318e471fc6cd] Fetching instance by UUID {{(pid=116064) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 13:04:18.840778 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-bbec44e1-db5f-4422-a979-78b033b4dd95 tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 13:04:18.841254 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-bbec44e1-db5f-4422-a979-78b033b4dd95 tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 13:04:18.842035 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-bbec44e1-db5f-4422-a979-78b033b4dd95 tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 13:04:18.842469 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-bbec44e1-db5f-4422-a979-78b033b4dd95 tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 13:04:18.904894 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.api.openstack.wsgi [None req-27c00875-f70b-4875-b6bf-ddd9bc4509f5 tempest-TestMinimumBasicScenario-84513626 tempest-TestMinimumBasicScenario-84513626-project] Calling method '>' {{(pid=116063) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 13:04:18.906313 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.compute.api [None req-27c00875-f70b-4875-b6bf-ddd9bc4509f5 tempest-TestMinimumBasicScenario-84513626 tempest-TestMinimumBasicScenario-84513626-project] [instance: dd367814-45bc-4808-b2de-d54f79eb7933] Fetching instance by UUID {{(pid=116063) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 13:04:18.914175 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-27c00875-f70b-4875-b6bf-ddd9bc4509f5 tempest-TestMinimumBasicScenario-84513626 tempest-TestMinimumBasicScenario-84513626-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 13:04:18.914611 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-27c00875-f70b-4875-b6bf-ddd9bc4509f5 tempest-TestMinimumBasicScenario-84513626 tempest-TestMinimumBasicScenario-84513626-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 13:04:18.915431 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-27c00875-f70b-4875-b6bf-ddd9bc4509f5 tempest-TestMinimumBasicScenario-84513626 tempest-TestMinimumBasicScenario-84513626-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 13:04:18.915864 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-27c00875-f70b-4875-b6bf-ddd9bc4509f5 tempest-TestMinimumBasicScenario-84513626 tempest-TestMinimumBasicScenario-84513626-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 13:04:19.015075 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.policy [None req-bbec44e1-db5f-4422-a979-78b033b4dd95 tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79d74a2ea1e541d28d085c15cec34032', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68a8770b8dbe489a8119016fbee64eb5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116064) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 13:04:19.022913 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.policy [None req-bbec44e1-db5f-4422-a979-78b033b4dd95 tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '79d74a2ea1e541d28d085c15cec34032', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68a8770b8dbe489a8119016fbee64eb5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116064) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 13:04:19.024516 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.policy [None req-bbec44e1-db5f-4422-a979-78b033b4dd95 tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '79d74a2ea1e541d28d085c15cec34032', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68a8770b8dbe489a8119016fbee64eb5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116064) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 13:04:19.025791 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: INFO nova.api.openstack.requestlog [None req-bbec44e1-db5f-4422-a979-78b033b4dd95 tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] 10.222.0.49 "GET /compute/v2.1/servers/9b3b44a7-7c20-473c-841c-318e471fc6cd" status: 200 len: 1729 microversion: 2.20 time: 0.195869 Dec 14 13:04:19.026483 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: [pid: 116064|app: 0|req: 440/900] 10.222.0.49 () {60 vars in 1276 bytes} [Tue Dec 14 13:04:18 2021] GET /compute/v2.1/servers/9b3b44a7-7c20-473c-841c-318e471fc6cd => generated 1729 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 14 13:04:19.095396 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.policy [None req-27c00875-f70b-4875-b6bf-ddd9bc4509f5 tempest-TestMinimumBasicScenario-84513626 tempest-TestMinimumBasicScenario-84513626-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edf65e37b42d40b28c4e90bd92987016', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bcb503e37b2449484c788574e4c88f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116063) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 13:04:19.104925 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: INFO nova.api.openstack.requestlog [None req-27c00875-f70b-4875-b6bf-ddd9bc4509f5 tempest-TestMinimumBasicScenario-84513626 tempest-TestMinimumBasicScenario-84513626-project] 10.222.0.49 "GET /compute/v2.1/servers/dd367814-45bc-4808-b2de-d54f79eb7933" status: 200 len: 1756 microversion: 2.1 time: 0.204851 Dec 14 13:04:19.105719 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: [pid: 116063|app: 0|req: 461/901] 10.222.0.49 () {58 vars in 1235 bytes} [Tue Dec 14 13:04:18 2021] GET /compute/v2.1/servers/dd367814-45bc-4808-b2de-d54f79eb7933 => generated 1756 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 14 13:04:20.043967 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.api.openstack.wsgi [None req-7de7337e-2cad-4f55-89a2-7954da080124 tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] Calling method '>' {{(pid=116064) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 13:04:20.044645 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.compute.api [None req-7de7337e-2cad-4f55-89a2-7954da080124 tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] [instance: 9b3b44a7-7c20-473c-841c-318e471fc6cd] Fetching instance by UUID {{(pid=116064) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 13:04:20.051228 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-7de7337e-2cad-4f55-89a2-7954da080124 tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 13:04:20.051679 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-7de7337e-2cad-4f55-89a2-7954da080124 tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 13:04:20.052459 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-7de7337e-2cad-4f55-89a2-7954da080124 tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 13:04:20.052922 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-7de7337e-2cad-4f55-89a2-7954da080124 tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 13:04:20.122291 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.api.openstack.wsgi [None req-481e2ace-0394-49e9-a216-4aa6d1eb4b6e tempest-TestMinimumBasicScenario-84513626 tempest-TestMinimumBasicScenario-84513626-project] Calling method '>' {{(pid=116063) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 13:04:20.122900 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.compute.api [None req-481e2ace-0394-49e9-a216-4aa6d1eb4b6e tempest-TestMinimumBasicScenario-84513626 tempest-TestMinimumBasicScenario-84513626-project] [instance: dd367814-45bc-4808-b2de-d54f79eb7933] Fetching instance by UUID {{(pid=116063) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 13:04:20.129188 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-481e2ace-0394-49e9-a216-4aa6d1eb4b6e tempest-TestMinimumBasicScenario-84513626 tempest-TestMinimumBasicScenario-84513626-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 13:04:20.129636 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-481e2ace-0394-49e9-a216-4aa6d1eb4b6e tempest-TestMinimumBasicScenario-84513626 tempest-TestMinimumBasicScenario-84513626-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 13:04:20.130407 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-481e2ace-0394-49e9-a216-4aa6d1eb4b6e tempest-TestMinimumBasicScenario-84513626 tempest-TestMinimumBasicScenario-84513626-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 13:04:20.130929 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-481e2ace-0394-49e9-a216-4aa6d1eb4b6e tempest-TestMinimumBasicScenario-84513626 tempest-TestMinimumBasicScenario-84513626-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 13:04:20.215941 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.policy [None req-7de7337e-2cad-4f55-89a2-7954da080124 tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79d74a2ea1e541d28d085c15cec34032', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68a8770b8dbe489a8119016fbee64eb5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116064) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 13:04:20.223911 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.policy [None req-7de7337e-2cad-4f55-89a2-7954da080124 tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '79d74a2ea1e541d28d085c15cec34032', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68a8770b8dbe489a8119016fbee64eb5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116064) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 13:04:20.225440 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.policy [None req-7de7337e-2cad-4f55-89a2-7954da080124 tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '79d74a2ea1e541d28d085c15cec34032', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68a8770b8dbe489a8119016fbee64eb5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116064) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 13:04:20.226606 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: INFO nova.api.openstack.requestlog [None req-7de7337e-2cad-4f55-89a2-7954da080124 tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] 10.222.0.49 "GET /compute/v2.1/servers/9b3b44a7-7c20-473c-841c-318e471fc6cd" status: 200 len: 1729 microversion: 2.20 time: 0.186929 Dec 14 13:04:20.227166 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: [pid: 116064|app: 0|req: 441/902] 10.222.0.49 () {60 vars in 1276 bytes} [Tue Dec 14 13:04:20 2021] GET /compute/v2.1/servers/9b3b44a7-7c20-473c-841c-318e471fc6cd => generated 1729 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 14 13:04:20.301195 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.policy [None req-481e2ace-0394-49e9-a216-4aa6d1eb4b6e tempest-TestMinimumBasicScenario-84513626 tempest-TestMinimumBasicScenario-84513626-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edf65e37b42d40b28c4e90bd92987016', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bcb503e37b2449484c788574e4c88f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116063) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 13:04:20.310292 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: INFO nova.api.openstack.requestlog [None req-481e2ace-0394-49e9-a216-4aa6d1eb4b6e tempest-TestMinimumBasicScenario-84513626 tempest-TestMinimumBasicScenario-84513626-project] 10.222.0.49 "GET /compute/v2.1/servers/dd367814-45bc-4808-b2de-d54f79eb7933" status: 200 len: 1756 microversion: 2.1 time: 0.191693 Dec 14 13:04:20.310881 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: [pid: 116063|app: 0|req: 462/903] 10.222.0.49 () {58 vars in 1235 bytes} [Tue Dec 14 13:04:20 2021] GET /compute/v2.1/servers/dd367814-45bc-4808-b2de-d54f79eb7933 => generated 1756 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 14 13:04:21.246207 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.api.openstack.wsgi [None req-7daa7ae4-ca73-40c1-a365-f9b97a90ae90 tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] Calling method '>' {{(pid=116064) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 13:04:21.246829 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.compute.api [None req-7daa7ae4-ca73-40c1-a365-f9b97a90ae90 tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] [instance: 9b3b44a7-7c20-473c-841c-318e471fc6cd] Fetching instance by UUID {{(pid=116064) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 13:04:21.253496 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-7daa7ae4-ca73-40c1-a365-f9b97a90ae90 tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 13:04:21.253937 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-7daa7ae4-ca73-40c1-a365-f9b97a90ae90 tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 13:04:21.254714 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-7daa7ae4-ca73-40c1-a365-f9b97a90ae90 tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 13:04:21.255179 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-7daa7ae4-ca73-40c1-a365-f9b97a90ae90 tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 13:04:21.327473 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.api.openstack.wsgi [None req-1b31a5d9-57de-43c0-8598-df22d5db4886 tempest-TestMinimumBasicScenario-84513626 tempest-TestMinimumBasicScenario-84513626-project] Calling method '>' {{(pid=116063) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 13:04:21.328783 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.compute.api [None req-1b31a5d9-57de-43c0-8598-df22d5db4886 tempest-TestMinimumBasicScenario-84513626 tempest-TestMinimumBasicScenario-84513626-project] [instance: dd367814-45bc-4808-b2de-d54f79eb7933] Fetching instance by UUID {{(pid=116063) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 13:04:21.335816 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-1b31a5d9-57de-43c0-8598-df22d5db4886 tempest-TestMinimumBasicScenario-84513626 tempest-TestMinimumBasicScenario-84513626-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 13:04:21.336266 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-1b31a5d9-57de-43c0-8598-df22d5db4886 tempest-TestMinimumBasicScenario-84513626 tempest-TestMinimumBasicScenario-84513626-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 13:04:21.337077 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-1b31a5d9-57de-43c0-8598-df22d5db4886 tempest-TestMinimumBasicScenario-84513626 tempest-TestMinimumBasicScenario-84513626-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 13:04:21.337553 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-1b31a5d9-57de-43c0-8598-df22d5db4886 tempest-TestMinimumBasicScenario-84513626 tempest-TestMinimumBasicScenario-84513626-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 13:04:21.424908 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.policy [None req-7daa7ae4-ca73-40c1-a365-f9b97a90ae90 tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79d74a2ea1e541d28d085c15cec34032', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68a8770b8dbe489a8119016fbee64eb5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116064) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 13:04:21.434071 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.policy [None req-7daa7ae4-ca73-40c1-a365-f9b97a90ae90 tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '79d74a2ea1e541d28d085c15cec34032', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68a8770b8dbe489a8119016fbee64eb5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116064) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 13:04:21.435836 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.policy [None req-7daa7ae4-ca73-40c1-a365-f9b97a90ae90 tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '79d74a2ea1e541d28d085c15cec34032', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68a8770b8dbe489a8119016fbee64eb5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116064) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 13:04:21.437211 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: INFO nova.api.openstack.requestlog [None req-7daa7ae4-ca73-40c1-a365-f9b97a90ae90 tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] 10.222.0.49 "GET /compute/v2.1/servers/9b3b44a7-7c20-473c-841c-318e471fc6cd" status: 200 len: 1729 microversion: 2.20 time: 0.195453 Dec 14 13:04:21.441544 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: [pid: 116064|app: 0|req: 442/904] 10.222.0.49 () {60 vars in 1276 bytes} [Tue Dec 14 13:04:21 2021] GET /compute/v2.1/servers/9b3b44a7-7c20-473c-841c-318e471fc6cd => generated 1729 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 14 13:04:21.535557 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.policy [None req-1b31a5d9-57de-43c0-8598-df22d5db4886 tempest-TestMinimumBasicScenario-84513626 tempest-TestMinimumBasicScenario-84513626-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edf65e37b42d40b28c4e90bd92987016', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bcb503e37b2449484c788574e4c88f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116063) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 13:04:21.545889 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: INFO nova.api.openstack.requestlog [None req-1b31a5d9-57de-43c0-8598-df22d5db4886 tempest-TestMinimumBasicScenario-84513626 tempest-TestMinimumBasicScenario-84513626-project] 10.222.0.49 "GET /compute/v2.1/servers/dd367814-45bc-4808-b2de-d54f79eb7933" status: 200 len: 1756 microversion: 2.1 time: 0.221997 Dec 14 13:04:21.552104 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: [pid: 116063|app: 0|req: 463/905] 10.222.0.49 () {58 vars in 1235 bytes} [Tue Dec 14 13:04:21 2021] GET /compute/v2.1/servers/dd367814-45bc-4808-b2de-d54f79eb7933 => generated 1756 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 14 13:04:22.458808 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.api.openstack.wsgi [None req-bdf09337-579f-406e-bdba-13dccca9d415 tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] Calling method '>' {{(pid=116064) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 13:04:22.459770 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.compute.api [None req-bdf09337-579f-406e-bdba-13dccca9d415 tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] [instance: 9b3b44a7-7c20-473c-841c-318e471fc6cd] Fetching instance by UUID {{(pid=116064) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 13:04:22.470152 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-bdf09337-579f-406e-bdba-13dccca9d415 tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 13:04:22.471064 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-bdf09337-579f-406e-bdba-13dccca9d415 tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 13:04:22.472267 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-bdf09337-579f-406e-bdba-13dccca9d415 tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 13:04:22.472917 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-bdf09337-579f-406e-bdba-13dccca9d415 tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 13:04:22.563840 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.api.openstack.wsgi [None req-d072940c-0e1e-4493-adbd-6eff2d947680 tempest-TestMinimumBasicScenario-84513626 tempest-TestMinimumBasicScenario-84513626-project] Calling method '>' {{(pid=116063) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 13:04:22.564623 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.compute.api [None req-d072940c-0e1e-4493-adbd-6eff2d947680 tempest-TestMinimumBasicScenario-84513626 tempest-TestMinimumBasicScenario-84513626-project] [instance: dd367814-45bc-4808-b2de-d54f79eb7933] Fetching instance by UUID {{(pid=116063) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 13:04:22.574872 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-d072940c-0e1e-4493-adbd-6eff2d947680 tempest-TestMinimumBasicScenario-84513626 tempest-TestMinimumBasicScenario-84513626-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 13:04:22.579224 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-d072940c-0e1e-4493-adbd-6eff2d947680 tempest-TestMinimumBasicScenario-84513626 tempest-TestMinimumBasicScenario-84513626-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 13:04:22.580108 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-d072940c-0e1e-4493-adbd-6eff2d947680 tempest-TestMinimumBasicScenario-84513626 tempest-TestMinimumBasicScenario-84513626-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 13:04:22.580604 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-d072940c-0e1e-4493-adbd-6eff2d947680 tempest-TestMinimumBasicScenario-84513626 tempest-TestMinimumBasicScenario-84513626-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 13:04:22.639651 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.policy [None req-bdf09337-579f-406e-bdba-13dccca9d415 tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79d74a2ea1e541d28d085c15cec34032', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68a8770b8dbe489a8119016fbee64eb5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116064) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 13:04:22.648077 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.policy [None req-bdf09337-579f-406e-bdba-13dccca9d415 tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '79d74a2ea1e541d28d085c15cec34032', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68a8770b8dbe489a8119016fbee64eb5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116064) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 13:04:22.649683 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.policy [None req-bdf09337-579f-406e-bdba-13dccca9d415 tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '79d74a2ea1e541d28d085c15cec34032', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68a8770b8dbe489a8119016fbee64eb5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116064) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 13:04:22.650959 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: INFO nova.api.openstack.requestlog [None req-bdf09337-579f-406e-bdba-13dccca9d415 tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] 10.222.0.49 "GET /compute/v2.1/servers/9b3b44a7-7c20-473c-841c-318e471fc6cd" status: 200 len: 1729 microversion: 2.20 time: 0.198130 Dec 14 13:04:22.662049 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: [pid: 116064|app: 0|req: 443/906] 10.222.0.49 () {60 vars in 1276 bytes} [Tue Dec 14 13:04:22 2021] GET /compute/v2.1/servers/9b3b44a7-7c20-473c-841c-318e471fc6cd => generated 1729 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 14 13:04:22.746715 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.policy [None req-d072940c-0e1e-4493-adbd-6eff2d947680 tempest-TestMinimumBasicScenario-84513626 tempest-TestMinimumBasicScenario-84513626-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edf65e37b42d40b28c4e90bd92987016', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bcb503e37b2449484c788574e4c88f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116063) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 13:04:22.756235 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: INFO nova.api.openstack.requestlog [None req-d072940c-0e1e-4493-adbd-6eff2d947680 tempest-TestMinimumBasicScenario-84513626 tempest-TestMinimumBasicScenario-84513626-project] 10.222.0.49 "GET /compute/v2.1/servers/dd367814-45bc-4808-b2de-d54f79eb7933" status: 200 len: 1756 microversion: 2.1 time: 0.196485 Dec 14 13:04:22.757441 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: [pid: 116063|app: 0|req: 464/907] 10.222.0.49 () {58 vars in 1235 bytes} [Tue Dec 14 13:04:22 2021] GET /compute/v2.1/servers/dd367814-45bc-4808-b2de-d54f79eb7933 => generated 1756 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 14 13:04:23.671358 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.api.openstack.wsgi [None req-c838f4f5-c205-4827-9391-3f4481e76eef tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] Calling method '>' {{(pid=116064) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 13:04:23.672207 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.compute.api [None req-c838f4f5-c205-4827-9391-3f4481e76eef tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] [instance: 9b3b44a7-7c20-473c-841c-318e471fc6cd] Fetching instance by UUID {{(pid=116064) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 13:04:23.679454 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-c838f4f5-c205-4827-9391-3f4481e76eef tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 13:04:23.680024 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-c838f4f5-c205-4827-9391-3f4481e76eef tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 13:04:23.680828 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-c838f4f5-c205-4827-9391-3f4481e76eef tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 13:04:23.681217 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-c838f4f5-c205-4827-9391-3f4481e76eef tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 13:04:23.773617 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.api.openstack.wsgi [None req-d20f1327-a919-4e2f-bc08-f08abfb16908 tempest-TestMinimumBasicScenario-84513626 tempest-TestMinimumBasicScenario-84513626-project] Calling method '>' {{(pid=116063) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 13:04:23.774799 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.compute.api [None req-d20f1327-a919-4e2f-bc08-f08abfb16908 tempest-TestMinimumBasicScenario-84513626 tempest-TestMinimumBasicScenario-84513626-project] [instance: dd367814-45bc-4808-b2de-d54f79eb7933] Fetching instance by UUID {{(pid=116063) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 13:04:23.781391 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-d20f1327-a919-4e2f-bc08-f08abfb16908 tempest-TestMinimumBasicScenario-84513626 tempest-TestMinimumBasicScenario-84513626-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 13:04:23.781830 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-d20f1327-a919-4e2f-bc08-f08abfb16908 tempest-TestMinimumBasicScenario-84513626 tempest-TestMinimumBasicScenario-84513626-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 13:04:23.782602 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-d20f1327-a919-4e2f-bc08-f08abfb16908 tempest-TestMinimumBasicScenario-84513626 tempest-TestMinimumBasicScenario-84513626-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 13:04:23.783026 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-d20f1327-a919-4e2f-bc08-f08abfb16908 tempest-TestMinimumBasicScenario-84513626 tempest-TestMinimumBasicScenario-84513626-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 13:04:23.814507 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.policy [None req-c838f4f5-c205-4827-9391-3f4481e76eef tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79d74a2ea1e541d28d085c15cec34032', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68a8770b8dbe489a8119016fbee64eb5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116064) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 13:04:23.825677 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.policy [None req-c838f4f5-c205-4827-9391-3f4481e76eef tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '79d74a2ea1e541d28d085c15cec34032', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68a8770b8dbe489a8119016fbee64eb5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116064) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 13:04:23.827432 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.policy [None req-c838f4f5-c205-4827-9391-3f4481e76eef tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '79d74a2ea1e541d28d085c15cec34032', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68a8770b8dbe489a8119016fbee64eb5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116064) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 13:04:23.828809 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: INFO nova.api.openstack.requestlog [None req-c838f4f5-c205-4827-9391-3f4481e76eef tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] 10.222.0.49 "GET /compute/v2.1/servers/9b3b44a7-7c20-473c-841c-318e471fc6cd" status: 200 len: 1729 microversion: 2.20 time: 0.162313 Dec 14 13:04:23.840515 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: [pid: 116064|app: 0|req: 444/908] 10.222.0.49 () {60 vars in 1276 bytes} [Tue Dec 14 13:04:23 2021] GET /compute/v2.1/servers/9b3b44a7-7c20-473c-841c-318e471fc6cd => generated 1729 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 14 13:04:23.942860 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.policy [None req-d20f1327-a919-4e2f-bc08-f08abfb16908 tempest-TestMinimumBasicScenario-84513626 tempest-TestMinimumBasicScenario-84513626-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edf65e37b42d40b28c4e90bd92987016', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bcb503e37b2449484c788574e4c88f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116063) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 13:04:23.952200 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: INFO nova.api.openstack.requestlog [None req-d20f1327-a919-4e2f-bc08-f08abfb16908 tempest-TestMinimumBasicScenario-84513626 tempest-TestMinimumBasicScenario-84513626-project] 10.222.0.49 "GET /compute/v2.1/servers/dd367814-45bc-4808-b2de-d54f79eb7933" status: 200 len: 1756 microversion: 2.1 time: 0.181982 Dec 14 13:04:23.953292 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: [pid: 116063|app: 0|req: 465/909] 10.222.0.49 () {58 vars in 1235 bytes} [Tue Dec 14 13:04:23 2021] GET /compute/v2.1/servers/dd367814-45bc-4808-b2de-d54f79eb7933 => generated 1756 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 14 13:04:24.848680 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.api.openstack.wsgi [None req-9ace1226-03c7-4437-852a-729569ddd7ae tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] Calling method '>' {{(pid=116064) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 13:04:24.849293 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.compute.api [None req-9ace1226-03c7-4437-852a-729569ddd7ae tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] [instance: 9b3b44a7-7c20-473c-841c-318e471fc6cd] Fetching instance by UUID {{(pid=116064) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 13:04:24.856114 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-9ace1226-03c7-4437-852a-729569ddd7ae tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 13:04:24.856570 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-9ace1226-03c7-4437-852a-729569ddd7ae tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 13:04:24.857392 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-9ace1226-03c7-4437-852a-729569ddd7ae tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 13:04:24.857810 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-9ace1226-03c7-4437-852a-729569ddd7ae tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 13:04:24.970417 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.api.openstack.wsgi [None req-21f415b5-76b8-4df5-8374-085476f0ef28 tempest-TestMinimumBasicScenario-84513626 tempest-TestMinimumBasicScenario-84513626-project] Calling method '>' {{(pid=116063) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 13:04:24.971030 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.compute.api [None req-21f415b5-76b8-4df5-8374-085476f0ef28 tempest-TestMinimumBasicScenario-84513626 tempest-TestMinimumBasicScenario-84513626-project] [instance: dd367814-45bc-4808-b2de-d54f79eb7933] Fetching instance by UUID {{(pid=116063) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 13:04:24.977596 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-21f415b5-76b8-4df5-8374-085476f0ef28 tempest-TestMinimumBasicScenario-84513626 tempest-TestMinimumBasicScenario-84513626-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 13:04:24.978040 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-21f415b5-76b8-4df5-8374-085476f0ef28 tempest-TestMinimumBasicScenario-84513626 tempest-TestMinimumBasicScenario-84513626-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 13:04:24.978820 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-21f415b5-76b8-4df5-8374-085476f0ef28 tempest-TestMinimumBasicScenario-84513626 tempest-TestMinimumBasicScenario-84513626-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 13:04:24.979248 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-21f415b5-76b8-4df5-8374-085476f0ef28 tempest-TestMinimumBasicScenario-84513626 tempest-TestMinimumBasicScenario-84513626-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 13:04:25.003271 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.policy [None req-9ace1226-03c7-4437-852a-729569ddd7ae tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79d74a2ea1e541d28d085c15cec34032', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68a8770b8dbe489a8119016fbee64eb5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116064) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 13:04:25.011582 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.policy [None req-9ace1226-03c7-4437-852a-729569ddd7ae tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '79d74a2ea1e541d28d085c15cec34032', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68a8770b8dbe489a8119016fbee64eb5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116064) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 13:04:25.013185 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.policy [None req-9ace1226-03c7-4437-852a-729569ddd7ae tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '79d74a2ea1e541d28d085c15cec34032', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68a8770b8dbe489a8119016fbee64eb5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116064) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 13:04:25.014354 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: INFO nova.api.openstack.requestlog [None req-9ace1226-03c7-4437-852a-729569ddd7ae tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] 10.222.0.49 "GET /compute/v2.1/servers/9b3b44a7-7c20-473c-841c-318e471fc6cd" status: 200 len: 1729 microversion: 2.20 time: 0.170855 Dec 14 13:04:25.014891 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: [pid: 116064|app: 0|req: 445/910] 10.222.0.49 () {60 vars in 1276 bytes} [Tue Dec 14 13:04:24 2021] GET /compute/v2.1/servers/9b3b44a7-7c20-473c-841c-318e471fc6cd => generated 1729 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 14 13:04:25.141530 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.policy [None req-21f415b5-76b8-4df5-8374-085476f0ef28 tempest-TestMinimumBasicScenario-84513626 tempest-TestMinimumBasicScenario-84513626-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edf65e37b42d40b28c4e90bd92987016', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bcb503e37b2449484c788574e4c88f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116063) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 13:04:25.150952 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: INFO nova.api.openstack.requestlog [None req-21f415b5-76b8-4df5-8374-085476f0ef28 tempest-TestMinimumBasicScenario-84513626 tempest-TestMinimumBasicScenario-84513626-project] 10.222.0.49 "GET /compute/v2.1/servers/dd367814-45bc-4808-b2de-d54f79eb7933" status: 200 len: 1756 microversion: 2.1 time: 0.185432 Dec 14 13:04:25.151535 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: [pid: 116063|app: 0|req: 466/911] 10.222.0.49 () {58 vars in 1235 bytes} [Tue Dec 14 13:04:24 2021] GET /compute/v2.1/servers/dd367814-45bc-4808-b2de-d54f79eb7933 => generated 1756 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 14 13:04:26.034850 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.api.openstack.wsgi [None req-02516c20-c53c-4793-bcb8-852c5fcd3b7f tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] Calling method '>' {{(pid=116064) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 13:04:26.035426 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.compute.api [None req-02516c20-c53c-4793-bcb8-852c5fcd3b7f tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] [instance: 9b3b44a7-7c20-473c-841c-318e471fc6cd] Fetching instance by UUID {{(pid=116064) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 13:04:26.042764 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-02516c20-c53c-4793-bcb8-852c5fcd3b7f tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 13:04:26.043220 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-02516c20-c53c-4793-bcb8-852c5fcd3b7f tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 13:04:26.044018 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-02516c20-c53c-4793-bcb8-852c5fcd3b7f tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 13:04:26.044480 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-02516c20-c53c-4793-bcb8-852c5fcd3b7f tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 13:04:26.167695 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.api.openstack.wsgi [None req-84541270-209b-4461-a06e-8475da4cc3fb tempest-TestMinimumBasicScenario-84513626 tempest-TestMinimumBasicScenario-84513626-project] Calling method '>' {{(pid=116063) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 13:04:26.169173 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.compute.api [None req-84541270-209b-4461-a06e-8475da4cc3fb tempest-TestMinimumBasicScenario-84513626 tempest-TestMinimumBasicScenario-84513626-project] [instance: dd367814-45bc-4808-b2de-d54f79eb7933] Fetching instance by UUID {{(pid=116063) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 13:04:26.175472 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-84541270-209b-4461-a06e-8475da4cc3fb tempest-TestMinimumBasicScenario-84513626 tempest-TestMinimumBasicScenario-84513626-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 13:04:26.175917 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-84541270-209b-4461-a06e-8475da4cc3fb tempest-TestMinimumBasicScenario-84513626 tempest-TestMinimumBasicScenario-84513626-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 13:04:26.177451 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-84541270-209b-4461-a06e-8475da4cc3fb tempest-TestMinimumBasicScenario-84513626 tempest-TestMinimumBasicScenario-84513626-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 13:04:26.177778 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.policy [None req-02516c20-c53c-4793-bcb8-852c5fcd3b7f tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79d74a2ea1e541d28d085c15cec34032', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68a8770b8dbe489a8119016fbee64eb5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116064) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 13:04:26.178070 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-84541270-209b-4461-a06e-8475da4cc3fb tempest-TestMinimumBasicScenario-84513626 tempest-TestMinimumBasicScenario-84513626-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 13:04:26.186194 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.policy [None req-02516c20-c53c-4793-bcb8-852c5fcd3b7f tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '79d74a2ea1e541d28d085c15cec34032', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68a8770b8dbe489a8119016fbee64eb5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116064) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 13:04:26.187689 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.policy [None req-02516c20-c53c-4793-bcb8-852c5fcd3b7f tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '79d74a2ea1e541d28d085c15cec34032', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68a8770b8dbe489a8119016fbee64eb5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116064) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 13:04:26.188840 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: INFO nova.api.openstack.requestlog [None req-02516c20-c53c-4793-bcb8-852c5fcd3b7f tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] 10.222.0.49 "GET /compute/v2.1/servers/9b3b44a7-7c20-473c-841c-318e471fc6cd" status: 200 len: 1729 microversion: 2.20 time: 0.157980 Dec 14 13:04:26.189497 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: [pid: 116064|app: 0|req: 446/912] 10.222.0.49 () {60 vars in 1276 bytes} [Tue Dec 14 13:04:26 2021] GET /compute/v2.1/servers/9b3b44a7-7c20-473c-841c-318e471fc6cd => generated 1729 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 14 13:04:26.325070 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.policy [None req-84541270-209b-4461-a06e-8475da4cc3fb tempest-TestMinimumBasicScenario-84513626 tempest-TestMinimumBasicScenario-84513626-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edf65e37b42d40b28c4e90bd92987016', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bcb503e37b2449484c788574e4c88f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116063) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 13:04:26.338198 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: INFO nova.api.openstack.requestlog [None req-84541270-209b-4461-a06e-8475da4cc3fb tempest-TestMinimumBasicScenario-84513626 tempest-TestMinimumBasicScenario-84513626-project] 10.222.0.49 "GET /compute/v2.1/servers/dd367814-45bc-4808-b2de-d54f79eb7933" status: 200 len: 1759 microversion: 2.1 time: 0.174125 Dec 14 13:04:26.338904 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: [pid: 116063|app: 0|req: 467/913] 10.222.0.49 () {58 vars in 1235 bytes} [Tue Dec 14 13:04:26 2021] GET /compute/v2.1/servers/dd367814-45bc-4808-b2de-d54f79eb7933 => generated 1759 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 14 13:04:27.211530 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.api.openstack.wsgi [None req-9379aaf6-3ca3-4fc0-a994-9022bcc0a74b tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] Calling method '>' {{(pid=116064) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 13:04:27.212362 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.compute.api [None req-9379aaf6-3ca3-4fc0-a994-9022bcc0a74b tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] [instance: 9b3b44a7-7c20-473c-841c-318e471fc6cd] Fetching instance by UUID {{(pid=116064) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 13:04:27.220355 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-9379aaf6-3ca3-4fc0-a994-9022bcc0a74b tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 13:04:27.220842 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-9379aaf6-3ca3-4fc0-a994-9022bcc0a74b tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 13:04:27.221714 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-9379aaf6-3ca3-4fc0-a994-9022bcc0a74b tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 13:04:27.222175 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-9379aaf6-3ca3-4fc0-a994-9022bcc0a74b tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 13:04:27.357363 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.policy [None req-9379aaf6-3ca3-4fc0-a994-9022bcc0a74b tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79d74a2ea1e541d28d085c15cec34032', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68a8770b8dbe489a8119016fbee64eb5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116064) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 13:04:27.365487 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.policy [None req-9379aaf6-3ca3-4fc0-a994-9022bcc0a74b tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '79d74a2ea1e541d28d085c15cec34032', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68a8770b8dbe489a8119016fbee64eb5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116064) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 13:04:27.367009 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.policy [None req-9379aaf6-3ca3-4fc0-a994-9022bcc0a74b tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '79d74a2ea1e541d28d085c15cec34032', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68a8770b8dbe489a8119016fbee64eb5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116064) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 13:04:27.368156 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: INFO nova.api.openstack.requestlog [None req-9379aaf6-3ca3-4fc0-a994-9022bcc0a74b tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] 10.222.0.49 "GET /compute/v2.1/servers/9b3b44a7-7c20-473c-841c-318e471fc6cd" status: 200 len: 1729 microversion: 2.20 time: 0.163160 Dec 14 13:04:27.368743 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: [pid: 116064|app: 0|req: 447/914] 10.222.0.49 () {60 vars in 1276 bytes} [Tue Dec 14 13:04:27 2021] GET /compute/v2.1/servers/9b3b44a7-7c20-473c-841c-318e471fc6cd => generated 1729 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 14 13:04:28.387171 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.api.openstack.wsgi [None req-f2be4bbd-250a-4a47-b43a-0c763e389037 tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] Calling method '>' {{(pid=116063) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 13:04:28.387739 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.compute.api [None req-f2be4bbd-250a-4a47-b43a-0c763e389037 tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] [instance: 9b3b44a7-7c20-473c-841c-318e471fc6cd] Fetching instance by UUID {{(pid=116063) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 13:04:28.394351 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-f2be4bbd-250a-4a47-b43a-0c763e389037 tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 13:04:28.394801 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-f2be4bbd-250a-4a47-b43a-0c763e389037 tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 13:04:28.395583 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-f2be4bbd-250a-4a47-b43a-0c763e389037 tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 13:04:28.396014 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-f2be4bbd-250a-4a47-b43a-0c763e389037 tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 13:04:28.534323 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.policy [None req-f2be4bbd-250a-4a47-b43a-0c763e389037 tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79d74a2ea1e541d28d085c15cec34032', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68a8770b8dbe489a8119016fbee64eb5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116063) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 13:04:28.546545 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.policy [None req-f2be4bbd-250a-4a47-b43a-0c763e389037 tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '79d74a2ea1e541d28d085c15cec34032', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68a8770b8dbe489a8119016fbee64eb5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116063) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 13:04:28.548926 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.policy [None req-f2be4bbd-250a-4a47-b43a-0c763e389037 tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '79d74a2ea1e541d28d085c15cec34032', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68a8770b8dbe489a8119016fbee64eb5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116063) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 13:04:28.550731 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: INFO nova.api.openstack.requestlog [None req-f2be4bbd-250a-4a47-b43a-0c763e389037 tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] 10.222.0.49 "GET /compute/v2.1/servers/9b3b44a7-7c20-473c-841c-318e471fc6cd" status: 200 len: 1729 microversion: 2.20 time: 0.167479 Dec 14 13:04:28.551491 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: [pid: 116063|app: 0|req: 468/915] 10.222.0.49 () {60 vars in 1276 bytes} [Tue Dec 14 13:04:28 2021] GET /compute/v2.1/servers/9b3b44a7-7c20-473c-841c-318e471fc6cd => generated 1729 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 14 13:04:29.572881 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.api.openstack.wsgi [None req-2a48a0db-6a0c-470f-b2c9-3881b308b56c tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] Calling method '>' {{(pid=116064) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 13:04:29.573731 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.compute.api [None req-2a48a0db-6a0c-470f-b2c9-3881b308b56c tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] [instance: 9b3b44a7-7c20-473c-841c-318e471fc6cd] Fetching instance by UUID {{(pid=116064) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 13:04:29.582053 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-2a48a0db-6a0c-470f-b2c9-3881b308b56c tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 13:04:29.582632 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-2a48a0db-6a0c-470f-b2c9-3881b308b56c tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 13:04:29.583634 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-2a48a0db-6a0c-470f-b2c9-3881b308b56c tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 13:04:29.584172 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-2a48a0db-6a0c-470f-b2c9-3881b308b56c tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 13:04:29.724206 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.policy [None req-2a48a0db-6a0c-470f-b2c9-3881b308b56c tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79d74a2ea1e541d28d085c15cec34032', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68a8770b8dbe489a8119016fbee64eb5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116064) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 13:04:29.732782 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.policy [None req-2a48a0db-6a0c-470f-b2c9-3881b308b56c tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '79d74a2ea1e541d28d085c15cec34032', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68a8770b8dbe489a8119016fbee64eb5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116064) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 13:04:29.734355 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.policy [None req-2a48a0db-6a0c-470f-b2c9-3881b308b56c tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '79d74a2ea1e541d28d085c15cec34032', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68a8770b8dbe489a8119016fbee64eb5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116064) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 13:04:29.735511 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: INFO nova.api.openstack.requestlog [None req-2a48a0db-6a0c-470f-b2c9-3881b308b56c tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] 10.222.0.49 "GET /compute/v2.1/servers/9b3b44a7-7c20-473c-841c-318e471fc6cd" status: 200 len: 1729 microversion: 2.20 time: 0.167444 Dec 14 13:04:29.738711 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: [pid: 116064|app: 0|req: 448/916] 10.222.0.49 () {60 vars in 1276 bytes} [Tue Dec 14 13:04:29 2021] GET /compute/v2.1/servers/9b3b44a7-7c20-473c-841c-318e471fc6cd => generated 1729 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 14 13:04:30.000304 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.api.openstack.wsgi [req-89d74597-0f52-48c6-b73c-2f535241ca01 req-07c14d37-9be2-48ab-b363-f9d3a9afe455 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9b3b44a7-7c20-473c-841c-318e471fc6cd", "name": "network-vif-plugged", "status": "completed", "tag": "0ed44ee3-2630-4f50-9391-4bb374b76e1d"}]} {{(pid=116063) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 14 13:04:30.001860 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 14 13:04:30.001860 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: warnings.warn(msg) Dec 14 13:04:30.010092 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [req-89d74597-0f52-48c6-b73c-2f535241ca01 req-07c14d37-9be2-48ab-b363-f9d3a9afe455 service nova] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 13:04:30.010534 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [req-89d74597-0f52-48c6-b73c-2f535241ca01 req-07c14d37-9be2-48ab-b363-f9d3a9afe455 service nova] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 13:04:30.022511 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: INFO nova.api.openstack.compute.server_external_events [req-89d74597-0f52-48c6-b73c-2f535241ca01 req-07c14d37-9be2-48ab-b363-f9d3a9afe455 service nova] Creating event network-vif-plugged:0ed44ee3-2630-4f50-9391-4bb374b76e1d for instance 9b3b44a7-7c20-473c-841c-318e471fc6cd on hv-cinder-78447 Dec 14 13:04:30.027751 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: INFO nova.api.openstack.requestlog [req-89d74597-0f52-48c6-b73c-2f535241ca01 req-07c14d37-9be2-48ab-b363-f9d3a9afe455 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031067 Dec 14 13:04:30.028328 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: [pid: 116063|app: 0|req: 469/917] 10.222.0.49 () {64 vars in 1317 bytes} [Tue Dec 14 13:04:29 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 14 13:04:30.757803 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.api.openstack.wsgi [None req-a839278f-ada7-40ac-9f31-676b20b3f771 tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] Calling method '>' {{(pid=116064) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 13:04:30.758673 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.compute.api [None req-a839278f-ada7-40ac-9f31-676b20b3f771 tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] [instance: 9b3b44a7-7c20-473c-841c-318e471fc6cd] Fetching instance by UUID {{(pid=116064) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 13:04:30.769396 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-a839278f-ada7-40ac-9f31-676b20b3f771 tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 13:04:30.770146 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-a839278f-ada7-40ac-9f31-676b20b3f771 tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 13:04:30.771434 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-a839278f-ada7-40ac-9f31-676b20b3f771 tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 13:04:30.772196 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-a839278f-ada7-40ac-9f31-676b20b3f771 tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 13:04:30.911902 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.policy [None req-a839278f-ada7-40ac-9f31-676b20b3f771 tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79d74a2ea1e541d28d085c15cec34032', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68a8770b8dbe489a8119016fbee64eb5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116064) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 13:04:30.920695 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.policy [None req-a839278f-ada7-40ac-9f31-676b20b3f771 tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '79d74a2ea1e541d28d085c15cec34032', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68a8770b8dbe489a8119016fbee64eb5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116064) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 13:04:30.922234 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.policy [None req-a839278f-ada7-40ac-9f31-676b20b3f771 tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '79d74a2ea1e541d28d085c15cec34032', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68a8770b8dbe489a8119016fbee64eb5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116064) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 13:04:30.923396 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: INFO nova.api.openstack.requestlog [None req-a839278f-ada7-40ac-9f31-676b20b3f771 tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] 10.222.0.49 "GET /compute/v2.1/servers/9b3b44a7-7c20-473c-841c-318e471fc6cd" status: 200 len: 1729 microversion: 2.20 time: 0.172036 Dec 14 13:04:30.923959 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: [pid: 116064|app: 0|req: 449/918] 10.222.0.49 () {60 vars in 1276 bytes} [Tue Dec 14 13:04:30 2021] GET /compute/v2.1/servers/9b3b44a7-7c20-473c-841c-318e471fc6cd => generated 1729 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 14 13:04:31.946537 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.api.openstack.wsgi [None req-413a2828-67ae-4ad6-a7db-cde15eaae36c tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] Calling method '>' {{(pid=116063) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 13:04:31.947939 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.compute.api [None req-413a2828-67ae-4ad6-a7db-cde15eaae36c tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] [instance: 9b3b44a7-7c20-473c-841c-318e471fc6cd] Fetching instance by UUID {{(pid=116063) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 13:04:31.955064 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-413a2828-67ae-4ad6-a7db-cde15eaae36c tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 13:04:31.955555 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-413a2828-67ae-4ad6-a7db-cde15eaae36c tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 13:04:31.956420 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-413a2828-67ae-4ad6-a7db-cde15eaae36c tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 13:04:31.956946 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-413a2828-67ae-4ad6-a7db-cde15eaae36c tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 13:04:32.091775 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.policy [None req-413a2828-67ae-4ad6-a7db-cde15eaae36c tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79d74a2ea1e541d28d085c15cec34032', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68a8770b8dbe489a8119016fbee64eb5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116063) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 13:04:32.100087 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.policy [None req-413a2828-67ae-4ad6-a7db-cde15eaae36c tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '79d74a2ea1e541d28d085c15cec34032', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68a8770b8dbe489a8119016fbee64eb5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116063) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 13:04:32.101734 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.policy [None req-413a2828-67ae-4ad6-a7db-cde15eaae36c tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '79d74a2ea1e541d28d085c15cec34032', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68a8770b8dbe489a8119016fbee64eb5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116063) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 13:04:32.102898 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: INFO nova.api.openstack.requestlog [None req-413a2828-67ae-4ad6-a7db-cde15eaae36c tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] 10.222.0.49 "GET /compute/v2.1/servers/9b3b44a7-7c20-473c-841c-318e471fc6cd" status: 200 len: 1729 microversion: 2.20 time: 0.161063 Dec 14 13:04:32.103440 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: [pid: 116063|app: 0|req: 470/919] 10.222.0.49 () {60 vars in 1276 bytes} [Tue Dec 14 13:04:31 2021] GET /compute/v2.1/servers/9b3b44a7-7c20-473c-841c-318e471fc6cd => generated 1729 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 14 13:04:33.125312 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.api.openstack.wsgi [None req-61a5b900-5a2e-4d8d-aca5-37e8f01e0381 tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] Calling method '>' {{(pid=116064) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 13:04:33.126274 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.compute.api [None req-61a5b900-5a2e-4d8d-aca5-37e8f01e0381 tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] [instance: 9b3b44a7-7c20-473c-841c-318e471fc6cd] Fetching instance by UUID {{(pid=116064) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 13:04:33.137044 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-61a5b900-5a2e-4d8d-aca5-37e8f01e0381 tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 13:04:33.137841 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-61a5b900-5a2e-4d8d-aca5-37e8f01e0381 tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 13:04:33.139121 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-61a5b900-5a2e-4d8d-aca5-37e8f01e0381 tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 13:04:33.139839 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-61a5b900-5a2e-4d8d-aca5-37e8f01e0381 tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 13:04:33.282079 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.policy [None req-61a5b900-5a2e-4d8d-aca5-37e8f01e0381 tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79d74a2ea1e541d28d085c15cec34032', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68a8770b8dbe489a8119016fbee64eb5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116064) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 13:04:33.289946 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.policy [None req-61a5b900-5a2e-4d8d-aca5-37e8f01e0381 tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '79d74a2ea1e541d28d085c15cec34032', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68a8770b8dbe489a8119016fbee64eb5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116064) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 13:04:33.291453 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.policy [None req-61a5b900-5a2e-4d8d-aca5-37e8f01e0381 tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '79d74a2ea1e541d28d085c15cec34032', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68a8770b8dbe489a8119016fbee64eb5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116064) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 13:04:33.293151 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: INFO nova.api.openstack.requestlog [None req-61a5b900-5a2e-4d8d-aca5-37e8f01e0381 tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] 10.222.0.49 "GET /compute/v2.1/servers/9b3b44a7-7c20-473c-841c-318e471fc6cd" status: 200 len: 1716 microversion: 2.20 time: 0.174232 Dec 14 13:04:33.293732 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: [pid: 116064|app: 0|req: 450/920] 10.222.0.49 () {60 vars in 1276 bytes} [Tue Dec 14 13:04:33 2021] GET /compute/v2.1/servers/9b3b44a7-7c20-473c-841c-318e471fc6cd => generated 1716 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 14 13:04:38.821736 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.api.openstack.wsgi [None req-5510bf36-5b7c-493a-bd6a-73f3bae79ff3 tempest-AttachVolumeTestJSON-709357402 tempest-AttachVolumeTestJSON-709357402-project] Calling method '>' {{(pid=116063) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 13:04:38.822683 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.compute.api [None req-5510bf36-5b7c-493a-bd6a-73f3bae79ff3 tempest-AttachVolumeTestJSON-709357402 tempest-AttachVolumeTestJSON-709357402-project] [instance: 1b8e1f2f-c109-4413-9d56-33ef0b651f85] Fetching instance by UUID {{(pid=116063) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 13:04:38.829843 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-5510bf36-5b7c-493a-bd6a-73f3bae79ff3 tempest-AttachVolumeTestJSON-709357402 tempest-AttachVolumeTestJSON-709357402-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 13:04:38.830338 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-5510bf36-5b7c-493a-bd6a-73f3bae79ff3 tempest-AttachVolumeTestJSON-709357402 tempest-AttachVolumeTestJSON-709357402-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 13:04:38.831196 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-5510bf36-5b7c-493a-bd6a-73f3bae79ff3 tempest-AttachVolumeTestJSON-709357402 tempest-AttachVolumeTestJSON-709357402-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 13:04:38.831668 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-5510bf36-5b7c-493a-bd6a-73f3bae79ff3 tempest-AttachVolumeTestJSON-709357402 tempest-AttachVolumeTestJSON-709357402-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 13:04:38.913766 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.objects.instance [None req-5510bf36-5b7c-493a-bd6a-73f3bae79ff3 tempest-AttachVolumeTestJSON-709357402 tempest-AttachVolumeTestJSON-709357402-project] Lazy-loading 'services' on Instance uuid 1b8e1f2f-c109-4413-9d56-33ef0b651f85 {{(pid=116063) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Dec 14 13:04:38.995487 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: INFO nova.api.openstack.requestlog [None req-5510bf36-5b7c-493a-bd6a-73f3bae79ff3 tempest-AttachVolumeTestJSON-709357402 tempest-AttachVolumeTestJSON-709357402-project] 10.222.0.49 "DELETE /compute/v2.1/servers/1b8e1f2f-c109-4413-9d56-33ef0b651f85/os-volume_attachments/27ca29c4-ea1b-4293-91bb-ffa773ee1e44" status: 202 len: 0 microversion: 2.1 time: 0.177821 Dec 14 13:04:38.996107 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: [pid: 116063|app: 0|req: 471/921] 10.222.0.49 () {58 vars in 1415 bytes} [Tue Dec 14 13:04:38 2021] DELETE /compute/v2.1/servers/1b8e1f2f-c109-4413-9d56-33ef0b651f85/os-volume_attachments/27ca29c4-ea1b-4293-91bb-ffa773ee1e44 => generated 0 bytes in 179 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Dec 14 13:04:40.114698 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.api.openstack.wsgi [None req-be235691-33b6-48e1-ae23-309607aa30c9 tempest-AttachVolumeTestJSON-709357402 tempest-AttachVolumeTestJSON-709357402-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=116064) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 14 13:04:40.121330 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-be235691-33b6-48e1-ae23-309607aa30c9 tempest-AttachVolumeTestJSON-709357402 tempest-AttachVolumeTestJSON-709357402-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 13:04:40.121777 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-be235691-33b6-48e1-ae23-309607aa30c9 tempest-AttachVolumeTestJSON-709357402 tempest-AttachVolumeTestJSON-709357402-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 13:04:40.144360 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.compute.api [None req-be235691-33b6-48e1-ae23-309607aa30c9 tempest-AttachVolumeTestJSON-709357402 tempest-AttachVolumeTestJSON-709357402-project] [instance: 1b8e1f2f-c109-4413-9d56-33ef0b651f85] Going to try to stop instance {{(pid=116064) force_stop /opt/stack/nova/nova/compute/api.py:2654}} Dec 14 13:04:40.190635 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: INFO nova.api.openstack.requestlog [None req-be235691-33b6-48e1-ae23-309607aa30c9 tempest-AttachVolumeTestJSON-709357402 tempest-AttachVolumeTestJSON-709357402-project] 10.222.0.49 "POST /compute/v2.1/servers/1b8e1f2f-c109-4413-9d56-33ef0b651f85/action" status: 202 len: 0 microversion: 2.1 time: 0.079664 Dec 14 13:04:40.191482 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: [pid: 116064|app: 0|req: 451/922] 10.222.0.49 () {60 vars in 1277 bytes} [Tue Dec 14 13:04:40 2021] POST /compute/v2.1/servers/1b8e1f2f-c109-4413-9d56-33ef0b651f85/action => generated 0 bytes in 81 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Dec 14 13:04:40.201720 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.api.openstack.wsgi [None req-0a61a5b9-4183-42f0-85c8-89cfe330f05d tempest-AttachVolumeTestJSON-709357402 tempest-AttachVolumeTestJSON-709357402-project] Calling method '>' {{(pid=116063) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 13:04:40.202430 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.compute.api [None req-0a61a5b9-4183-42f0-85c8-89cfe330f05d tempest-AttachVolumeTestJSON-709357402 tempest-AttachVolumeTestJSON-709357402-project] [instance: 1b8e1f2f-c109-4413-9d56-33ef0b651f85] Fetching instance by UUID {{(pid=116063) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 13:04:40.209052 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-0a61a5b9-4183-42f0-85c8-89cfe330f05d tempest-AttachVolumeTestJSON-709357402 tempest-AttachVolumeTestJSON-709357402-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 13:04:40.209485 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-0a61a5b9-4183-42f0-85c8-89cfe330f05d tempest-AttachVolumeTestJSON-709357402 tempest-AttachVolumeTestJSON-709357402-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 13:04:40.210257 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-0a61a5b9-4183-42f0-85c8-89cfe330f05d tempest-AttachVolumeTestJSON-709357402 tempest-AttachVolumeTestJSON-709357402-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 13:04:40.210690 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-0a61a5b9-4183-42f0-85c8-89cfe330f05d tempest-AttachVolumeTestJSON-709357402 tempest-AttachVolumeTestJSON-709357402-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 13:04:40.349433 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.policy [None req-0a61a5b9-4183-42f0-85c8-89cfe330f05d tempest-AttachVolumeTestJSON-709357402 tempest-AttachVolumeTestJSON-709357402-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '083128ec42474a3e82a2b0fc8c278f4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b1a390d20a54f4d9529d286ab7764a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116063) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 13:04:40.357422 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: INFO nova.api.openstack.requestlog [None req-0a61a5b9-4183-42f0-85c8-89cfe330f05d tempest-AttachVolumeTestJSON-709357402 tempest-AttachVolumeTestJSON-709357402-project] 10.222.0.49 "GET /compute/v2.1/servers/1b8e1f2f-c109-4413-9d56-33ef0b651f85" status: 200 len: 1677 microversion: 2.1 time: 0.160254 Dec 14 13:04:40.357999 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: [pid: 116063|app: 0|req: 472/923] 10.222.0.49 () {58 vars in 1235 bytes} [Tue Dec 14 13:04:40 2021] GET /compute/v2.1/servers/1b8e1f2f-c109-4413-9d56-33ef0b651f85 => generated 1677 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 14 13:04:41.379647 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.api.openstack.wsgi [None req-cfe1e003-bbe3-46c1-bada-bf69b9c9a7fb tempest-AttachVolumeTestJSON-709357402 tempest-AttachVolumeTestJSON-709357402-project] Calling method '>' {{(pid=116064) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 13:04:41.380833 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.compute.api [None req-cfe1e003-bbe3-46c1-bada-bf69b9c9a7fb tempest-AttachVolumeTestJSON-709357402 tempest-AttachVolumeTestJSON-709357402-project] [instance: 1b8e1f2f-c109-4413-9d56-33ef0b651f85] Fetching instance by UUID {{(pid=116064) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 13:04:41.391164 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-cfe1e003-bbe3-46c1-bada-bf69b9c9a7fb tempest-AttachVolumeTestJSON-709357402 tempest-AttachVolumeTestJSON-709357402-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 13:04:41.391905 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-cfe1e003-bbe3-46c1-bada-bf69b9c9a7fb tempest-AttachVolumeTestJSON-709357402 tempest-AttachVolumeTestJSON-709357402-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 13:04:41.393233 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-cfe1e003-bbe3-46c1-bada-bf69b9c9a7fb tempest-AttachVolumeTestJSON-709357402 tempest-AttachVolumeTestJSON-709357402-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 13:04:41.393995 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-cfe1e003-bbe3-46c1-bada-bf69b9c9a7fb tempest-AttachVolumeTestJSON-709357402 tempest-AttachVolumeTestJSON-709357402-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 13:04:41.530818 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.policy [None req-cfe1e003-bbe3-46c1-bada-bf69b9c9a7fb tempest-AttachVolumeTestJSON-709357402 tempest-AttachVolumeTestJSON-709357402-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '083128ec42474a3e82a2b0fc8c278f4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b1a390d20a54f4d9529d286ab7764a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116064) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 13:04:41.538409 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: INFO nova.api.openstack.requestlog [None req-cfe1e003-bbe3-46c1-bada-bf69b9c9a7fb tempest-AttachVolumeTestJSON-709357402 tempest-AttachVolumeTestJSON-709357402-project] 10.222.0.49 "GET /compute/v2.1/servers/1b8e1f2f-c109-4413-9d56-33ef0b651f85" status: 200 len: 1677 microversion: 2.1 time: 0.165692 Dec 14 13:04:41.538957 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: [pid: 116064|app: 0|req: 452/924] 10.222.0.49 () {58 vars in 1235 bytes} [Tue Dec 14 13:04:41 2021] GET /compute/v2.1/servers/1b8e1f2f-c109-4413-9d56-33ef0b651f85 => generated 1677 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 14 13:04:42.559709 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.api.openstack.wsgi [None req-792196aa-0782-4a6d-9a35-f885e54c2ee3 tempest-AttachVolumeTestJSON-709357402 tempest-AttachVolumeTestJSON-709357402-project] Calling method '>' {{(pid=116063) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 13:04:42.560648 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.compute.api [None req-792196aa-0782-4a6d-9a35-f885e54c2ee3 tempest-AttachVolumeTestJSON-709357402 tempest-AttachVolumeTestJSON-709357402-project] [instance: 1b8e1f2f-c109-4413-9d56-33ef0b651f85] Fetching instance by UUID {{(pid=116063) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 13:04:42.569059 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-792196aa-0782-4a6d-9a35-f885e54c2ee3 tempest-AttachVolumeTestJSON-709357402 tempest-AttachVolumeTestJSON-709357402-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 13:04:42.569501 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-792196aa-0782-4a6d-9a35-f885e54c2ee3 tempest-AttachVolumeTestJSON-709357402 tempest-AttachVolumeTestJSON-709357402-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 13:04:42.570266 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-792196aa-0782-4a6d-9a35-f885e54c2ee3 tempest-AttachVolumeTestJSON-709357402 tempest-AttachVolumeTestJSON-709357402-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 13:04:42.570694 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-792196aa-0782-4a6d-9a35-f885e54c2ee3 tempest-AttachVolumeTestJSON-709357402 tempest-AttachVolumeTestJSON-709357402-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 13:04:42.929283 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.policy [None req-792196aa-0782-4a6d-9a35-f885e54c2ee3 tempest-AttachVolumeTestJSON-709357402 tempest-AttachVolumeTestJSON-709357402-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '083128ec42474a3e82a2b0fc8c278f4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b1a390d20a54f4d9529d286ab7764a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116063) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 13:04:42.940655 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: INFO nova.api.openstack.requestlog [None req-792196aa-0782-4a6d-9a35-f885e54c2ee3 tempest-AttachVolumeTestJSON-709357402 tempest-AttachVolumeTestJSON-709357402-project] 10.222.0.49 "GET /compute/v2.1/servers/1b8e1f2f-c109-4413-9d56-33ef0b651f85" status: 200 len: 1677 microversion: 2.1 time: 0.387113 Dec 14 13:04:42.941233 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: [pid: 116063|app: 0|req: 473/925] 10.222.0.49 () {58 vars in 1235 bytes} [Tue Dec 14 13:04:42 2021] GET /compute/v2.1/servers/1b8e1f2f-c109-4413-9d56-33ef0b651f85 => generated 1677 bytes in 389 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 14 13:04:43.962336 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.api.openstack.wsgi [None req-fec2c2bc-51ab-464a-acfc-e414a73f1596 tempest-AttachVolumeTestJSON-709357402 tempest-AttachVolumeTestJSON-709357402-project] Calling method '>' {{(pid=116064) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 13:04:43.963338 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.compute.api [None req-fec2c2bc-51ab-464a-acfc-e414a73f1596 tempest-AttachVolumeTestJSON-709357402 tempest-AttachVolumeTestJSON-709357402-project] [instance: 1b8e1f2f-c109-4413-9d56-33ef0b651f85] Fetching instance by UUID {{(pid=116064) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 13:04:43.973885 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-fec2c2bc-51ab-464a-acfc-e414a73f1596 tempest-AttachVolumeTestJSON-709357402 tempest-AttachVolumeTestJSON-709357402-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 13:04:43.974661 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-fec2c2bc-51ab-464a-acfc-e414a73f1596 tempest-AttachVolumeTestJSON-709357402 tempest-AttachVolumeTestJSON-709357402-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 13:04:43.975941 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-fec2c2bc-51ab-464a-acfc-e414a73f1596 tempest-AttachVolumeTestJSON-709357402 tempest-AttachVolumeTestJSON-709357402-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 13:04:43.976660 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-fec2c2bc-51ab-464a-acfc-e414a73f1596 tempest-AttachVolumeTestJSON-709357402 tempest-AttachVolumeTestJSON-709357402-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 13:04:44.113515 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.policy [None req-fec2c2bc-51ab-464a-acfc-e414a73f1596 tempest-AttachVolumeTestJSON-709357402 tempest-AttachVolumeTestJSON-709357402-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '083128ec42474a3e82a2b0fc8c278f4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b1a390d20a54f4d9529d286ab7764a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116064) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 13:04:44.120999 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: INFO nova.api.openstack.requestlog [None req-fec2c2bc-51ab-464a-acfc-e414a73f1596 tempest-AttachVolumeTestJSON-709357402 tempest-AttachVolumeTestJSON-709357402-project] 10.222.0.49 "GET /compute/v2.1/servers/1b8e1f2f-c109-4413-9d56-33ef0b651f85" status: 200 len: 1677 microversion: 2.1 time: 0.165109 Dec 14 13:04:44.121569 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: [pid: 116064|app: 0|req: 453/926] 10.222.0.49 () {58 vars in 1235 bytes} [Tue Dec 14 13:04:43 2021] GET /compute/v2.1/servers/1b8e1f2f-c109-4413-9d56-33ef0b651f85 => generated 1677 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 14 13:04:45.142647 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.api.openstack.wsgi [None req-148c29a4-59d6-408f-be73-9b30aa739bcf tempest-AttachVolumeTestJSON-709357402 tempest-AttachVolumeTestJSON-709357402-project] Calling method '>' {{(pid=116063) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 13:04:45.143546 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.compute.api [None req-148c29a4-59d6-408f-be73-9b30aa739bcf tempest-AttachVolumeTestJSON-709357402 tempest-AttachVolumeTestJSON-709357402-project] [instance: 1b8e1f2f-c109-4413-9d56-33ef0b651f85] Fetching instance by UUID {{(pid=116063) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 13:04:45.153628 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-148c29a4-59d6-408f-be73-9b30aa739bcf tempest-AttachVolumeTestJSON-709357402 tempest-AttachVolumeTestJSON-709357402-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 13:04:45.154337 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-148c29a4-59d6-408f-be73-9b30aa739bcf tempest-AttachVolumeTestJSON-709357402 tempest-AttachVolumeTestJSON-709357402-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 13:04:45.155626 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-148c29a4-59d6-408f-be73-9b30aa739bcf tempest-AttachVolumeTestJSON-709357402 tempest-AttachVolumeTestJSON-709357402-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 13:04:45.156340 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-148c29a4-59d6-408f-be73-9b30aa739bcf tempest-AttachVolumeTestJSON-709357402 tempest-AttachVolumeTestJSON-709357402-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 13:04:45.295593 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.policy [None req-148c29a4-59d6-408f-be73-9b30aa739bcf tempest-AttachVolumeTestJSON-709357402 tempest-AttachVolumeTestJSON-709357402-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '083128ec42474a3e82a2b0fc8c278f4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b1a390d20a54f4d9529d286ab7764a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116063) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 13:04:45.303954 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: INFO nova.api.openstack.requestlog [None req-148c29a4-59d6-408f-be73-9b30aa739bcf tempest-AttachVolumeTestJSON-709357402 tempest-AttachVolumeTestJSON-709357402-project] 10.222.0.49 "GET /compute/v2.1/servers/1b8e1f2f-c109-4413-9d56-33ef0b651f85" status: 200 len: 1677 microversion: 2.1 time: 0.168067 Dec 14 13:04:45.304515 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: [pid: 116063|app: 0|req: 474/927] 10.222.0.49 () {58 vars in 1235 bytes} [Tue Dec 14 13:04:45 2021] GET /compute/v2.1/servers/1b8e1f2f-c109-4413-9d56-33ef0b651f85 => generated 1677 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 14 13:04:46.325464 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.api.openstack.wsgi [None req-1a5613dd-4069-468b-a5dc-6f518f7f0659 tempest-AttachVolumeTestJSON-709357402 tempest-AttachVolumeTestJSON-709357402-project] Calling method '>' {{(pid=116064) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 13:04:46.326462 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.compute.api [None req-1a5613dd-4069-468b-a5dc-6f518f7f0659 tempest-AttachVolumeTestJSON-709357402 tempest-AttachVolumeTestJSON-709357402-project] [instance: 1b8e1f2f-c109-4413-9d56-33ef0b651f85] Fetching instance by UUID {{(pid=116064) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 13:04:46.337116 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-1a5613dd-4069-468b-a5dc-6f518f7f0659 tempest-AttachVolumeTestJSON-709357402 tempest-AttachVolumeTestJSON-709357402-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 13:04:46.337863 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-1a5613dd-4069-468b-a5dc-6f518f7f0659 tempest-AttachVolumeTestJSON-709357402 tempest-AttachVolumeTestJSON-709357402-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 13:04:46.339142 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-1a5613dd-4069-468b-a5dc-6f518f7f0659 tempest-AttachVolumeTestJSON-709357402 tempest-AttachVolumeTestJSON-709357402-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 13:04:46.339863 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-1a5613dd-4069-468b-a5dc-6f518f7f0659 tempest-AttachVolumeTestJSON-709357402 tempest-AttachVolumeTestJSON-709357402-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 13:04:46.482224 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.policy [None req-1a5613dd-4069-468b-a5dc-6f518f7f0659 tempest-AttachVolumeTestJSON-709357402 tempest-AttachVolumeTestJSON-709357402-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '083128ec42474a3e82a2b0fc8c278f4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b1a390d20a54f4d9529d286ab7764a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116064) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 13:04:46.489909 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: INFO nova.api.openstack.requestlog [None req-1a5613dd-4069-468b-a5dc-6f518f7f0659 tempest-AttachVolumeTestJSON-709357402 tempest-AttachVolumeTestJSON-709357402-project] 10.222.0.49 "GET /compute/v2.1/servers/1b8e1f2f-c109-4413-9d56-33ef0b651f85" status: 200 len: 1677 microversion: 2.1 time: 0.170749 Dec 14 13:04:46.490446 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: [pid: 116064|app: 0|req: 454/928] 10.222.0.49 () {58 vars in 1235 bytes} [Tue Dec 14 13:04:46 2021] GET /compute/v2.1/servers/1b8e1f2f-c109-4413-9d56-33ef0b651f85 => generated 1677 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 14 13:04:47.510990 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.api.openstack.wsgi [None req-45a19095-7465-4602-8e52-977ac3f3669a tempest-AttachVolumeTestJSON-709357402 tempest-AttachVolumeTestJSON-709357402-project] Calling method '>' {{(pid=116063) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 13:04:47.512004 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.compute.api [None req-45a19095-7465-4602-8e52-977ac3f3669a tempest-AttachVolumeTestJSON-709357402 tempest-AttachVolumeTestJSON-709357402-project] [instance: 1b8e1f2f-c109-4413-9d56-33ef0b651f85] Fetching instance by UUID {{(pid=116063) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 13:04:47.521372 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-45a19095-7465-4602-8e52-977ac3f3669a tempest-AttachVolumeTestJSON-709357402 tempest-AttachVolumeTestJSON-709357402-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 13:04:47.521825 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-45a19095-7465-4602-8e52-977ac3f3669a tempest-AttachVolumeTestJSON-709357402 tempest-AttachVolumeTestJSON-709357402-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 13:04:47.522602 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-45a19095-7465-4602-8e52-977ac3f3669a tempest-AttachVolumeTestJSON-709357402 tempest-AttachVolumeTestJSON-709357402-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 13:04:47.523044 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-45a19095-7465-4602-8e52-977ac3f3669a tempest-AttachVolumeTestJSON-709357402 tempest-AttachVolumeTestJSON-709357402-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 13:04:47.658995 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.policy [None req-45a19095-7465-4602-8e52-977ac3f3669a tempest-AttachVolumeTestJSON-709357402 tempest-AttachVolumeTestJSON-709357402-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '083128ec42474a3e82a2b0fc8c278f4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b1a390d20a54f4d9529d286ab7764a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116063) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 13:04:47.666870 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: INFO nova.api.openstack.requestlog [None req-45a19095-7465-4602-8e52-977ac3f3669a tempest-AttachVolumeTestJSON-709357402 tempest-AttachVolumeTestJSON-709357402-project] 10.222.0.49 "GET /compute/v2.1/servers/1b8e1f2f-c109-4413-9d56-33ef0b651f85" status: 200 len: 1677 microversion: 2.1 time: 0.161737 Dec 14 13:04:47.667440 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: [pid: 116063|app: 0|req: 475/929] 10.222.0.49 () {58 vars in 1235 bytes} [Tue Dec 14 13:04:47 2021] GET /compute/v2.1/servers/1b8e1f2f-c109-4413-9d56-33ef0b651f85 => generated 1677 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 14 13:04:48.684308 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.api.openstack.wsgi [None req-73a583b6-5396-4cf8-aa7d-43af42f9ded5 tempest-AttachVolumeTestJSON-709357402 tempest-AttachVolumeTestJSON-709357402-project] Calling method '>' {{(pid=116064) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 13:04:48.684958 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.compute.api [None req-73a583b6-5396-4cf8-aa7d-43af42f9ded5 tempest-AttachVolumeTestJSON-709357402 tempest-AttachVolumeTestJSON-709357402-project] [instance: 1b8e1f2f-c109-4413-9d56-33ef0b651f85] Fetching instance by UUID {{(pid=116064) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 13:04:48.691913 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-73a583b6-5396-4cf8-aa7d-43af42f9ded5 tempest-AttachVolumeTestJSON-709357402 tempest-AttachVolumeTestJSON-709357402-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 13:04:48.692374 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-73a583b6-5396-4cf8-aa7d-43af42f9ded5 tempest-AttachVolumeTestJSON-709357402 tempest-AttachVolumeTestJSON-709357402-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 13:04:48.693310 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-73a583b6-5396-4cf8-aa7d-43af42f9ded5 tempest-AttachVolumeTestJSON-709357402 tempest-AttachVolumeTestJSON-709357402-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 13:04:48.693812 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-73a583b6-5396-4cf8-aa7d-43af42f9ded5 tempest-AttachVolumeTestJSON-709357402 tempest-AttachVolumeTestJSON-709357402-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 13:04:48.829228 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.policy [None req-73a583b6-5396-4cf8-aa7d-43af42f9ded5 tempest-AttachVolumeTestJSON-709357402 tempest-AttachVolumeTestJSON-709357402-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '083128ec42474a3e82a2b0fc8c278f4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b1a390d20a54f4d9529d286ab7764a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116064) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 13:04:48.840285 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: INFO nova.api.openstack.requestlog [None req-73a583b6-5396-4cf8-aa7d-43af42f9ded5 tempest-AttachVolumeTestJSON-709357402 tempest-AttachVolumeTestJSON-709357402-project] 10.222.0.49 "GET /compute/v2.1/servers/1b8e1f2f-c109-4413-9d56-33ef0b651f85" status: 200 len: 1677 microversion: 2.1 time: 0.159488 Dec 14 13:04:48.841038 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: [pid: 116064|app: 0|req: 455/930] 10.222.0.49 () {58 vars in 1235 bytes} [Tue Dec 14 13:04:48 2021] GET /compute/v2.1/servers/1b8e1f2f-c109-4413-9d56-33ef0b651f85 => generated 1677 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 14 13:04:49.860913 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.api.openstack.wsgi [None req-1f3d9d5c-f23f-427e-96c2-eb8dc00d129d tempest-AttachVolumeTestJSON-709357402 tempest-AttachVolumeTestJSON-709357402-project] Calling method '>' {{(pid=116063) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 13:04:49.861691 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.compute.api [None req-1f3d9d5c-f23f-427e-96c2-eb8dc00d129d tempest-AttachVolumeTestJSON-709357402 tempest-AttachVolumeTestJSON-709357402-project] [instance: 1b8e1f2f-c109-4413-9d56-33ef0b651f85] Fetching instance by UUID {{(pid=116063) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 13:04:49.868541 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-1f3d9d5c-f23f-427e-96c2-eb8dc00d129d tempest-AttachVolumeTestJSON-709357402 tempest-AttachVolumeTestJSON-709357402-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 13:04:49.869008 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-1f3d9d5c-f23f-427e-96c2-eb8dc00d129d tempest-AttachVolumeTestJSON-709357402 tempest-AttachVolumeTestJSON-709357402-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 13:04:49.869776 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-1f3d9d5c-f23f-427e-96c2-eb8dc00d129d tempest-AttachVolumeTestJSON-709357402 tempest-AttachVolumeTestJSON-709357402-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 13:04:49.870197 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-1f3d9d5c-f23f-427e-96c2-eb8dc00d129d tempest-AttachVolumeTestJSON-709357402 tempest-AttachVolumeTestJSON-709357402-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 13:04:50.010648 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.policy [None req-1f3d9d5c-f23f-427e-96c2-eb8dc00d129d tempest-AttachVolumeTestJSON-709357402 tempest-AttachVolumeTestJSON-709357402-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '083128ec42474a3e82a2b0fc8c278f4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b1a390d20a54f4d9529d286ab7764a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116063) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 13:04:50.018179 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: INFO nova.api.openstack.requestlog [None req-1f3d9d5c-f23f-427e-96c2-eb8dc00d129d tempest-AttachVolumeTestJSON-709357402 tempest-AttachVolumeTestJSON-709357402-project] 10.222.0.49 "GET /compute/v2.1/servers/1b8e1f2f-c109-4413-9d56-33ef0b651f85" status: 200 len: 1677 microversion: 2.1 time: 0.161929 Dec 14 13:04:50.018788 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: [pid: 116063|app: 0|req: 476/931] 10.222.0.49 () {58 vars in 1235 bytes} [Tue Dec 14 13:04:49 2021] GET /compute/v2.1/servers/1b8e1f2f-c109-4413-9d56-33ef0b651f85 => generated 1677 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 14 13:04:51.039198 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.api.openstack.wsgi [None req-9e3bdee6-7e7a-4300-b87f-a9136057dda8 tempest-AttachVolumeTestJSON-709357402 tempest-AttachVolumeTestJSON-709357402-project] Calling method '>' {{(pid=116064) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 13:04:51.040208 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.compute.api [None req-9e3bdee6-7e7a-4300-b87f-a9136057dda8 tempest-AttachVolumeTestJSON-709357402 tempest-AttachVolumeTestJSON-709357402-project] [instance: 1b8e1f2f-c109-4413-9d56-33ef0b651f85] Fetching instance by UUID {{(pid=116064) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 13:04:51.051336 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-9e3bdee6-7e7a-4300-b87f-a9136057dda8 tempest-AttachVolumeTestJSON-709357402 tempest-AttachVolumeTestJSON-709357402-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 13:04:51.052130 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-9e3bdee6-7e7a-4300-b87f-a9136057dda8 tempest-AttachVolumeTestJSON-709357402 tempest-AttachVolumeTestJSON-709357402-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 13:04:51.053720 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-9e3bdee6-7e7a-4300-b87f-a9136057dda8 tempest-AttachVolumeTestJSON-709357402 tempest-AttachVolumeTestJSON-709357402-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 13:04:51.054442 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-9e3bdee6-7e7a-4300-b87f-a9136057dda8 tempest-AttachVolumeTestJSON-709357402 tempest-AttachVolumeTestJSON-709357402-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 13:04:51.191424 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.policy [None req-9e3bdee6-7e7a-4300-b87f-a9136057dda8 tempest-AttachVolumeTestJSON-709357402 tempest-AttachVolumeTestJSON-709357402-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '083128ec42474a3e82a2b0fc8c278f4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b1a390d20a54f4d9529d286ab7764a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116064) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 13:04:51.199658 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: INFO nova.api.openstack.requestlog [None req-9e3bdee6-7e7a-4300-b87f-a9136057dda8 tempest-AttachVolumeTestJSON-709357402 tempest-AttachVolumeTestJSON-709357402-project] 10.222.0.49 "GET /compute/v2.1/servers/1b8e1f2f-c109-4413-9d56-33ef0b651f85" status: 200 len: 1654 microversion: 2.1 time: 0.166947 Dec 14 13:04:51.200226 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: [pid: 116064|app: 0|req: 456/932] 10.222.0.49 () {58 vars in 1235 bytes} [Tue Dec 14 13:04:51 2021] GET /compute/v2.1/servers/1b8e1f2f-c109-4413-9d56-33ef0b651f85 => generated 1654 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 14 13:04:51.218301 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.api.openstack.wsgi [None req-26c3fd0f-0dd3-4b9f-94f4-6f9ac5782748 tempest-AttachVolumeTestJSON-709357402 tempest-AttachVolumeTestJSON-709357402-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=116063) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 14 13:04:51.225044 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-26c3fd0f-0dd3-4b9f-94f4-6f9ac5782748 tempest-AttachVolumeTestJSON-709357402 tempest-AttachVolumeTestJSON-709357402-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 13:04:51.225485 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-26c3fd0f-0dd3-4b9f-94f4-6f9ac5782748 tempest-AttachVolumeTestJSON-709357402 tempest-AttachVolumeTestJSON-709357402-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 13:04:51.247617 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.compute.api [None req-26c3fd0f-0dd3-4b9f-94f4-6f9ac5782748 tempest-AttachVolumeTestJSON-709357402 tempest-AttachVolumeTestJSON-709357402-project] [instance: 1b8e1f2f-c109-4413-9d56-33ef0b651f85] Going to try to start instance {{(pid=116063) start /opt/stack/nova/nova/compute/api.py:2677}} Dec 14 13:04:51.299906 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: INFO nova.api.openstack.requestlog [None req-26c3fd0f-0dd3-4b9f-94f4-6f9ac5782748 tempest-AttachVolumeTestJSON-709357402 tempest-AttachVolumeTestJSON-709357402-project] 10.222.0.49 "POST /compute/v2.1/servers/1b8e1f2f-c109-4413-9d56-33ef0b651f85/action" status: 202 len: 0 microversion: 2.1 time: 0.084851 Dec 14 13:04:51.300515 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: [pid: 116063|app: 0|req: 477/933] 10.222.0.49 () {60 vars in 1277 bytes} [Tue Dec 14 13:04:51 2021] POST /compute/v2.1/servers/1b8e1f2f-c109-4413-9d56-33ef0b651f85/action => generated 0 bytes in 87 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Dec 14 13:04:51.308559 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.api.openstack.wsgi [None req-15c1761d-8e94-4509-99eb-75dceeb6a171 tempest-AttachVolumeTestJSON-709357402 tempest-AttachVolumeTestJSON-709357402-project] Calling method '>' {{(pid=116064) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 13:04:51.309215 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.compute.api [None req-15c1761d-8e94-4509-99eb-75dceeb6a171 tempest-AttachVolumeTestJSON-709357402 tempest-AttachVolumeTestJSON-709357402-project] [instance: 1b8e1f2f-c109-4413-9d56-33ef0b651f85] Fetching instance by UUID {{(pid=116064) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 13:04:51.315672 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-15c1761d-8e94-4509-99eb-75dceeb6a171 tempest-AttachVolumeTestJSON-709357402 tempest-AttachVolumeTestJSON-709357402-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 13:04:51.316129 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-15c1761d-8e94-4509-99eb-75dceeb6a171 tempest-AttachVolumeTestJSON-709357402 tempest-AttachVolumeTestJSON-709357402-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 13:04:51.316976 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-15c1761d-8e94-4509-99eb-75dceeb6a171 tempest-AttachVolumeTestJSON-709357402 tempest-AttachVolumeTestJSON-709357402-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 13:04:51.317401 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-15c1761d-8e94-4509-99eb-75dceeb6a171 tempest-AttachVolumeTestJSON-709357402 tempest-AttachVolumeTestJSON-709357402-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 13:04:51.452213 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.policy [None req-15c1761d-8e94-4509-99eb-75dceeb6a171 tempest-AttachVolumeTestJSON-709357402 tempest-AttachVolumeTestJSON-709357402-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '083128ec42474a3e82a2b0fc8c278f4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b1a390d20a54f4d9529d286ab7764a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116064) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 13:04:51.459846 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: INFO nova.api.openstack.requestlog [None req-15c1761d-8e94-4509-99eb-75dceeb6a171 tempest-AttachVolumeTestJSON-709357402 tempest-AttachVolumeTestJSON-709357402-project] 10.222.0.49 "GET /compute/v2.1/servers/1b8e1f2f-c109-4413-9d56-33ef0b651f85" status: 200 len: 1663 microversion: 2.1 time: 0.154999 Dec 14 13:04:51.460443 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: [pid: 116064|app: 0|req: 457/934] 10.222.0.49 () {58 vars in 1235 bytes} [Tue Dec 14 13:04:51 2021] GET /compute/v2.1/servers/1b8e1f2f-c109-4413-9d56-33ef0b651f85 => generated 1663 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 14 13:04:52.480725 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.api.openstack.wsgi [None req-f3d4f294-6b8b-49cd-aa02-e577516b6df2 tempest-AttachVolumeTestJSON-709357402 tempest-AttachVolumeTestJSON-709357402-project] Calling method '>' {{(pid=116063) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 13:04:52.481685 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.compute.api [None req-f3d4f294-6b8b-49cd-aa02-e577516b6df2 tempest-AttachVolumeTestJSON-709357402 tempest-AttachVolumeTestJSON-709357402-project] [instance: 1b8e1f2f-c109-4413-9d56-33ef0b651f85] Fetching instance by UUID {{(pid=116063) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 13:04:52.490090 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-f3d4f294-6b8b-49cd-aa02-e577516b6df2 tempest-AttachVolumeTestJSON-709357402 tempest-AttachVolumeTestJSON-709357402-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 13:04:52.490719 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-f3d4f294-6b8b-49cd-aa02-e577516b6df2 tempest-AttachVolumeTestJSON-709357402 tempest-AttachVolumeTestJSON-709357402-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 13:04:52.491740 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-f3d4f294-6b8b-49cd-aa02-e577516b6df2 tempest-AttachVolumeTestJSON-709357402 tempest-AttachVolumeTestJSON-709357402-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 13:04:52.492328 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-f3d4f294-6b8b-49cd-aa02-e577516b6df2 tempest-AttachVolumeTestJSON-709357402 tempest-AttachVolumeTestJSON-709357402-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 13:04:52.629677 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.policy [None req-f3d4f294-6b8b-49cd-aa02-e577516b6df2 tempest-AttachVolumeTestJSON-709357402 tempest-AttachVolumeTestJSON-709357402-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '083128ec42474a3e82a2b0fc8c278f4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b1a390d20a54f4d9529d286ab7764a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116063) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 13:04:52.638062 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: INFO nova.api.openstack.requestlog [None req-f3d4f294-6b8b-49cd-aa02-e577516b6df2 tempest-AttachVolumeTestJSON-709357402 tempest-AttachVolumeTestJSON-709357402-project] 10.222.0.49 "GET /compute/v2.1/servers/1b8e1f2f-c109-4413-9d56-33ef0b651f85" status: 200 len: 1667 microversion: 2.1 time: 0.163366 Dec 14 13:04:52.638635 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: [pid: 116063|app: 0|req: 478/935] 10.222.0.49 () {58 vars in 1235 bytes} [Tue Dec 14 13:04:52 2021] GET /compute/v2.1/servers/1b8e1f2f-c109-4413-9d56-33ef0b651f85 => generated 1667 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 14 13:05:01.555630 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.api.openstack.wsgi [None req-30afd456-697a-4dd7-8268-8565263e3a2f tempest-TestMinimumBasicScenario-84513626 tempest-TestMinimumBasicScenario-84513626-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "tempest-secgroup-smoke-1782610082"}} {{(pid=116064) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 14 13:05:01.556525 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.compute.api [None req-30afd456-697a-4dd7-8268-8565263e3a2f tempest-TestMinimumBasicScenario-84513626 tempest-TestMinimumBasicScenario-84513626-project] [instance: dd367814-45bc-4808-b2de-d54f79eb7933] Fetching instance by UUID {{(pid=116064) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 13:05:01.564241 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-30afd456-697a-4dd7-8268-8565263e3a2f tempest-TestMinimumBasicScenario-84513626 tempest-TestMinimumBasicScenario-84513626-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 13:05:01.564692 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-30afd456-697a-4dd7-8268-8565263e3a2f tempest-TestMinimumBasicScenario-84513626 tempest-TestMinimumBasicScenario-84513626-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 13:05:01.565508 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-30afd456-697a-4dd7-8268-8565263e3a2f tempest-TestMinimumBasicScenario-84513626 tempest-TestMinimumBasicScenario-84513626-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 13:05:01.565943 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-30afd456-697a-4dd7-8268-8565263e3a2f tempest-TestMinimumBasicScenario-84513626 tempest-TestMinimumBasicScenario-84513626-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 13:05:01.718569 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: INFO nova.network.security_group_api [None req-30afd456-697a-4dd7-8268-8565263e3a2f tempest-TestMinimumBasicScenario-84513626 tempest-TestMinimumBasicScenario-84513626-project] Removing security group 8f3f2143-9262-42ac-8efb-3e90e10f7764 from port fee608e1-5f95-4491-9016-8fcb3872f581 Dec 14 13:05:02.086662 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: INFO nova.api.openstack.requestlog [None req-30afd456-697a-4dd7-8268-8565263e3a2f tempest-TestMinimumBasicScenario-84513626 tempest-TestMinimumBasicScenario-84513626-project] 10.222.0.49 "POST /compute/v2.1/servers/dd367814-45bc-4808-b2de-d54f79eb7933/action" status: 202 len: 0 microversion: 2.1 time: 0.535589 Dec 14 13:05:02.087418 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: [pid: 116064|app: 0|req: 458/936] 10.222.0.49 () {60 vars in 1277 bytes} [Tue Dec 14 13:05:01 2021] POST /compute/v2.1/servers/dd367814-45bc-4808-b2de-d54f79eb7933/action => generated 0 bytes in 537 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Dec 14 13:05:02.102179 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.api.openstack.wsgi [req-017e6c85-fbca-4be7-bdc9-614c130fe09c req-c92eb907-3c63-444c-b0f6-12eb77885495 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "dd367814-45bc-4808-b2de-d54f79eb7933", "tag": "fee608e1-5f95-4491-9016-8fcb3872f581"}]} {{(pid=116063) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 14 13:05:02.103813 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 14 13:05:02.103813 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: warnings.warn(msg) Dec 14 13:05:02.125798 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [req-017e6c85-fbca-4be7-bdc9-614c130fe09c req-c92eb907-3c63-444c-b0f6-12eb77885495 service nova] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 13:05:02.126236 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [req-017e6c85-fbca-4be7-bdc9-614c130fe09c req-c92eb907-3c63-444c-b0f6-12eb77885495 service nova] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 13:05:02.141316 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: INFO nova.api.openstack.compute.server_external_events [req-017e6c85-fbca-4be7-bdc9-614c130fe09c req-c92eb907-3c63-444c-b0f6-12eb77885495 service nova] Creating event network-changed:fee608e1-5f95-4491-9016-8fcb3872f581 for instance dd367814-45bc-4808-b2de-d54f79eb7933 on hv-cinder-78447 Dec 14 13:05:02.147567 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: INFO nova.api.openstack.requestlog [req-017e6c85-fbca-4be7-bdc9-614c130fe09c req-c92eb907-3c63-444c-b0f6-12eb77885495 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.051819 Dec 14 13:05:02.148183 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: [pid: 116063|app: 0|req: 479/937] 10.222.0.49 () {64 vars in 1317 bytes} [Tue Dec 14 13:05:02 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 14 13:05:03.293358 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.api.openstack.wsgi [None req-569fd1da-c1b1-4234-bbf1-a92d59569c13 tempest-TestMinimumBasicScenario-84513626 tempest-TestMinimumBasicScenario-84513626-project] Calling method '>' {{(pid=116064) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 13:05:03.294664 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.compute.api [None req-569fd1da-c1b1-4234-bbf1-a92d59569c13 tempest-TestMinimumBasicScenario-84513626 tempest-TestMinimumBasicScenario-84513626-project] [instance: dd367814-45bc-4808-b2de-d54f79eb7933] Fetching instance by UUID {{(pid=116064) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 13:05:03.302041 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-569fd1da-c1b1-4234-bbf1-a92d59569c13 tempest-TestMinimumBasicScenario-84513626 tempest-TestMinimumBasicScenario-84513626-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 13:05:03.302725 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-569fd1da-c1b1-4234-bbf1-a92d59569c13 tempest-TestMinimumBasicScenario-84513626 tempest-TestMinimumBasicScenario-84513626-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 13:05:03.303849 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-569fd1da-c1b1-4234-bbf1-a92d59569c13 tempest-TestMinimumBasicScenario-84513626 tempest-TestMinimumBasicScenario-84513626-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 13:05:03.304501 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-569fd1da-c1b1-4234-bbf1-a92d59569c13 tempest-TestMinimumBasicScenario-84513626 tempest-TestMinimumBasicScenario-84513626-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 13:05:03.386236 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.objects.instance [None req-569fd1da-c1b1-4234-bbf1-a92d59569c13 tempest-TestMinimumBasicScenario-84513626 tempest-TestMinimumBasicScenario-84513626-project] Lazy-loading 'services' on Instance uuid dd367814-45bc-4808-b2de-d54f79eb7933 {{(pid=116064) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Dec 14 13:05:03.458887 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: INFO nova.api.openstack.requestlog [None req-569fd1da-c1b1-4234-bbf1-a92d59569c13 tempest-TestMinimumBasicScenario-84513626 tempest-TestMinimumBasicScenario-84513626-project] 10.222.0.49 "DELETE /compute/v2.1/servers/dd367814-45bc-4808-b2de-d54f79eb7933/os-volume_attachments/aac65dcc-b224-42d0-8431-b1b930fc6a39" status: 202 len: 0 microversion: 2.1 time: 0.169880 Dec 14 13:05:03.463214 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: [pid: 116064|app: 0|req: 459/938] 10.222.0.49 () {58 vars in 1415 bytes} [Tue Dec 14 13:05:03 2021] DELETE /compute/v2.1/servers/dd367814-45bc-4808-b2de-d54f79eb7933/os-volume_attachments/aac65dcc-b224-42d0-8431-b1b930fc6a39 => generated 0 bytes in 175 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Dec 14 13:05:03.469313 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.api.openstack.wsgi [None req-6bd497af-4f4b-48f4-9ac2-d7fcc18f38a6 tempest-TestMinimumBasicScenario-84513626 tempest-TestMinimumBasicScenario-84513626-project] Calling method '>' {{(pid=116063) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 13:05:03.470325 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.compute.api [None req-6bd497af-4f4b-48f4-9ac2-d7fcc18f38a6 tempest-TestMinimumBasicScenario-84513626 tempest-TestMinimumBasicScenario-84513626-project] [instance: dd367814-45bc-4808-b2de-d54f79eb7933] Fetching instance by UUID {{(pid=116063) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 13:05:03.479894 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-6bd497af-4f4b-48f4-9ac2-d7fcc18f38a6 tempest-TestMinimumBasicScenario-84513626 tempest-TestMinimumBasicScenario-84513626-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 13:05:03.481352 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-6bd497af-4f4b-48f4-9ac2-d7fcc18f38a6 tempest-TestMinimumBasicScenario-84513626 tempest-TestMinimumBasicScenario-84513626-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 13:05:03.482672 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-6bd497af-4f4b-48f4-9ac2-d7fcc18f38a6 tempest-TestMinimumBasicScenario-84513626 tempest-TestMinimumBasicScenario-84513626-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 13:05:03.483116 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-6bd497af-4f4b-48f4-9ac2-d7fcc18f38a6 tempest-TestMinimumBasicScenario-84513626 tempest-TestMinimumBasicScenario-84513626-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 13:05:03.519008 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: INFO nova.api.openstack.requestlog [None req-6bd497af-4f4b-48f4-9ac2-d7fcc18f38a6 tempest-TestMinimumBasicScenario-84513626 tempest-TestMinimumBasicScenario-84513626-project] 10.222.0.49 "GET /compute/v2.1/servers/dd367814-45bc-4808-b2de-d54f79eb7933/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.054529 Dec 14 13:05:03.519743 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: [pid: 116063|app: 0|req: 480/939] 10.222.0.49 () {58 vars in 1301 bytes} [Tue Dec 14 13:05:03 2021] GET /compute/v2.1/servers/dd367814-45bc-4808-b2de-d54f79eb7933/os-volume_attachments => generated 197 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Dec 14 13:05:04.163208 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.api.openstack.wsgi [req-97cafd28-feab-4e6e-80be-53a536344d10 req-9b7628cb-23d5-4c0e-818d-a5db11dace45 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "dd367814-45bc-4808-b2de-d54f79eb7933", "tag": "fee608e1-5f95-4491-9016-8fcb3872f581"}]} {{(pid=116064) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 14 13:05:04.164774 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 14 13:05:04.164774 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: warnings.warn(msg) Dec 14 13:05:04.172594 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [req-97cafd28-feab-4e6e-80be-53a536344d10 req-9b7628cb-23d5-4c0e-818d-a5db11dace45 service nova] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 13:05:04.173180 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [req-97cafd28-feab-4e6e-80be-53a536344d10 req-9b7628cb-23d5-4c0e-818d-a5db11dace45 service nova] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 13:05:04.185349 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: INFO nova.api.openstack.compute.server_external_events [req-97cafd28-feab-4e6e-80be-53a536344d10 req-9b7628cb-23d5-4c0e-818d-a5db11dace45 service nova] Creating event network-changed:fee608e1-5f95-4491-9016-8fcb3872f581 for instance dd367814-45bc-4808-b2de-d54f79eb7933 on hv-cinder-78447 Dec 14 13:05:04.190658 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: INFO nova.api.openstack.requestlog [req-97cafd28-feab-4e6e-80be-53a536344d10 req-9b7628cb-23d5-4c0e-818d-a5db11dace45 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031701 Dec 14 13:05:04.191476 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: [pid: 116064|app: 0|req: 460/940] 10.222.0.49 () {64 vars in 1317 bytes} [Tue Dec 14 13:05:04 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 14 13:05:04.531240 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.api.openstack.wsgi [None req-6c5636c6-14a0-4f2e-98ed-1fcdd7eb6353 tempest-TestMinimumBasicScenario-84513626 tempest-TestMinimumBasicScenario-84513626-project] Calling method '>' {{(pid=116063) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 13:05:04.532148 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.compute.api [None req-6c5636c6-14a0-4f2e-98ed-1fcdd7eb6353 tempest-TestMinimumBasicScenario-84513626 tempest-TestMinimumBasicScenario-84513626-project] [instance: dd367814-45bc-4808-b2de-d54f79eb7933] Fetching instance by UUID {{(pid=116063) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 13:05:04.539018 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-6c5636c6-14a0-4f2e-98ed-1fcdd7eb6353 tempest-TestMinimumBasicScenario-84513626 tempest-TestMinimumBasicScenario-84513626-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 13:05:04.539529 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-6c5636c6-14a0-4f2e-98ed-1fcdd7eb6353 tempest-TestMinimumBasicScenario-84513626 tempest-TestMinimumBasicScenario-84513626-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 13:05:04.540307 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-6c5636c6-14a0-4f2e-98ed-1fcdd7eb6353 tempest-TestMinimumBasicScenario-84513626 tempest-TestMinimumBasicScenario-84513626-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 13:05:04.540727 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-6c5636c6-14a0-4f2e-98ed-1fcdd7eb6353 tempest-TestMinimumBasicScenario-84513626 tempest-TestMinimumBasicScenario-84513626-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 13:05:04.569920 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: INFO nova.api.openstack.requestlog [None req-6c5636c6-14a0-4f2e-98ed-1fcdd7eb6353 tempest-TestMinimumBasicScenario-84513626 tempest-TestMinimumBasicScenario-84513626-project] 10.222.0.49 "GET /compute/v2.1/servers/dd367814-45bc-4808-b2de-d54f79eb7933/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.042476 Dec 14 13:05:04.570525 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: [pid: 116063|app: 0|req: 481/941] 10.222.0.49 () {58 vars in 1301 bytes} [Tue Dec 14 13:05:04 2021] GET /compute/v2.1/servers/dd367814-45bc-4808-b2de-d54f79eb7933/os-volume_attachments => generated 25 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Dec 14 13:05:04.584981 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.api.openstack.wsgi [None req-1b8ac350-887f-4032-b5c1-9813e82fc445 tempest-TestMinimumBasicScenario-84513626 tempest-TestMinimumBasicScenario-84513626-project] Calling method '>' {{(pid=116064) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 13:05:04.585547 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.compute.api [None req-1b8ac350-887f-4032-b5c1-9813e82fc445 tempest-TestMinimumBasicScenario-84513626 tempest-TestMinimumBasicScenario-84513626-project] [instance: dd367814-45bc-4808-b2de-d54f79eb7933] Fetching instance by UUID {{(pid=116064) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 13:05:04.592256 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-1b8ac350-887f-4032-b5c1-9813e82fc445 tempest-TestMinimumBasicScenario-84513626 tempest-TestMinimumBasicScenario-84513626-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 13:05:04.592696 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-1b8ac350-887f-4032-b5c1-9813e82fc445 tempest-TestMinimumBasicScenario-84513626 tempest-TestMinimumBasicScenario-84513626-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 13:05:04.593525 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-1b8ac350-887f-4032-b5c1-9813e82fc445 tempest-TestMinimumBasicScenario-84513626 tempest-TestMinimumBasicScenario-84513626-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 13:05:04.593952 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-1b8ac350-887f-4032-b5c1-9813e82fc445 tempest-TestMinimumBasicScenario-84513626 tempest-TestMinimumBasicScenario-84513626-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 13:05:04.670581 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: INFO nova.api.openstack.wsgi [None req-1b8ac350-887f-4032-b5c1-9813e82fc445 tempest-TestMinimumBasicScenario-84513626 tempest-TestMinimumBasicScenario-84513626-project] HTTP exception thrown: Instance dd367814-45bc-4808-b2de-d54f79eb7933 is not attached to volume aac65dcc-b224-42d0-8431-b1b930fc6a39 Dec 14 13:05:04.671186 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.api.openstack.wsgi [None req-1b8ac350-887f-4032-b5c1-9813e82fc445 tempest-TestMinimumBasicScenario-84513626 tempest-TestMinimumBasicScenario-84513626-project] Returning 404 to user: Instance dd367814-45bc-4808-b2de-d54f79eb7933 is not attached to volume aac65dcc-b224-42d0-8431-b1b930fc6a39 {{(pid=116064) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 14 13:05:04.672030 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: INFO nova.api.openstack.requestlog [None req-1b8ac350-887f-4032-b5c1-9813e82fc445 tempest-TestMinimumBasicScenario-84513626 tempest-TestMinimumBasicScenario-84513626-project] 10.222.0.49 "DELETE /compute/v2.1/servers/dd367814-45bc-4808-b2de-d54f79eb7933/os-volume_attachments/aac65dcc-b224-42d0-8431-b1b930fc6a39" status: 404 len: 154 microversion: 2.1 time: 0.091587 Dec 14 13:05:04.672582 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: [pid: 116064|app: 0|req: 461/942] 10.222.0.49 () {58 vars in 1415 bytes} [Tue Dec 14 13:05:04 2021] DELETE /compute/v2.1/servers/dd367814-45bc-4808-b2de-d54f79eb7933/os-volume_attachments/aac65dcc-b224-42d0-8431-b1b930fc6a39 => generated 154 bytes in 93 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Dec 14 13:05:05.818510 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.api.openstack.wsgi [None req-c16fa11f-efd2-4ff3-8129-bf721cbb9ff6 tempest-TestMinimumBasicScenario-84513626 tempest-TestMinimumBasicScenario-84513626-project] Calling method '>' {{(pid=116063) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 13:05:05.819069 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.compute.api [None req-c16fa11f-efd2-4ff3-8129-bf721cbb9ff6 tempest-TestMinimumBasicScenario-84513626 tempest-TestMinimumBasicScenario-84513626-project] [instance: dd367814-45bc-4808-b2de-d54f79eb7933] Fetching instance by UUID {{(pid=116063) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 13:05:05.825652 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-c16fa11f-efd2-4ff3-8129-bf721cbb9ff6 tempest-TestMinimumBasicScenario-84513626 tempest-TestMinimumBasicScenario-84513626-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 13:05:05.826095 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-c16fa11f-efd2-4ff3-8129-bf721cbb9ff6 tempest-TestMinimumBasicScenario-84513626 tempest-TestMinimumBasicScenario-84513626-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 13:05:05.826864 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-c16fa11f-efd2-4ff3-8129-bf721cbb9ff6 tempest-TestMinimumBasicScenario-84513626 tempest-TestMinimumBasicScenario-84513626-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 13:05:05.827293 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-c16fa11f-efd2-4ff3-8129-bf721cbb9ff6 tempest-TestMinimumBasicScenario-84513626 tempest-TestMinimumBasicScenario-84513626-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 13:05:05.855090 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.compute.api [None req-c16fa11f-efd2-4ff3-8129-bf721cbb9ff6 tempest-TestMinimumBasicScenario-84513626 tempest-TestMinimumBasicScenario-84513626-project] [instance: dd367814-45bc-4808-b2de-d54f79eb7933] Going to try to terminate instance {{(pid=116063) delete /opt/stack/nova/nova/compute/api.py:2614}} Dec 14 13:05:05.931376 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: INFO nova.api.openstack.requestlog [None req-c16fa11f-efd2-4ff3-8129-bf721cbb9ff6 tempest-TestMinimumBasicScenario-84513626 tempest-TestMinimumBasicScenario-84513626-project] 10.222.0.49 "DELETE /compute/v2.1/servers/dd367814-45bc-4808-b2de-d54f79eb7933" status: 204 len: 0 microversion: 2.1 time: 0.117877 Dec 14 13:05:05.931972 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: [pid: 116063|app: 0|req: 482/943] 10.222.0.49 () {58 vars in 1238 bytes} [Tue Dec 14 13:05:05 2021] DELETE /compute/v2.1/servers/dd367814-45bc-4808-b2de-d54f79eb7933 => generated 0 bytes in 120 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Dec 14 13:05:05.941240 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.api.openstack.wsgi [None req-ae1ad835-aac3-4f2d-94d9-fbc42cd97e8f tempest-TestMinimumBasicScenario-84513626 tempest-TestMinimumBasicScenario-84513626-project] Calling method '>' {{(pid=116064) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 13:05:05.941852 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.compute.api [None req-ae1ad835-aac3-4f2d-94d9-fbc42cd97e8f tempest-TestMinimumBasicScenario-84513626 tempest-TestMinimumBasicScenario-84513626-project] [instance: dd367814-45bc-4808-b2de-d54f79eb7933] Fetching instance by UUID {{(pid=116064) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 13:05:05.948647 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-ae1ad835-aac3-4f2d-94d9-fbc42cd97e8f tempest-TestMinimumBasicScenario-84513626 tempest-TestMinimumBasicScenario-84513626-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 13:05:05.949127 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-ae1ad835-aac3-4f2d-94d9-fbc42cd97e8f tempest-TestMinimumBasicScenario-84513626 tempest-TestMinimumBasicScenario-84513626-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 13:05:05.949902 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-ae1ad835-aac3-4f2d-94d9-fbc42cd97e8f tempest-TestMinimumBasicScenario-84513626 tempest-TestMinimumBasicScenario-84513626-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 13:05:05.950332 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-ae1ad835-aac3-4f2d-94d9-fbc42cd97e8f tempest-TestMinimumBasicScenario-84513626 tempest-TestMinimumBasicScenario-84513626-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 13:05:06.092735 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.policy [None req-ae1ad835-aac3-4f2d-94d9-fbc42cd97e8f tempest-TestMinimumBasicScenario-84513626 tempest-TestMinimumBasicScenario-84513626-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edf65e37b42d40b28c4e90bd92987016', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bcb503e37b2449484c788574e4c88f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116064) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 13:05:06.100879 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: INFO nova.api.openstack.requestlog [None req-ae1ad835-aac3-4f2d-94d9-fbc42cd97e8f tempest-TestMinimumBasicScenario-84513626 tempest-TestMinimumBasicScenario-84513626-project] 10.222.0.49 "GET /compute/v2.1/servers/dd367814-45bc-4808-b2de-d54f79eb7933" status: 200 len: 1554 microversion: 2.1 time: 0.164378 Dec 14 13:05:06.101482 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: [pid: 116064|app: 0|req: 462/944] 10.222.0.49 () {58 vars in 1235 bytes} [Tue Dec 14 13:05:05 2021] GET /compute/v2.1/servers/dd367814-45bc-4808-b2de-d54f79eb7933 => generated 1554 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 14 13:05:06.382382 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.api.openstack.wsgi [None req-cfe7f3d9-e4e0-4f38-b40b-f5c1825b31bd tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] Calling method '>' {{(pid=116063) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 13:05:06.383376 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.compute.api [None req-cfe7f3d9-e4e0-4f38-b40b-f5c1825b31bd tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] [instance: 9b3b44a7-7c20-473c-841c-318e471fc6cd] Fetching instance by UUID {{(pid=116063) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 13:05:06.389344 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-cfe7f3d9-e4e0-4f38-b40b-f5c1825b31bd tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 13:05:06.389793 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-cfe7f3d9-e4e0-4f38-b40b-f5c1825b31bd tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 13:05:06.390580 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-cfe7f3d9-e4e0-4f38-b40b-f5c1825b31bd tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 13:05:06.391012 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-cfe7f3d9-e4e0-4f38-b40b-f5c1825b31bd tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 13:05:06.421137 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: INFO nova.api.openstack.requestlog [None req-cfe7f3d9-e4e0-4f38-b40b-f5c1825b31bd tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] 10.222.0.49 "GET /compute/v2.1/servers/9b3b44a7-7c20-473c-841c-318e471fc6cd/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.042919 Dec 14 13:05:06.421650 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: [pid: 116063|app: 0|req: 483/945] 10.222.0.49 () {60 vars in 1342 bytes} [Tue Dec 14 13:05:06 2021] GET /compute/v2.1/servers/9b3b44a7-7c20-473c-841c-318e471fc6cd/os-volume_attachments => generated 25 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 14 13:05:06.479100 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.api.openstack.wsgi [None req-fd6e4a4d-c4e5-465b-b066-b78c92de1cca tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] Calling method '>' {{(pid=116064) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 13:05:06.479594 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.compute.api [None req-fd6e4a4d-c4e5-465b-b066-b78c92de1cca tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] [instance: 9b3b44a7-7c20-473c-841c-318e471fc6cd] Fetching instance by UUID {{(pid=116064) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 13:05:06.486012 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-fd6e4a4d-c4e5-465b-b066-b78c92de1cca tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 13:05:06.486453 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-fd6e4a4d-c4e5-465b-b066-b78c92de1cca tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 13:05:06.487224 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-fd6e4a4d-c4e5-465b-b066-b78c92de1cca tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 13:05:06.487653 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-fd6e4a4d-c4e5-465b-b066-b78c92de1cca tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 13:05:06.512532 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.compute.api [None req-fd6e4a4d-c4e5-465b-b066-b78c92de1cca tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] [instance: 9b3b44a7-7c20-473c-841c-318e471fc6cd] Going to try to terminate instance {{(pid=116064) delete /opt/stack/nova/nova/compute/api.py:2614}} Dec 14 13:05:06.599099 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: INFO nova.api.openstack.requestlog [None req-fd6e4a4d-c4e5-465b-b066-b78c92de1cca tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] 10.222.0.49 "DELETE /compute/v2.1/servers/9b3b44a7-7c20-473c-841c-318e471fc6cd" status: 204 len: 0 microversion: 2.20 time: 0.123407 Dec 14 13:05:06.599645 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: [pid: 116064|app: 0|req: 463/946] 10.222.0.49 () {60 vars in 1279 bytes} [Tue Dec 14 13:05:06 2021] DELETE /compute/v2.1/servers/9b3b44a7-7c20-473c-841c-318e471fc6cd => generated 0 bytes in 125 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Dec 14 13:05:06.608936 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.api.openstack.wsgi [None req-8b80e038-3fa9-4913-a8e8-5822b778f2a6 tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] Calling method '>' {{(pid=116063) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 13:05:06.609535 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.compute.api [None req-8b80e038-3fa9-4913-a8e8-5822b778f2a6 tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] [instance: 9b3b44a7-7c20-473c-841c-318e471fc6cd] Fetching instance by UUID {{(pid=116063) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 13:05:06.615424 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-8b80e038-3fa9-4913-a8e8-5822b778f2a6 tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 13:05:06.615861 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-8b80e038-3fa9-4913-a8e8-5822b778f2a6 tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 13:05:06.616620 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-8b80e038-3fa9-4913-a8e8-5822b778f2a6 tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 13:05:06.617078 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-8b80e038-3fa9-4913-a8e8-5822b778f2a6 tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 13:05:06.756603 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.policy [None req-8b80e038-3fa9-4913-a8e8-5822b778f2a6 tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79d74a2ea1e541d28d085c15cec34032', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68a8770b8dbe489a8119016fbee64eb5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116063) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 13:05:06.765846 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.policy [None req-8b80e038-3fa9-4913-a8e8-5822b778f2a6 tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '79d74a2ea1e541d28d085c15cec34032', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68a8770b8dbe489a8119016fbee64eb5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116063) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 13:05:06.767324 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.policy [None req-8b80e038-3fa9-4913-a8e8-5822b778f2a6 tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '79d74a2ea1e541d28d085c15cec34032', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68a8770b8dbe489a8119016fbee64eb5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116063) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 13:05:06.768467 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: INFO nova.api.openstack.requestlog [None req-8b80e038-3fa9-4913-a8e8-5822b778f2a6 tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] 10.222.0.49 "GET /compute/v2.1/servers/9b3b44a7-7c20-473c-841c-318e471fc6cd" status: 200 len: 1722 microversion: 2.20 time: 0.163318 Dec 14 13:05:06.769038 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: [pid: 116063|app: 0|req: 484/947] 10.222.0.49 () {60 vars in 1276 bytes} [Tue Dec 14 13:05:06 2021] GET /compute/v2.1/servers/9b3b44a7-7c20-473c-841c-318e471fc6cd => generated 1722 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 14 13:05:07.119387 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.api.openstack.wsgi [None req-fb438996-a39d-466d-9d2d-0e24cb62551b tempest-TestMinimumBasicScenario-84513626 tempest-TestMinimumBasicScenario-84513626-project] Calling method '>' {{(pid=116064) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 13:05:07.119969 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.compute.api [None req-fb438996-a39d-466d-9d2d-0e24cb62551b tempest-TestMinimumBasicScenario-84513626 tempest-TestMinimumBasicScenario-84513626-project] [instance: dd367814-45bc-4808-b2de-d54f79eb7933] Fetching instance by UUID {{(pid=116064) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 13:05:07.127132 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-fb438996-a39d-466d-9d2d-0e24cb62551b tempest-TestMinimumBasicScenario-84513626 tempest-TestMinimumBasicScenario-84513626-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 13:05:07.127580 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-fb438996-a39d-466d-9d2d-0e24cb62551b tempest-TestMinimumBasicScenario-84513626 tempest-TestMinimumBasicScenario-84513626-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 13:05:07.128409 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-fb438996-a39d-466d-9d2d-0e24cb62551b tempest-TestMinimumBasicScenario-84513626 tempest-TestMinimumBasicScenario-84513626-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 13:05:07.128887 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-fb438996-a39d-466d-9d2d-0e24cb62551b tempest-TestMinimumBasicScenario-84513626 tempest-TestMinimumBasicScenario-84513626-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 13:05:07.261361 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.policy [None req-fb438996-a39d-466d-9d2d-0e24cb62551b tempest-TestMinimumBasicScenario-84513626 tempest-TestMinimumBasicScenario-84513626-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edf65e37b42d40b28c4e90bd92987016', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bcb503e37b2449484c788574e4c88f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116064) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 13:05:07.272930 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: INFO nova.api.openstack.requestlog [None req-fb438996-a39d-466d-9d2d-0e24cb62551b tempest-TestMinimumBasicScenario-84513626 tempest-TestMinimumBasicScenario-84513626-project] 10.222.0.49 "GET /compute/v2.1/servers/dd367814-45bc-4808-b2de-d54f79eb7933" status: 200 len: 1554 microversion: 2.1 time: 0.157696 Dec 14 13:05:07.273688 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: [pid: 116064|app: 0|req: 464/948] 10.222.0.49 () {58 vars in 1235 bytes} [Tue Dec 14 13:05:07 2021] GET /compute/v2.1/servers/dd367814-45bc-4808-b2de-d54f79eb7933 => generated 1554 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 14 13:05:07.791673 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.api.openstack.wsgi [None req-ab6388d2-fa9c-4dd3-9ba6-990bf248d52c tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] Calling method '>' {{(pid=116063) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 13:05:07.792634 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.compute.api [None req-ab6388d2-fa9c-4dd3-9ba6-990bf248d52c tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] [instance: 9b3b44a7-7c20-473c-841c-318e471fc6cd] Fetching instance by UUID {{(pid=116063) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 13:05:07.803705 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-ab6388d2-fa9c-4dd3-9ba6-990bf248d52c tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 13:05:07.804151 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-ab6388d2-fa9c-4dd3-9ba6-990bf248d52c tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 13:05:07.804950 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-ab6388d2-fa9c-4dd3-9ba6-990bf248d52c tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 13:05:07.805370 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-ab6388d2-fa9c-4dd3-9ba6-990bf248d52c tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 13:05:07.950229 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.policy [None req-ab6388d2-fa9c-4dd3-9ba6-990bf248d52c tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79d74a2ea1e541d28d085c15cec34032', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68a8770b8dbe489a8119016fbee64eb5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116063) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 13:05:07.960452 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.policy [None req-ab6388d2-fa9c-4dd3-9ba6-990bf248d52c tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '79d74a2ea1e541d28d085c15cec34032', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68a8770b8dbe489a8119016fbee64eb5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116063) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 13:05:07.962027 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.policy [None req-ab6388d2-fa9c-4dd3-9ba6-990bf248d52c tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '79d74a2ea1e541d28d085c15cec34032', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68a8770b8dbe489a8119016fbee64eb5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116063) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 13:05:07.963196 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: INFO nova.api.openstack.requestlog [None req-ab6388d2-fa9c-4dd3-9ba6-990bf248d52c tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] 10.222.0.49 "GET /compute/v2.1/servers/9b3b44a7-7c20-473c-841c-318e471fc6cd" status: 200 len: 1722 microversion: 2.20 time: 0.178173 Dec 14 13:05:07.963781 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: [pid: 116063|app: 0|req: 485/949] 10.222.0.49 () {60 vars in 1276 bytes} [Tue Dec 14 13:05:07 2021] GET /compute/v2.1/servers/9b3b44a7-7c20-473c-841c-318e471fc6cd => generated 1722 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 14 13:05:08.290705 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.api.openstack.wsgi [None req-02a0d17b-0a8f-415f-bbda-e1fcb20b986d tempest-TestMinimumBasicScenario-84513626 tempest-TestMinimumBasicScenario-84513626-project] Calling method '>' {{(pid=116064) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 13:05:08.291605 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.compute.api [None req-02a0d17b-0a8f-415f-bbda-e1fcb20b986d tempest-TestMinimumBasicScenario-84513626 tempest-TestMinimumBasicScenario-84513626-project] [instance: dd367814-45bc-4808-b2de-d54f79eb7933] Fetching instance by UUID {{(pid=116064) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 13:05:08.298440 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-02a0d17b-0a8f-415f-bbda-e1fcb20b986d tempest-TestMinimumBasicScenario-84513626 tempest-TestMinimumBasicScenario-84513626-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 13:05:08.298898 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-02a0d17b-0a8f-415f-bbda-e1fcb20b986d tempest-TestMinimumBasicScenario-84513626 tempest-TestMinimumBasicScenario-84513626-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 13:05:08.299689 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-02a0d17b-0a8f-415f-bbda-e1fcb20b986d tempest-TestMinimumBasicScenario-84513626 tempest-TestMinimumBasicScenario-84513626-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 13:05:08.300128 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-02a0d17b-0a8f-415f-bbda-e1fcb20b986d tempest-TestMinimumBasicScenario-84513626 tempest-TestMinimumBasicScenario-84513626-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 13:05:08.361581 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.policy [None req-02a0d17b-0a8f-415f-bbda-e1fcb20b986d tempest-TestMinimumBasicScenario-84513626 tempest-TestMinimumBasicScenario-84513626-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edf65e37b42d40b28c4e90bd92987016', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bcb503e37b2449484c788574e4c88f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116064) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 13:05:08.369541 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: INFO nova.api.openstack.requestlog [None req-02a0d17b-0a8f-415f-bbda-e1fcb20b986d tempest-TestMinimumBasicScenario-84513626 tempest-TestMinimumBasicScenario-84513626-project] 10.222.0.49 "GET /compute/v2.1/servers/dd367814-45bc-4808-b2de-d54f79eb7933" status: 200 len: 1512 microversion: 2.1 time: 0.082685 Dec 14 13:05:08.370518 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: [pid: 116064|app: 0|req: 465/950] 10.222.0.49 () {58 vars in 1235 bytes} [Tue Dec 14 13:05:08 2021] GET /compute/v2.1/servers/dd367814-45bc-4808-b2de-d54f79eb7933 => generated 1512 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 14 13:05:08.437518 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.api.openstack.wsgi [req-ffcbe538-1c1b-4042-a914-a83a06245a33 req-305d0aa9-df2d-4493-800c-e102c9e7327e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dd367814-45bc-4808-b2de-d54f79eb7933", "name": "network-vif-deleted", "tag": "fee608e1-5f95-4491-9016-8fcb3872f581"}]} {{(pid=116063) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 14 13:05:08.439425 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 14 13:05:08.439425 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: warnings.warn(msg) Dec 14 13:05:08.447416 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [req-ffcbe538-1c1b-4042-a914-a83a06245a33 req-305d0aa9-df2d-4493-800c-e102c9e7327e service nova] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 13:05:08.448099 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [req-ffcbe538-1c1b-4042-a914-a83a06245a33 req-305d0aa9-df2d-4493-800c-e102c9e7327e service nova] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 13:05:08.459851 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: INFO nova.api.openstack.compute.server_external_events [req-ffcbe538-1c1b-4042-a914-a83a06245a33 req-305d0aa9-df2d-4493-800c-e102c9e7327e service nova] Creating event network-vif-deleted:fee608e1-5f95-4491-9016-8fcb3872f581 for instance dd367814-45bc-4808-b2de-d54f79eb7933 on hv-cinder-78447 Dec 14 13:05:08.465275 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: INFO nova.api.openstack.requestlog [req-ffcbe538-1c1b-4042-a914-a83a06245a33 req-305d0aa9-df2d-4493-800c-e102c9e7327e service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032526 Dec 14 13:05:08.465888 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: [pid: 116063|app: 0|req: 486/951] 10.222.0.49 () {64 vars in 1317 bytes} [Tue Dec 14 13:05:08 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 14 13:05:08.982492 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.api.openstack.wsgi [None req-8623c708-abed-44f2-9859-e541f4f17671 tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] Calling method '>' {{(pid=116064) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 13:05:08.983171 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.compute.api [None req-8623c708-abed-44f2-9859-e541f4f17671 tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] [instance: 9b3b44a7-7c20-473c-841c-318e471fc6cd] Fetching instance by UUID {{(pid=116064) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 13:05:08.990125 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-8623c708-abed-44f2-9859-e541f4f17671 tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 13:05:08.990594 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-8623c708-abed-44f2-9859-e541f4f17671 tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 13:05:08.991562 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-8623c708-abed-44f2-9859-e541f4f17671 tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 13:05:08.991999 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-8623c708-abed-44f2-9859-e541f4f17671 tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 13:05:09.055543 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.policy [None req-8623c708-abed-44f2-9859-e541f4f17671 tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79d74a2ea1e541d28d085c15cec34032', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68a8770b8dbe489a8119016fbee64eb5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116064) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 13:05:09.064284 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.policy [None req-8623c708-abed-44f2-9859-e541f4f17671 tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '79d74a2ea1e541d28d085c15cec34032', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68a8770b8dbe489a8119016fbee64eb5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116064) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 13:05:09.066366 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.policy [None req-8623c708-abed-44f2-9859-e541f4f17671 tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '79d74a2ea1e541d28d085c15cec34032', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68a8770b8dbe489a8119016fbee64eb5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116064) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 13:05:09.067924 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: INFO nova.api.openstack.requestlog [None req-8623c708-abed-44f2-9859-e541f4f17671 tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] 10.222.0.49 "GET /compute/v2.1/servers/9b3b44a7-7c20-473c-841c-318e471fc6cd" status: 200 len: 1655 microversion: 2.20 time: 0.089608 Dec 14 13:05:09.069167 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: [pid: 116064|app: 0|req: 466/952] 10.222.0.49 () {60 vars in 1276 bytes} [Tue Dec 14 13:05:08 2021] GET /compute/v2.1/servers/9b3b44a7-7c20-473c-841c-318e471fc6cd => generated 1655 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 14 13:05:09.388160 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.api.openstack.wsgi [None req-faa87880-39e5-40bc-9f40-bbab2db36106 tempest-TestMinimumBasicScenario-84513626 tempest-TestMinimumBasicScenario-84513626-project] Calling method '>' {{(pid=116063) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 13:05:09.389018 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.compute.api [None req-faa87880-39e5-40bc-9f40-bbab2db36106 tempest-TestMinimumBasicScenario-84513626 tempest-TestMinimumBasicScenario-84513626-project] [instance: dd367814-45bc-4808-b2de-d54f79eb7933] Fetching instance by UUID {{(pid=116063) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 13:05:09.396540 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-faa87880-39e5-40bc-9f40-bbab2db36106 tempest-TestMinimumBasicScenario-84513626 tempest-TestMinimumBasicScenario-84513626-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 13:05:09.397379 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-faa87880-39e5-40bc-9f40-bbab2db36106 tempest-TestMinimumBasicScenario-84513626 tempest-TestMinimumBasicScenario-84513626-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 13:05:09.398455 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-faa87880-39e5-40bc-9f40-bbab2db36106 tempest-TestMinimumBasicScenario-84513626 tempest-TestMinimumBasicScenario-84513626-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 13:05:09.399234 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-faa87880-39e5-40bc-9f40-bbab2db36106 tempest-TestMinimumBasicScenario-84513626 tempest-TestMinimumBasicScenario-84513626-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 13:05:09.417145 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: INFO nova.api.openstack.wsgi [None req-faa87880-39e5-40bc-9f40-bbab2db36106 tempest-TestMinimumBasicScenario-84513626 tempest-TestMinimumBasicScenario-84513626-project] HTTP exception thrown: Instance dd367814-45bc-4808-b2de-d54f79eb7933 could not be found. Dec 14 13:05:09.417753 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.api.openstack.wsgi [None req-faa87880-39e5-40bc-9f40-bbab2db36106 tempest-TestMinimumBasicScenario-84513626 tempest-TestMinimumBasicScenario-84513626-project] Returning 404 to user: Instance dd367814-45bc-4808-b2de-d54f79eb7933 could not be found. {{(pid=116063) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 14 13:05:09.419206 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: INFO nova.api.openstack.requestlog [None req-faa87880-39e5-40bc-9f40-bbab2db36106 tempest-TestMinimumBasicScenario-84513626 tempest-TestMinimumBasicScenario-84513626-project] 10.222.0.49 "GET /compute/v2.1/servers/dd367814-45bc-4808-b2de-d54f79eb7933" status: 404 len: 111 microversion: 2.1 time: 0.036150 Dec 14 13:05:09.423759 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: [pid: 116063|app: 0|req: 487/953] 10.222.0.49 () {58 vars in 1235 bytes} [Tue Dec 14 13:05:09 2021] GET /compute/v2.1/servers/dd367814-45bc-4808-b2de-d54f79eb7933 => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Dec 14 13:05:09.429248 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.api.openstack.wsgi [None req-8e736bca-9165-46bf-aa76-b4d64af685bc tempest-TestMinimumBasicScenario-84513626 tempest-TestMinimumBasicScenario-84513626-project] Calling method '.version_select at 0x7f2ace3fb0d0>' {{(pid=116064) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 13:05:09.450058 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: INFO nova.api.openstack.requestlog [None req-8e736bca-9165-46bf-aa76-b4d64af685bc tempest-TestMinimumBasicScenario-84513626 tempest-TestMinimumBasicScenario-84513626-project] 10.222.0.49 "DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-1545478889" status: 202 len: 0 microversion: 2.1 time: 0.024855 Dec 14 13:05:09.450727 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: [pid: 116064|app: 0|req: 467/954] 10.222.0.49 () {58 vars in 1271 bytes} [Tue Dec 14 13:05:09 2021] DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-1545478889 => generated 0 bytes in 26 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Dec 14 13:05:10.087403 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.api.openstack.wsgi [None req-375896ef-6be9-4d0b-a306-389923bbbf18 tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] Calling method '>' {{(pid=116063) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 13:05:10.088042 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.compute.api [None req-375896ef-6be9-4d0b-a306-389923bbbf18 tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] [instance: 9b3b44a7-7c20-473c-841c-318e471fc6cd] Fetching instance by UUID {{(pid=116063) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 13:05:10.094623 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-375896ef-6be9-4d0b-a306-389923bbbf18 tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 13:05:10.095044 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-375896ef-6be9-4d0b-a306-389923bbbf18 tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 13:05:10.096093 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-375896ef-6be9-4d0b-a306-389923bbbf18 tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 13:05:10.096532 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-375896ef-6be9-4d0b-a306-389923bbbf18 tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 13:05:10.110320 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: INFO nova.api.openstack.wsgi [None req-375896ef-6be9-4d0b-a306-389923bbbf18 tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] HTTP exception thrown: Instance 9b3b44a7-7c20-473c-841c-318e471fc6cd could not be found. Dec 14 13:05:10.111043 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.api.openstack.wsgi [None req-375896ef-6be9-4d0b-a306-389923bbbf18 tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] Returning 404 to user: Instance 9b3b44a7-7c20-473c-841c-318e471fc6cd could not be found. {{(pid=116063) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 14 13:05:10.111874 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: INFO nova.api.openstack.requestlog [None req-375896ef-6be9-4d0b-a306-389923bbbf18 tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] 10.222.0.49 "GET /compute/v2.1/servers/9b3b44a7-7c20-473c-841c-318e471fc6cd" status: 404 len: 111 microversion: 2.20 time: 0.028550 Dec 14 13:05:10.112617 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: [pid: 116063|app: 0|req: 488/955] 10.222.0.49 () {60 vars in 1276 bytes} [Tue Dec 14 13:05:10 2021] GET /compute/v2.1/servers/9b3b44a7-7c20-473c-841c-318e471fc6cd => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Dec 14 13:05:10.122241 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.api.openstack.wsgi [None req-e60fe473-4d07-4cd7-8563-a70b78f4a1f4 tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] Calling method '.version_select at 0x7f2ace435a60>' {{(pid=116064) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 13:05:10.145556 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: INFO nova.api.openstack.requestlog [None req-e60fe473-4d07-4cd7-8563-a70b78f4a1f4 tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] 10.222.0.49 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-395647254" status: 204 len: 0 microversion: 2.20 time: 0.027709 Dec 14 13:05:10.152026 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: [pid: 116064|app: 0|req: 468/956] 10.222.0.49 () {60 vars in 1258 bytes} [Tue Dec 14 13:05:10 2021] DELETE /compute/v2.1/os-keypairs/tempest-keypair-395647254 => generated 0 bytes in 29 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Dec 14 13:05:10.504879 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.api.openstack.wsgi [req-88e96df0-f9c4-419d-bcc2-7fa8bbea00d3 req-6bc7ec4d-3a4a-4687-8d12-1e9aa7ebc7bb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9b3b44a7-7c20-473c-841c-318e471fc6cd", "name": "network-vif-deleted", "tag": "0ed44ee3-2630-4f50-9391-4bb374b76e1d"}]} {{(pid=116063) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 14 13:05:10.507342 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 14 13:05:10.507342 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: warnings.warn(msg) Dec 14 13:05:10.515229 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [req-88e96df0-f9c4-419d-bcc2-7fa8bbea00d3 req-6bc7ec4d-3a4a-4687-8d12-1e9aa7ebc7bb service nova] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 13:05:10.515677 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [req-88e96df0-f9c4-419d-bcc2-7fa8bbea00d3 req-6bc7ec4d-3a4a-4687-8d12-1e9aa7ebc7bb service nova] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 13:05:10.527280 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: INFO nova.api.openstack.compute.server_external_events [req-88e96df0-f9c4-419d-bcc2-7fa8bbea00d3 req-6bc7ec4d-3a4a-4687-8d12-1e9aa7ebc7bb service nova] Creating event network-vif-deleted:0ed44ee3-2630-4f50-9391-4bb374b76e1d for instance 9b3b44a7-7c20-473c-841c-318e471fc6cd on hv-cinder-78447 Dec 14 13:05:10.532322 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: INFO nova.api.openstack.requestlog [req-88e96df0-f9c4-419d-bcc2-7fa8bbea00d3 req-6bc7ec4d-3a4a-4687-8d12-1e9aa7ebc7bb service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031206 Dec 14 13:05:10.533240 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: [pid: 116063|app: 0|req: 489/957] 10.222.0.49 () {64 vars in 1317 bytes} [Tue Dec 14 13:05:10 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 14 13:05:11.940594 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.api.openstack.wsgi [None req-8148f610-6428-432c-a732-eb1b301a698f tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] Calling method '>' {{(pid=116064) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 13:05:11.941131 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.compute.api [None req-8148f610-6428-432c-a732-eb1b301a698f tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] [instance: 9b3b44a7-7c20-473c-841c-318e471fc6cd] Fetching instance by UUID {{(pid=116064) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 13:05:11.947293 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-8148f610-6428-432c-a732-eb1b301a698f tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 13:05:11.947740 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-8148f610-6428-432c-a732-eb1b301a698f tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 13:05:11.948705 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-8148f610-6428-432c-a732-eb1b301a698f tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 13:05:11.949334 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-8148f610-6428-432c-a732-eb1b301a698f tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 13:05:11.963913 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: INFO nova.api.openstack.wsgi [None req-8148f610-6428-432c-a732-eb1b301a698f tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] HTTP exception thrown: Instance 9b3b44a7-7c20-473c-841c-318e471fc6cd could not be found. Dec 14 13:05:11.964509 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.api.openstack.wsgi [None req-8148f610-6428-432c-a732-eb1b301a698f tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] Returning 404 to user: Instance 9b3b44a7-7c20-473c-841c-318e471fc6cd could not be found. {{(pid=116064) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 14 13:05:11.965382 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: INFO nova.api.openstack.requestlog [None req-8148f610-6428-432c-a732-eb1b301a698f tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] 10.222.0.49 "DELETE /compute/v2.1/servers/9b3b44a7-7c20-473c-841c-318e471fc6cd" status: 404 len: 111 microversion: 2.20 time: 0.029384 Dec 14 13:05:11.965938 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: [pid: 116064|app: 0|req: 469/958] 10.222.0.49 () {60 vars in 1279 bytes} [Tue Dec 14 13:05:11 2021] DELETE /compute/v2.1/servers/9b3b44a7-7c20-473c-841c-318e471fc6cd => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Dec 14 13:05:11.974452 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.api.openstack.wsgi [None req-e6d18396-213f-4dd4-8280-a3ad0ebc7f75 tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] Calling method '>' {{(pid=116063) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 13:05:11.975936 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.compute.api [None req-e6d18396-213f-4dd4-8280-a3ad0ebc7f75 tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] [instance: 9b3b44a7-7c20-473c-841c-318e471fc6cd] Fetching instance by UUID {{(pid=116063) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 13:05:11.982649 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-e6d18396-213f-4dd4-8280-a3ad0ebc7f75 tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 13:05:11.983098 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-e6d18396-213f-4dd4-8280-a3ad0ebc7f75 tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 13:05:11.983877 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-e6d18396-213f-4dd4-8280-a3ad0ebc7f75 tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 13:05:11.984307 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-e6d18396-213f-4dd4-8280-a3ad0ebc7f75 tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 13:05:11.997950 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: INFO nova.api.openstack.wsgi [None req-e6d18396-213f-4dd4-8280-a3ad0ebc7f75 tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] HTTP exception thrown: Instance 9b3b44a7-7c20-473c-841c-318e471fc6cd could not be found. Dec 14 13:05:11.998534 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.api.openstack.wsgi [None req-e6d18396-213f-4dd4-8280-a3ad0ebc7f75 tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] Returning 404 to user: Instance 9b3b44a7-7c20-473c-841c-318e471fc6cd could not be found. {{(pid=116063) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 14 13:05:11.999621 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: INFO nova.api.openstack.requestlog [None req-e6d18396-213f-4dd4-8280-a3ad0ebc7f75 tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] 10.222.0.49 "GET /compute/v2.1/servers/9b3b44a7-7c20-473c-841c-318e471fc6cd" status: 404 len: 111 microversion: 2.20 time: 0.029365 Dec 14 13:05:12.000414 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: [pid: 116063|app: 0|req: 490/959] 10.222.0.49 () {60 vars in 1276 bytes} [Tue Dec 14 13:05:11 2021] GET /compute/v2.1/servers/9b3b44a7-7c20-473c-841c-318e471fc6cd => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 381 bytes (2 switches on core 0) Dec 14 13:05:13.154006 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.api.openstack.wsgi [None req-0c16c2b3-15d0-4ee3-a1f8-496c63edf3f2 tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] Calling method '>' {{(pid=116064) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 13:05:13.155066 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.compute.api [None req-0c16c2b3-15d0-4ee3-a1f8-496c63edf3f2 tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] [instance: c8de7730-62f2-4a77-b1e9-cf6a74fa366d] Fetching instance by UUID {{(pid=116064) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 13:05:13.167152 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-0c16c2b3-15d0-4ee3-a1f8-496c63edf3f2 tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 13:05:13.167628 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-0c16c2b3-15d0-4ee3-a1f8-496c63edf3f2 tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 13:05:13.168400 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-0c16c2b3-15d0-4ee3-a1f8-496c63edf3f2 tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 13:05:13.168934 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-0c16c2b3-15d0-4ee3-a1f8-496c63edf3f2 tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 13:05:13.187781 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: INFO nova.api.openstack.wsgi [None req-0c16c2b3-15d0-4ee3-a1f8-496c63edf3f2 tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] HTTP exception thrown: Instance c8de7730-62f2-4a77-b1e9-cf6a74fa366d could not be found. Dec 14 13:05:13.188598 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.api.openstack.wsgi [None req-0c16c2b3-15d0-4ee3-a1f8-496c63edf3f2 tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] Returning 404 to user: Instance c8de7730-62f2-4a77-b1e9-cf6a74fa366d could not be found. {{(pid=116064) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 14 13:05:13.189659 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: INFO nova.api.openstack.requestlog [None req-0c16c2b3-15d0-4ee3-a1f8-496c63edf3f2 tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] 10.222.0.49 "DELETE /compute/v2.1/servers/c8de7730-62f2-4a77-b1e9-cf6a74fa366d" status: 404 len: 111 microversion: 2.20 time: 0.039608 Dec 14 13:05:13.190395 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: [pid: 116064|app: 0|req: 470/960] 10.222.0.49 () {60 vars in 1279 bytes} [Tue Dec 14 13:05:13 2021] DELETE /compute/v2.1/servers/c8de7730-62f2-4a77-b1e9-cf6a74fa366d => generated 111 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Dec 14 13:05:13.201023 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.api.openstack.wsgi [None req-f9c94206-a538-426c-99cc-97acc5785373 tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] Calling method '>' {{(pid=116063) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 13:05:13.202089 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.compute.api [None req-f9c94206-a538-426c-99cc-97acc5785373 tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] [instance: c8de7730-62f2-4a77-b1e9-cf6a74fa366d] Fetching instance by UUID {{(pid=116063) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 13:05:13.208705 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-f9c94206-a538-426c-99cc-97acc5785373 tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 13:05:13.212804 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-f9c94206-a538-426c-99cc-97acc5785373 tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 13:05:13.213875 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-f9c94206-a538-426c-99cc-97acc5785373 tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 13:05:13.214311 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-f9c94206-a538-426c-99cc-97acc5785373 tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 13:05:13.229309 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: INFO nova.api.openstack.wsgi [None req-f9c94206-a538-426c-99cc-97acc5785373 tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] HTTP exception thrown: Instance c8de7730-62f2-4a77-b1e9-cf6a74fa366d could not be found. Dec 14 13:05:13.230131 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.api.openstack.wsgi [None req-f9c94206-a538-426c-99cc-97acc5785373 tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] Returning 404 to user: Instance c8de7730-62f2-4a77-b1e9-cf6a74fa366d could not be found. {{(pid=116063) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 14 13:05:13.230924 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: INFO nova.api.openstack.requestlog [None req-f9c94206-a538-426c-99cc-97acc5785373 tempest-AttachVolumeShelveTestJSON-879872614 tempest-AttachVolumeShelveTestJSON-879872614-project] 10.222.0.49 "GET /compute/v2.1/servers/c8de7730-62f2-4a77-b1e9-cf6a74fa366d" status: 404 len: 111 microversion: 2.20 time: 0.036264 Dec 14 13:05:13.231784 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: [pid: 116063|app: 0|req: 491/961] 10.222.0.49 () {60 vars in 1276 bytes} [Tue Dec 14 13:05:13 2021] GET /compute/v2.1/servers/c8de7730-62f2-4a77-b1e9-cf6a74fa366d => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Dec 14 13:05:25.482451 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.api.openstack.wsgi [None req-3dcf3a19-4755-4c33-98dd-aa85ccd6993e tempest-AttachVolumeTestJSON-709357402 tempest-AttachVolumeTestJSON-709357402-project] Calling method '>' {{(pid=116064) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 13:05:25.483375 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.compute.api [None req-3dcf3a19-4755-4c33-98dd-aa85ccd6993e tempest-AttachVolumeTestJSON-709357402 tempest-AttachVolumeTestJSON-709357402-project] [instance: 1b8e1f2f-c109-4413-9d56-33ef0b651f85] Fetching instance by UUID {{(pid=116064) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 13:05:25.489698 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-3dcf3a19-4755-4c33-98dd-aa85ccd6993e tempest-AttachVolumeTestJSON-709357402 tempest-AttachVolumeTestJSON-709357402-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 13:05:25.490105 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-3dcf3a19-4755-4c33-98dd-aa85ccd6993e tempest-AttachVolumeTestJSON-709357402 tempest-AttachVolumeTestJSON-709357402-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 13:05:25.490892 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-3dcf3a19-4755-4c33-98dd-aa85ccd6993e tempest-AttachVolumeTestJSON-709357402 tempest-AttachVolumeTestJSON-709357402-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 13:05:25.491335 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-3dcf3a19-4755-4c33-98dd-aa85ccd6993e tempest-AttachVolumeTestJSON-709357402 tempest-AttachVolumeTestJSON-709357402-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 13:05:25.520020 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: INFO nova.api.openstack.requestlog [None req-3dcf3a19-4755-4c33-98dd-aa85ccd6993e tempest-AttachVolumeTestJSON-709357402 tempest-AttachVolumeTestJSON-709357402-project] 10.222.0.49 "GET /compute/v2.1/servers/1b8e1f2f-c109-4413-9d56-33ef0b651f85/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.042065 Dec 14 13:05:25.520556 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: [pid: 116064|app: 0|req: 471/962] 10.222.0.49 () {58 vars in 1301 bytes} [Tue Dec 14 13:05:25 2021] GET /compute/v2.1/servers/1b8e1f2f-c109-4413-9d56-33ef0b651f85/os-volume_attachments => generated 25 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Dec 14 13:05:25.586928 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.api.openstack.wsgi [None req-94b412a5-7b81-4872-94f1-3d4a2bde1c8a tempest-AttachVolumeTestJSON-709357402 tempest-AttachVolumeTestJSON-709357402-project] Calling method '>' {{(pid=116063) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 13:05:25.587480 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.compute.api [None req-94b412a5-7b81-4872-94f1-3d4a2bde1c8a tempest-AttachVolumeTestJSON-709357402 tempest-AttachVolumeTestJSON-709357402-project] [instance: 1b8e1f2f-c109-4413-9d56-33ef0b651f85] Fetching instance by UUID {{(pid=116063) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 13:05:25.593769 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-94b412a5-7b81-4872-94f1-3d4a2bde1c8a tempest-AttachVolumeTestJSON-709357402 tempest-AttachVolumeTestJSON-709357402-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 13:05:25.594196 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-94b412a5-7b81-4872-94f1-3d4a2bde1c8a tempest-AttachVolumeTestJSON-709357402 tempest-AttachVolumeTestJSON-709357402-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 13:05:25.594972 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-94b412a5-7b81-4872-94f1-3d4a2bde1c8a tempest-AttachVolumeTestJSON-709357402 tempest-AttachVolumeTestJSON-709357402-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 13:05:25.595395 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-94b412a5-7b81-4872-94f1-3d4a2bde1c8a tempest-AttachVolumeTestJSON-709357402 tempest-AttachVolumeTestJSON-709357402-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 13:05:25.621200 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.compute.api [None req-94b412a5-7b81-4872-94f1-3d4a2bde1c8a tempest-AttachVolumeTestJSON-709357402 tempest-AttachVolumeTestJSON-709357402-project] [instance: 1b8e1f2f-c109-4413-9d56-33ef0b651f85] Going to try to terminate instance {{(pid=116063) delete /opt/stack/nova/nova/compute/api.py:2614}} Dec 14 13:05:25.697129 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: INFO nova.api.openstack.requestlog [None req-94b412a5-7b81-4872-94f1-3d4a2bde1c8a tempest-AttachVolumeTestJSON-709357402 tempest-AttachVolumeTestJSON-709357402-project] 10.222.0.49 "DELETE /compute/v2.1/servers/1b8e1f2f-c109-4413-9d56-33ef0b651f85" status: 204 len: 0 microversion: 2.1 time: 0.113949 Dec 14 13:05:25.697712 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: [pid: 116063|app: 0|req: 492/963] 10.222.0.49 () {58 vars in 1238 bytes} [Tue Dec 14 13:05:25 2021] DELETE /compute/v2.1/servers/1b8e1f2f-c109-4413-9d56-33ef0b651f85 => generated 0 bytes in 116 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Dec 14 13:05:25.705815 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.api.openstack.wsgi [None req-904e7e6a-e0e9-4bf0-bcf4-b0cfdfe055e3 tempest-AttachVolumeTestJSON-709357402 tempest-AttachVolumeTestJSON-709357402-project] Calling method '>' {{(pid=116064) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 13:05:25.706423 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.compute.api [None req-904e7e6a-e0e9-4bf0-bcf4-b0cfdfe055e3 tempest-AttachVolumeTestJSON-709357402 tempest-AttachVolumeTestJSON-709357402-project] [instance: 1b8e1f2f-c109-4413-9d56-33ef0b651f85] Fetching instance by UUID {{(pid=116064) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 13:05:25.712225 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-904e7e6a-e0e9-4bf0-bcf4-b0cfdfe055e3 tempest-AttachVolumeTestJSON-709357402 tempest-AttachVolumeTestJSON-709357402-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 13:05:25.712664 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-904e7e6a-e0e9-4bf0-bcf4-b0cfdfe055e3 tempest-AttachVolumeTestJSON-709357402 tempest-AttachVolumeTestJSON-709357402-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 13:05:25.713579 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-904e7e6a-e0e9-4bf0-bcf4-b0cfdfe055e3 tempest-AttachVolumeTestJSON-709357402 tempest-AttachVolumeTestJSON-709357402-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 13:05:25.714008 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-904e7e6a-e0e9-4bf0-bcf4-b0cfdfe055e3 tempest-AttachVolumeTestJSON-709357402 tempest-AttachVolumeTestJSON-709357402-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 13:05:25.847412 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.policy [None req-904e7e6a-e0e9-4bf0-bcf4-b0cfdfe055e3 tempest-AttachVolumeTestJSON-709357402 tempest-AttachVolumeTestJSON-709357402-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '083128ec42474a3e82a2b0fc8c278f4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b1a390d20a54f4d9529d286ab7764a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116064) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 13:05:25.855242 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: INFO nova.api.openstack.requestlog [None req-904e7e6a-e0e9-4bf0-bcf4-b0cfdfe055e3 tempest-AttachVolumeTestJSON-709357402 tempest-AttachVolumeTestJSON-709357402-project] 10.222.0.49 "GET /compute/v2.1/servers/1b8e1f2f-c109-4413-9d56-33ef0b651f85" status: 200 len: 1673 microversion: 2.1 time: 0.153031 Dec 14 13:05:25.856183 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: [pid: 116064|app: 0|req: 472/964] 10.222.0.49 () {58 vars in 1235 bytes} [Tue Dec 14 13:05:25 2021] GET /compute/v2.1/servers/1b8e1f2f-c109-4413-9d56-33ef0b651f85 => generated 1673 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 14 13:05:26.878026 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.api.openstack.wsgi [None req-18140958-160d-4221-b8e2-e88254cdbf6b tempest-AttachVolumeTestJSON-709357402 tempest-AttachVolumeTestJSON-709357402-project] Calling method '>' {{(pid=116063) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 13:05:26.879207 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.compute.api [None req-18140958-160d-4221-b8e2-e88254cdbf6b tempest-AttachVolumeTestJSON-709357402 tempest-AttachVolumeTestJSON-709357402-project] [instance: 1b8e1f2f-c109-4413-9d56-33ef0b651f85] Fetching instance by UUID {{(pid=116063) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 13:05:26.886379 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-18140958-160d-4221-b8e2-e88254cdbf6b tempest-AttachVolumeTestJSON-709357402 tempest-AttachVolumeTestJSON-709357402-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 13:05:26.886819 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-18140958-160d-4221-b8e2-e88254cdbf6b tempest-AttachVolumeTestJSON-709357402 tempest-AttachVolumeTestJSON-709357402-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 13:05:26.887585 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-18140958-160d-4221-b8e2-e88254cdbf6b tempest-AttachVolumeTestJSON-709357402 tempest-AttachVolumeTestJSON-709357402-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 13:05:26.888012 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-18140958-160d-4221-b8e2-e88254cdbf6b tempest-AttachVolumeTestJSON-709357402 tempest-AttachVolumeTestJSON-709357402-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 13:05:27.023545 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.policy [None req-18140958-160d-4221-b8e2-e88254cdbf6b tempest-AttachVolumeTestJSON-709357402 tempest-AttachVolumeTestJSON-709357402-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '083128ec42474a3e82a2b0fc8c278f4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b1a390d20a54f4d9529d286ab7764a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116063) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 13:05:27.031072 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: INFO nova.api.openstack.requestlog [None req-18140958-160d-4221-b8e2-e88254cdbf6b tempest-AttachVolumeTestJSON-709357402 tempest-AttachVolumeTestJSON-709357402-project] 10.222.0.49 "GET /compute/v2.1/servers/1b8e1f2f-c109-4413-9d56-33ef0b651f85" status: 200 len: 1673 microversion: 2.1 time: 0.159930 Dec 14 13:05:27.031630 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: [pid: 116063|app: 0|req: 493/965] 10.222.0.49 () {58 vars in 1235 bytes} [Tue Dec 14 13:05:26 2021] GET /compute/v2.1/servers/1b8e1f2f-c109-4413-9d56-33ef0b651f85 => generated 1673 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 14 13:05:28.052751 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.api.openstack.wsgi [None req-9da07a5b-688a-4f3c-adcc-6a22154f32c5 tempest-AttachVolumeTestJSON-709357402 tempest-AttachVolumeTestJSON-709357402-project] Calling method '>' {{(pid=116064) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 13:05:28.053804 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.compute.api [None req-9da07a5b-688a-4f3c-adcc-6a22154f32c5 tempest-AttachVolumeTestJSON-709357402 tempest-AttachVolumeTestJSON-709357402-project] [instance: 1b8e1f2f-c109-4413-9d56-33ef0b651f85] Fetching instance by UUID {{(pid=116064) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 13:05:28.064428 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-9da07a5b-688a-4f3c-adcc-6a22154f32c5 tempest-AttachVolumeTestJSON-709357402 tempest-AttachVolumeTestJSON-709357402-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 13:05:28.065250 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-9da07a5b-688a-4f3c-adcc-6a22154f32c5 tempest-AttachVolumeTestJSON-709357402 tempest-AttachVolumeTestJSON-709357402-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 13:05:28.066522 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-9da07a5b-688a-4f3c-adcc-6a22154f32c5 tempest-AttachVolumeTestJSON-709357402 tempest-AttachVolumeTestJSON-709357402-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 13:05:28.067285 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-9da07a5b-688a-4f3c-adcc-6a22154f32c5 tempest-AttachVolumeTestJSON-709357402 tempest-AttachVolumeTestJSON-709357402-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 13:05:28.209000 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.policy [None req-9da07a5b-688a-4f3c-adcc-6a22154f32c5 tempest-AttachVolumeTestJSON-709357402 tempest-AttachVolumeTestJSON-709357402-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '083128ec42474a3e82a2b0fc8c278f4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b1a390d20a54f4d9529d286ab7764a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116064) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 13:05:28.216969 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: INFO nova.api.openstack.requestlog [None req-9da07a5b-688a-4f3c-adcc-6a22154f32c5 tempest-AttachVolumeTestJSON-709357402 tempest-AttachVolumeTestJSON-709357402-project] 10.222.0.49 "GET /compute/v2.1/servers/1b8e1f2f-c109-4413-9d56-33ef0b651f85" status: 200 len: 1673 microversion: 2.1 time: 0.170392 Dec 14 13:05:28.217538 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: [pid: 116064|app: 0|req: 473/966] 10.222.0.49 () {58 vars in 1235 bytes} [Tue Dec 14 13:05:28 2021] GET /compute/v2.1/servers/1b8e1f2f-c109-4413-9d56-33ef0b651f85 => generated 1673 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 14 13:05:29.234551 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.api.openstack.wsgi [None req-a0e5fcf4-37a5-4c39-90b5-703c5e3ee415 tempest-AttachVolumeTestJSON-709357402 tempest-AttachVolumeTestJSON-709357402-project] Calling method '>' {{(pid=116063) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 13:05:29.235224 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.compute.api [None req-a0e5fcf4-37a5-4c39-90b5-703c5e3ee415 tempest-AttachVolumeTestJSON-709357402 tempest-AttachVolumeTestJSON-709357402-project] [instance: 1b8e1f2f-c109-4413-9d56-33ef0b651f85] Fetching instance by UUID {{(pid=116063) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 13:05:29.242420 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-a0e5fcf4-37a5-4c39-90b5-703c5e3ee415 tempest-AttachVolumeTestJSON-709357402 tempest-AttachVolumeTestJSON-709357402-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 13:05:29.242918 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-a0e5fcf4-37a5-4c39-90b5-703c5e3ee415 tempest-AttachVolumeTestJSON-709357402 tempest-AttachVolumeTestJSON-709357402-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 13:05:29.243773 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-a0e5fcf4-37a5-4c39-90b5-703c5e3ee415 tempest-AttachVolumeTestJSON-709357402 tempest-AttachVolumeTestJSON-709357402-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 13:05:29.244249 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-a0e5fcf4-37a5-4c39-90b5-703c5e3ee415 tempest-AttachVolumeTestJSON-709357402 tempest-AttachVolumeTestJSON-709357402-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 13:05:29.379307 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.policy [None req-a0e5fcf4-37a5-4c39-90b5-703c5e3ee415 tempest-AttachVolumeTestJSON-709357402 tempest-AttachVolumeTestJSON-709357402-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '083128ec42474a3e82a2b0fc8c278f4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b1a390d20a54f4d9529d286ab7764a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116063) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 13:05:29.386759 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: INFO nova.api.openstack.requestlog [None req-a0e5fcf4-37a5-4c39-90b5-703c5e3ee415 tempest-AttachVolumeTestJSON-709357402 tempest-AttachVolumeTestJSON-709357402-project] 10.222.0.49 "GET /compute/v2.1/servers/1b8e1f2f-c109-4413-9d56-33ef0b651f85" status: 200 len: 1673 microversion: 2.1 time: 0.156271 Dec 14 13:05:29.387329 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: [pid: 116063|app: 0|req: 494/967] 10.222.0.49 () {58 vars in 1235 bytes} [Tue Dec 14 13:05:29 2021] GET /compute/v2.1/servers/1b8e1f2f-c109-4413-9d56-33ef0b651f85 => generated 1673 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 14 13:05:30.403213 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.api.openstack.wsgi [None req-8cbbc6d5-30c1-444a-9727-1eb62ce4cd10 tempest-AttachVolumeTestJSON-709357402 tempest-AttachVolumeTestJSON-709357402-project] Calling method '>' {{(pid=116064) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 13:05:30.404649 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.compute.api [None req-8cbbc6d5-30c1-444a-9727-1eb62ce4cd10 tempest-AttachVolumeTestJSON-709357402 tempest-AttachVolumeTestJSON-709357402-project] [instance: 1b8e1f2f-c109-4413-9d56-33ef0b651f85] Fetching instance by UUID {{(pid=116064) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 13:05:30.413553 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-8cbbc6d5-30c1-444a-9727-1eb62ce4cd10 tempest-AttachVolumeTestJSON-709357402 tempest-AttachVolumeTestJSON-709357402-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 13:05:30.414107 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-8cbbc6d5-30c1-444a-9727-1eb62ce4cd10 tempest-AttachVolumeTestJSON-709357402 tempest-AttachVolumeTestJSON-709357402-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 13:05:30.415124 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-8cbbc6d5-30c1-444a-9727-1eb62ce4cd10 tempest-AttachVolumeTestJSON-709357402 tempest-AttachVolumeTestJSON-709357402-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 13:05:30.416017 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-8cbbc6d5-30c1-444a-9727-1eb62ce4cd10 tempest-AttachVolumeTestJSON-709357402 tempest-AttachVolumeTestJSON-709357402-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 13:05:30.466868 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.api.openstack.wsgi [req-90efe453-0ae1-49db-92c9-46e911866d80 req-49de48b7-9134-471d-a60f-2d8767c5a6c5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1b8e1f2f-c109-4413-9d56-33ef0b651f85", "name": "network-vif-deleted", "tag": "a2ba138b-4125-4b6b-ab4d-99c16d8b8a80"}]} {{(pid=116063) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 14 13:05:30.468342 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 14 13:05:30.468342 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: warnings.warn(msg) Dec 14 13:05:30.475877 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [req-90efe453-0ae1-49db-92c9-46e911866d80 req-49de48b7-9134-471d-a60f-2d8767c5a6c5 service nova] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 13:05:30.476329 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [req-90efe453-0ae1-49db-92c9-46e911866d80 req-49de48b7-9134-471d-a60f-2d8767c5a6c5 service nova] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 13:05:30.487283 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: INFO nova.api.openstack.compute.server_external_events [req-90efe453-0ae1-49db-92c9-46e911866d80 req-49de48b7-9134-471d-a60f-2d8767c5a6c5 service nova] Creating event network-vif-deleted:a2ba138b-4125-4b6b-ab4d-99c16d8b8a80 for instance 1b8e1f2f-c109-4413-9d56-33ef0b651f85 on hv-cinder-78447 Dec 14 13:05:30.492608 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: INFO nova.api.openstack.requestlog [req-90efe453-0ae1-49db-92c9-46e911866d80 req-49de48b7-9134-471d-a60f-2d8767c5a6c5 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029657 Dec 14 13:05:30.496142 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: [pid: 116063|app: 0|req: 495/968] 10.222.0.49 () {64 vars in 1317 bytes} [Tue Dec 14 13:05:30 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Dec 14 13:05:30.513361 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.policy [None req-8cbbc6d5-30c1-444a-9727-1eb62ce4cd10 tempest-AttachVolumeTestJSON-709357402 tempest-AttachVolumeTestJSON-709357402-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '083128ec42474a3e82a2b0fc8c278f4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b1a390d20a54f4d9529d286ab7764a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116064) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 13:05:30.521168 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: INFO nova.api.openstack.requestlog [None req-8cbbc6d5-30c1-444a-9727-1eb62ce4cd10 tempest-AttachVolumeTestJSON-709357402 tempest-AttachVolumeTestJSON-709357402-project] 10.222.0.49 "GET /compute/v2.1/servers/1b8e1f2f-c109-4413-9d56-33ef0b651f85" status: 200 len: 1605 microversion: 2.1 time: 0.121460 Dec 14 13:05:30.521932 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: [pid: 116064|app: 0|req: 474/969] 10.222.0.49 () {58 vars in 1235 bytes} [Tue Dec 14 13:05:30 2021] GET /compute/v2.1/servers/1b8e1f2f-c109-4413-9d56-33ef0b651f85 => generated 1605 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 14 13:05:31.540021 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.api.openstack.wsgi [None req-ecd3e518-20d7-42f9-ba14-cb70fcef1296 tempest-AttachVolumeTestJSON-709357402 tempest-AttachVolumeTestJSON-709357402-project] Calling method '>' {{(pid=116063) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 13:05:31.541440 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.compute.api [None req-ecd3e518-20d7-42f9-ba14-cb70fcef1296 tempest-AttachVolumeTestJSON-709357402 tempest-AttachVolumeTestJSON-709357402-project] [instance: 1b8e1f2f-c109-4413-9d56-33ef0b651f85] Fetching instance by UUID {{(pid=116063) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 13:05:31.547919 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-ecd3e518-20d7-42f9-ba14-cb70fcef1296 tempest-AttachVolumeTestJSON-709357402 tempest-AttachVolumeTestJSON-709357402-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 13:05:31.548468 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-ecd3e518-20d7-42f9-ba14-cb70fcef1296 tempest-AttachVolumeTestJSON-709357402 tempest-AttachVolumeTestJSON-709357402-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 13:05:31.549576 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-ecd3e518-20d7-42f9-ba14-cb70fcef1296 tempest-AttachVolumeTestJSON-709357402 tempest-AttachVolumeTestJSON-709357402-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 13:05:31.550267 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-ecd3e518-20d7-42f9-ba14-cb70fcef1296 tempest-AttachVolumeTestJSON-709357402 tempest-AttachVolumeTestJSON-709357402-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 13:05:31.564362 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: INFO nova.api.openstack.wsgi [None req-ecd3e518-20d7-42f9-ba14-cb70fcef1296 tempest-AttachVolumeTestJSON-709357402 tempest-AttachVolumeTestJSON-709357402-project] HTTP exception thrown: Instance 1b8e1f2f-c109-4413-9d56-33ef0b651f85 could not be found. Dec 14 13:05:31.564977 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.api.openstack.wsgi [None req-ecd3e518-20d7-42f9-ba14-cb70fcef1296 tempest-AttachVolumeTestJSON-709357402 tempest-AttachVolumeTestJSON-709357402-project] Returning 404 to user: Instance 1b8e1f2f-c109-4413-9d56-33ef0b651f85 could not be found. {{(pid=116063) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 14 13:05:31.565798 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: INFO nova.api.openstack.requestlog [None req-ecd3e518-20d7-42f9-ba14-cb70fcef1296 tempest-AttachVolumeTestJSON-709357402 tempest-AttachVolumeTestJSON-709357402-project] 10.222.0.49 "GET /compute/v2.1/servers/1b8e1f2f-c109-4413-9d56-33ef0b651f85" status: 404 len: 111 microversion: 2.1 time: 0.030762 Dec 14 13:05:31.566325 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: [pid: 116063|app: 0|req: 496/970] 10.222.0.49 () {58 vars in 1235 bytes} [Tue Dec 14 13:05:31 2021] GET /compute/v2.1/servers/1b8e1f2f-c109-4413-9d56-33ef0b651f85 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Dec 14 13:05:31.574389 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.api.openstack.wsgi [None req-946b77b9-35fe-46fd-8ba8-ee16ad4bc196 tempest-AttachVolumeTestJSON-709357402 tempest-AttachVolumeTestJSON-709357402-project] Calling method '.version_select at 0x7f2ace4350d0>' {{(pid=116064) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 13:05:31.591597 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: INFO nova.api.openstack.requestlog [None req-946b77b9-35fe-46fd-8ba8-ee16ad4bc196 tempest-AttachVolumeTestJSON-709357402 tempest-AttachVolumeTestJSON-709357402-project] 10.222.0.49 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1366229700" status: 202 len: 0 microversion: 2.1 time: 0.020783 Dec 14 13:05:31.592288 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: [pid: 116064|app: 0|req: 475/971] 10.222.0.49 () {58 vars in 1220 bytes} [Tue Dec 14 13:05:31 2021] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1366229700 => generated 0 bytes in 22 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Dec 14 13:05:32.254797 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.api.openstack.wsgi [None req-8dcc4597-a077-45bb-90a7-f1c9ea4bebf0 tempest-AttachVolumeTestJSON-709357402 tempest-AttachVolumeTestJSON-709357402-project] Action: 'create', calling method: .version_select at 0x7f2acd9825e0>, body: {"keypair": {"name": "tempest-keypair-1344262871"}} {{(pid=116063) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 14 13:05:32.268878 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.quota [None req-8dcc4597-a077-45bb-90a7-f1c9ea4bebf0 tempest-AttachVolumeTestJSON-709357402 tempest-AttachVolumeTestJSON-709357402-project] Getting quotas for project 8b1a390d20a54f4d9529d286ab7764a5. Resources: {'key_pairs'} {{(pid=116063) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 14 13:05:32.272958 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.quota [None req-8dcc4597-a077-45bb-90a7-f1c9ea4bebf0 tempest-AttachVolumeTestJSON-709357402 tempest-AttachVolumeTestJSON-709357402-project] Getting quotas for user 083128ec42474a3e82a2b0fc8c278f4d and project 8b1a390d20a54f4d9529d286ab7764a5. Resources: {'key_pairs'} {{(pid=116063) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 14 13:05:32.375033 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.quota [None req-8dcc4597-a077-45bb-90a7-f1c9ea4bebf0 tempest-AttachVolumeTestJSON-709357402 tempest-AttachVolumeTestJSON-709357402-project] Getting quotas for project 8b1a390d20a54f4d9529d286ab7764a5. Resources: {'key_pairs'} {{(pid=116063) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 14 13:05:32.378735 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.quota [None req-8dcc4597-a077-45bb-90a7-f1c9ea4bebf0 tempest-AttachVolumeTestJSON-709357402 tempest-AttachVolumeTestJSON-709357402-project] Getting quotas for user 083128ec42474a3e82a2b0fc8c278f4d and project 8b1a390d20a54f4d9529d286ab7764a5. Resources: {'key_pairs'} {{(pid=116063) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 14 13:05:32.391497 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: INFO nova.api.openstack.requestlog [None req-8dcc4597-a077-45bb-90a7-f1c9ea4bebf0 tempest-AttachVolumeTestJSON-709357402 tempest-AttachVolumeTestJSON-709357402-project] 10.222.0.49 "POST /compute/v2.1/os-keypairs" status: 200 len: 2301 microversion: 2.1 time: 0.142276 Dec 14 13:05:32.392079 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: [pid: 116063|app: 0|req: 497/972] 10.222.0.49 () {60 vars in 1157 bytes} [Tue Dec 14 13:05:32 2021] POST /compute/v2.1/os-keypairs => generated 2301 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 14 13:05:33.713172 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.api.openstack.wsgi [None req-a24fa1bb-6c28-48eb-beaf-6a0eec8497c5 tempest-AttachVolumeTestJSON-709357402 tempest-AttachVolumeTestJSON-709357402-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-397980384", "imageRef": "1733dcd4-5ded-44e1-8b8d-392adb05c67a", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "bd1c5b8e-76aa-4f4c-95ad-0b8348f823dc"}], "security_groups": [{"name": "tempest-securitygroup--2147406858"}], "key_name": "tempest-keypair-1344262871", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=116064) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 14 13:05:33.820452 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.network.neutron [None req-a24fa1bb-6c28-48eb-beaf-6a0eec8497c5 tempest-AttachVolumeTestJSON-709357402 tempest-AttachVolumeTestJSON-709357402-project] validate_networks() for [('bd1c5b8e-76aa-4f4c-95ad-0b8348f823dc', None, None, None, None, None)] {{(pid=116064) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Dec 14 13:05:34.190325 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.virt.hardware [None req-a24fa1bb-6c28-48eb-beaf-6a0eec8497c5 tempest-AttachVolumeTestJSON-709357402 tempest-AttachVolumeTestJSON-709357402-project] Flavor limits 0:0:0 {{(pid=116064) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Dec 14 13:05:34.190754 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.virt.hardware [None req-a24fa1bb-6c28-48eb-beaf-6a0eec8497c5 tempest-AttachVolumeTestJSON-709357402 tempest-AttachVolumeTestJSON-709357402-project] Image limits 0:0:0 {{(pid=116064) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Dec 14 13:05:34.191226 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.virt.hardware [None req-a24fa1bb-6c28-48eb-beaf-6a0eec8497c5 tempest-AttachVolumeTestJSON-709357402 tempest-AttachVolumeTestJSON-709357402-project] Flavor pref 0:0:0 {{(pid=116064) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Dec 14 13:05:34.191636 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.virt.hardware [None req-a24fa1bb-6c28-48eb-beaf-6a0eec8497c5 tempest-AttachVolumeTestJSON-709357402 tempest-AttachVolumeTestJSON-709357402-project] Image pref 0:0:0 {{(pid=116064) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Dec 14 13:05:34.192050 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.virt.hardware [None req-a24fa1bb-6c28-48eb-beaf-6a0eec8497c5 tempest-AttachVolumeTestJSON-709357402 tempest-AttachVolumeTestJSON-709357402-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=116064) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Dec 14 13:05:34.203790 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-a24fa1bb-6c28-48eb-beaf-6a0eec8497c5 tempest-AttachVolumeTestJSON-709357402 tempest-AttachVolumeTestJSON-709357402-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 13:05:34.204400 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-a24fa1bb-6c28-48eb-beaf-6a0eec8497c5 tempest-AttachVolumeTestJSON-709357402 tempest-AttachVolumeTestJSON-709357402-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 13:05:34.205724 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-a24fa1bb-6c28-48eb-beaf-6a0eec8497c5 tempest-AttachVolumeTestJSON-709357402 tempest-AttachVolumeTestJSON-709357402-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 13:05:34.206331 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-a24fa1bb-6c28-48eb-beaf-6a0eec8497c5 tempest-AttachVolumeTestJSON-709357402 tempest-AttachVolumeTestJSON-709357402-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 13:05:34.223184 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.quota [None req-a24fa1bb-6c28-48eb-beaf-6a0eec8497c5 tempest-AttachVolumeTestJSON-709357402 tempest-AttachVolumeTestJSON-709357402-project] Getting quotas for project 8b1a390d20a54f4d9529d286ab7764a5. Resources: {'cores', 'instances', 'ram'} {{(pid=116064) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 14 13:05:34.227208 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.quota [None req-a24fa1bb-6c28-48eb-beaf-6a0eec8497c5 tempest-AttachVolumeTestJSON-709357402 tempest-AttachVolumeTestJSON-709357402-project] Getting quotas for user 083128ec42474a3e82a2b0fc8c278f4d and project 8b1a390d20a54f4d9529d286ab7764a5. Resources: {'cores', 'instances', 'ram'} {{(pid=116064) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 14 13:05:34.238724 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.compute.api [None req-a24fa1bb-6c28-48eb-beaf-6a0eec8497c5 tempest-AttachVolumeTestJSON-709357402 tempest-AttachVolumeTestJSON-709357402-project] Going to run 1 instances... {{(pid=116064) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Dec 14 13:05:34.241256 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.compute.api [None req-a24fa1bb-6c28-48eb-beaf-6a0eec8497c5 tempest-AttachVolumeTestJSON-709357402 tempest-AttachVolumeTestJSON-709357402-project] [instance: bcb32a16-9097-40bc-9cd9-eee14f505d1d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='1733dcd4-5ded-44e1-8b8d-392adb05c67a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=116064) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Dec 14 13:05:34.290301 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: INFO nova.api.openstack.requestlog [None req-a24fa1bb-6c28-48eb-beaf-6a0eec8497c5 tempest-AttachVolumeTestJSON-709357402 tempest-AttachVolumeTestJSON-709357402-project] 10.222.0.49 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.581671 Dec 14 13:05:34.291273 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: [pid: 116064|app: 0|req: 476/973] 10.222.0.49 () {60 vars in 1146 bytes} [Tue Dec 14 13:05:33 2021] POST /compute/v2.1/servers => generated 402 bytes in 583 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Dec 14 13:05:34.301848 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.api.openstack.wsgi [None req-30a84cd9-0782-48b7-bf9f-4bca2ef4a7f6 tempest-AttachVolumeTestJSON-709357402 tempest-AttachVolumeTestJSON-709357402-project] Calling method '>' {{(pid=116063) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 13:05:34.302534 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.compute.api [None req-30a84cd9-0782-48b7-bf9f-4bca2ef4a7f6 tempest-AttachVolumeTestJSON-709357402 tempest-AttachVolumeTestJSON-709357402-project] [instance: bcb32a16-9097-40bc-9cd9-eee14f505d1d] Fetching instance by UUID {{(pid=116063) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 13:05:34.356128 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.policy [None req-30a84cd9-0782-48b7-bf9f-4bca2ef4a7f6 tempest-AttachVolumeTestJSON-709357402 tempest-AttachVolumeTestJSON-709357402-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '083128ec42474a3e82a2b0fc8c278f4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b1a390d20a54f4d9529d286ab7764a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116063) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 13:05:34.363593 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: INFO nova.api.openstack.requestlog [None req-30a84cd9-0782-48b7-bf9f-4bca2ef4a7f6 tempest-AttachVolumeTestJSON-709357402 tempest-AttachVolumeTestJSON-709357402-project] 10.222.0.49 "GET /compute/v2.1/servers/bcb32a16-9097-40bc-9cd9-eee14f505d1d" status: 200 len: 1237 microversion: 2.1 time: 0.065976 Dec 14 13:05:34.364144 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: [pid: 116063|app: 0|req: 498/974] 10.222.0.49 () {58 vars in 1235 bytes} [Tue Dec 14 13:05:34 2021] GET /compute/v2.1/servers/bcb32a16-9097-40bc-9cd9-eee14f505d1d => generated 1237 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 14 13:05:35.380081 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.api.openstack.wsgi [None req-9e1d333a-f01d-45e2-8bcd-65b813e3768a tempest-AttachVolumeTestJSON-709357402 tempest-AttachVolumeTestJSON-709357402-project] Calling method '>' {{(pid=116064) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 13:05:35.380898 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.compute.api [None req-9e1d333a-f01d-45e2-8bcd-65b813e3768a tempest-AttachVolumeTestJSON-709357402 tempest-AttachVolumeTestJSON-709357402-project] [instance: bcb32a16-9097-40bc-9cd9-eee14f505d1d] Fetching instance by UUID {{(pid=116064) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 13:05:35.387741 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-9e1d333a-f01d-45e2-8bcd-65b813e3768a tempest-AttachVolumeTestJSON-709357402 tempest-AttachVolumeTestJSON-709357402-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 13:05:35.388194 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-9e1d333a-f01d-45e2-8bcd-65b813e3768a tempest-AttachVolumeTestJSON-709357402 tempest-AttachVolumeTestJSON-709357402-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 13:05:35.389017 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-9e1d333a-f01d-45e2-8bcd-65b813e3768a tempest-AttachVolumeTestJSON-709357402 tempest-AttachVolumeTestJSON-709357402-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 13:05:35.389461 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-9e1d333a-f01d-45e2-8bcd-65b813e3768a tempest-AttachVolumeTestJSON-709357402 tempest-AttachVolumeTestJSON-709357402-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 13:05:35.449958 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.policy [None req-9e1d333a-f01d-45e2-8bcd-65b813e3768a tempest-AttachVolumeTestJSON-709357402 tempest-AttachVolumeTestJSON-709357402-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '083128ec42474a3e82a2b0fc8c278f4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b1a390d20a54f4d9529d286ab7764a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116064) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 13:05:35.457601 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: INFO nova.api.openstack.requestlog [None req-9e1d333a-f01d-45e2-8bcd-65b813e3768a tempest-AttachVolumeTestJSON-709357402 tempest-AttachVolumeTestJSON-709357402-project] 10.222.0.49 "GET /compute/v2.1/servers/bcb32a16-9097-40bc-9cd9-eee14f505d1d" status: 200 len: 1295 microversion: 2.1 time: 0.082005 Dec 14 13:05:35.458200 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: [pid: 116064|app: 0|req: 477/975] 10.222.0.49 () {58 vars in 1235 bytes} [Tue Dec 14 13:05:35 2021] GET /compute/v2.1/servers/bcb32a16-9097-40bc-9cd9-eee14f505d1d => generated 1295 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 14 13:05:36.475019 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.api.openstack.wsgi [None req-26927b90-4647-40ae-bb5b-d1731431fb27 tempest-AttachVolumeTestJSON-709357402 tempest-AttachVolumeTestJSON-709357402-project] Calling method '>' {{(pid=116063) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 13:05:36.475622 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.compute.api [None req-26927b90-4647-40ae-bb5b-d1731431fb27 tempest-AttachVolumeTestJSON-709357402 tempest-AttachVolumeTestJSON-709357402-project] [instance: bcb32a16-9097-40bc-9cd9-eee14f505d1d] Fetching instance by UUID {{(pid=116063) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 13:05:36.482311 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-26927b90-4647-40ae-bb5b-d1731431fb27 tempest-AttachVolumeTestJSON-709357402 tempest-AttachVolumeTestJSON-709357402-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 13:05:36.482733 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-26927b90-4647-40ae-bb5b-d1731431fb27 tempest-AttachVolumeTestJSON-709357402 tempest-AttachVolumeTestJSON-709357402-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 13:05:36.483728 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-26927b90-4647-40ae-bb5b-d1731431fb27 tempest-AttachVolumeTestJSON-709357402 tempest-AttachVolumeTestJSON-709357402-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 13:05:36.484151 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-26927b90-4647-40ae-bb5b-d1731431fb27 tempest-AttachVolumeTestJSON-709357402 tempest-AttachVolumeTestJSON-709357402-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 13:05:36.584400 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.api.openstack.wsgi [req-fcad02af-5eb6-4894-965e-a8f1f1daae7f req-577ea155-d9e1-4d4d-8107-154c851ba52a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bcb32a16-9097-40bc-9cd9-eee14f505d1d", "tag": "f2dc7c1b-e719-44e8-b9aa-992821506ebe"}]} {{(pid=116064) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 14 13:05:36.586147 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 14 13:05:36.586147 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: warnings.warn(msg) Dec 14 13:05:36.600032 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [req-fcad02af-5eb6-4894-965e-a8f1f1daae7f req-577ea155-d9e1-4d4d-8107-154c851ba52a service nova] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 13:05:36.609607 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [req-fcad02af-5eb6-4894-965e-a8f1f1daae7f req-577ea155-d9e1-4d4d-8107-154c851ba52a service nova] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 13:05:36.632004 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: INFO nova.api.openstack.compute.server_external_events [req-fcad02af-5eb6-4894-965e-a8f1f1daae7f req-577ea155-d9e1-4d4d-8107-154c851ba52a service nova] Creating event network-changed:f2dc7c1b-e719-44e8-b9aa-992821506ebe for instance bcb32a16-9097-40bc-9cd9-eee14f505d1d on hv-cinder-78447 Dec 14 13:05:36.640000 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: INFO nova.api.openstack.requestlog [req-fcad02af-5eb6-4894-965e-a8f1f1daae7f req-577ea155-d9e1-4d4d-8107-154c851ba52a service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.060843 Dec 14 13:05:36.640898 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: [pid: 116064|app: 0|req: 478/976] 10.222.0.49 () {64 vars in 1317 bytes} [Tue Dec 14 13:05:36 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Dec 14 13:05:36.642876 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.policy [None req-26927b90-4647-40ae-bb5b-d1731431fb27 tempest-AttachVolumeTestJSON-709357402 tempest-AttachVolumeTestJSON-709357402-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '083128ec42474a3e82a2b0fc8c278f4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b1a390d20a54f4d9529d286ab7764a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116063) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 13:05:36.650755 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: INFO nova.api.openstack.requestlog [None req-26927b90-4647-40ae-bb5b-d1731431fb27 tempest-AttachVolumeTestJSON-709357402 tempest-AttachVolumeTestJSON-709357402-project] 10.222.0.49 "GET /compute/v2.1/servers/bcb32a16-9097-40bc-9cd9-eee14f505d1d" status: 200 len: 1363 microversion: 2.1 time: 0.179446 Dec 14 13:05:36.651555 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: [pid: 116063|app: 0|req: 499/977] 10.222.0.49 () {58 vars in 1235 bytes} [Tue Dec 14 13:05:36 2021] GET /compute/v2.1/servers/bcb32a16-9097-40bc-9cd9-eee14f505d1d => generated 1363 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 14 13:05:37.670953 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.api.openstack.wsgi [None req-54ee7f44-736c-4f74-8601-d628ece06a66 tempest-AttachVolumeTestJSON-709357402 tempest-AttachVolumeTestJSON-709357402-project] Calling method '>' {{(pid=116064) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 13:05:37.671864 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.compute.api [None req-54ee7f44-736c-4f74-8601-d628ece06a66 tempest-AttachVolumeTestJSON-709357402 tempest-AttachVolumeTestJSON-709357402-project] [instance: bcb32a16-9097-40bc-9cd9-eee14f505d1d] Fetching instance by UUID {{(pid=116064) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 13:05:37.680351 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-54ee7f44-736c-4f74-8601-d628ece06a66 tempest-AttachVolumeTestJSON-709357402 tempest-AttachVolumeTestJSON-709357402-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 13:05:37.680799 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-54ee7f44-736c-4f74-8601-d628ece06a66 tempest-AttachVolumeTestJSON-709357402 tempest-AttachVolumeTestJSON-709357402-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 13:05:37.681613 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-54ee7f44-736c-4f74-8601-d628ece06a66 tempest-AttachVolumeTestJSON-709357402 tempest-AttachVolumeTestJSON-709357402-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 13:05:37.682045 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-54ee7f44-736c-4f74-8601-d628ece06a66 tempest-AttachVolumeTestJSON-709357402 tempest-AttachVolumeTestJSON-709357402-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 13:05:37.833396 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.policy [None req-54ee7f44-736c-4f74-8601-d628ece06a66 tempest-AttachVolumeTestJSON-709357402 tempest-AttachVolumeTestJSON-709357402-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '083128ec42474a3e82a2b0fc8c278f4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b1a390d20a54f4d9529d286ab7764a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116064) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 13:05:37.841698 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: INFO nova.api.openstack.requestlog [None req-54ee7f44-736c-4f74-8601-d628ece06a66 tempest-AttachVolumeTestJSON-709357402 tempest-AttachVolumeTestJSON-709357402-project] 10.222.0.49 "GET /compute/v2.1/servers/bcb32a16-9097-40bc-9cd9-eee14f505d1d" status: 200 len: 1363 microversion: 2.1 time: 0.176725 Dec 14 13:05:37.842284 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: [pid: 116064|app: 0|req: 479/978] 10.222.0.49 () {58 vars in 1235 bytes} [Tue Dec 14 13:05:37 2021] GET /compute/v2.1/servers/bcb32a16-9097-40bc-9cd9-eee14f505d1d => generated 1363 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 14 13:05:38.862415 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.api.openstack.wsgi [None req-dc4a375e-c6b0-4a99-98b1-10dd382b6f2e tempest-AttachVolumeTestJSON-709357402 tempest-AttachVolumeTestJSON-709357402-project] Calling method '>' {{(pid=116063) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 13:05:38.863411 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.compute.api [None req-dc4a375e-c6b0-4a99-98b1-10dd382b6f2e tempest-AttachVolumeTestJSON-709357402 tempest-AttachVolumeTestJSON-709357402-project] [instance: bcb32a16-9097-40bc-9cd9-eee14f505d1d] Fetching instance by UUID {{(pid=116063) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 13:05:38.874234 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-dc4a375e-c6b0-4a99-98b1-10dd382b6f2e tempest-AttachVolumeTestJSON-709357402 tempest-AttachVolumeTestJSON-709357402-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 13:05:38.874808 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-dc4a375e-c6b0-4a99-98b1-10dd382b6f2e tempest-AttachVolumeTestJSON-709357402 tempest-AttachVolumeTestJSON-709357402-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 13:05:38.875863 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-dc4a375e-c6b0-4a99-98b1-10dd382b6f2e tempest-AttachVolumeTestJSON-709357402 tempest-AttachVolumeTestJSON-709357402-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 13:05:38.876417 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-dc4a375e-c6b0-4a99-98b1-10dd382b6f2e tempest-AttachVolumeTestJSON-709357402 tempest-AttachVolumeTestJSON-709357402-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 13:05:39.013724 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.policy [None req-dc4a375e-c6b0-4a99-98b1-10dd382b6f2e tempest-AttachVolumeTestJSON-709357402 tempest-AttachVolumeTestJSON-709357402-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '083128ec42474a3e82a2b0fc8c278f4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b1a390d20a54f4d9529d286ab7764a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116063) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 13:05:39.021284 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: INFO nova.api.openstack.requestlog [None req-dc4a375e-c6b0-4a99-98b1-10dd382b6f2e tempest-AttachVolumeTestJSON-709357402 tempest-AttachVolumeTestJSON-709357402-project] 10.222.0.49 "GET /compute/v2.1/servers/bcb32a16-9097-40bc-9cd9-eee14f505d1d" status: 200 len: 1363 microversion: 2.1 time: 0.164957 Dec 14 13:05:39.021848 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: [pid: 116063|app: 0|req: 500/979] 10.222.0.49 () {58 vars in 1235 bytes} [Tue Dec 14 13:05:38 2021] GET /compute/v2.1/servers/bcb32a16-9097-40bc-9cd9-eee14f505d1d => generated 1363 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 14 13:05:40.044419 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.api.openstack.wsgi [None req-fb1566ce-fab6-41a4-8dee-25d144c127ae tempest-AttachVolumeTestJSON-709357402 tempest-AttachVolumeTestJSON-709357402-project] Calling method '>' {{(pid=116064) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 13:05:40.045474 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.compute.api [None req-fb1566ce-fab6-41a4-8dee-25d144c127ae tempest-AttachVolumeTestJSON-709357402 tempest-AttachVolumeTestJSON-709357402-project] [instance: bcb32a16-9097-40bc-9cd9-eee14f505d1d] Fetching instance by UUID {{(pid=116064) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 13:05:40.053580 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-fb1566ce-fab6-41a4-8dee-25d144c127ae tempest-AttachVolumeTestJSON-709357402 tempest-AttachVolumeTestJSON-709357402-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 13:05:40.054039 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-fb1566ce-fab6-41a4-8dee-25d144c127ae tempest-AttachVolumeTestJSON-709357402 tempest-AttachVolumeTestJSON-709357402-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 13:05:40.054834 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-fb1566ce-fab6-41a4-8dee-25d144c127ae tempest-AttachVolumeTestJSON-709357402 tempest-AttachVolumeTestJSON-709357402-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 13:05:40.055242 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-fb1566ce-fab6-41a4-8dee-25d144c127ae tempest-AttachVolumeTestJSON-709357402 tempest-AttachVolumeTestJSON-709357402-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 13:05:40.198343 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.policy [None req-fb1566ce-fab6-41a4-8dee-25d144c127ae tempest-AttachVolumeTestJSON-709357402 tempest-AttachVolumeTestJSON-709357402-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '083128ec42474a3e82a2b0fc8c278f4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b1a390d20a54f4d9529d286ab7764a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116064) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 13:05:40.206948 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: INFO nova.api.openstack.requestlog [None req-fb1566ce-fab6-41a4-8dee-25d144c127ae tempest-AttachVolumeTestJSON-709357402 tempest-AttachVolumeTestJSON-709357402-project] 10.222.0.49 "GET /compute/v2.1/servers/bcb32a16-9097-40bc-9cd9-eee14f505d1d" status: 200 len: 1363 microversion: 2.1 time: 0.171068 Dec 14 13:05:40.207547 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: [pid: 116064|app: 0|req: 480/980] 10.222.0.49 () {58 vars in 1235 bytes} [Tue Dec 14 13:05:40 2021] GET /compute/v2.1/servers/bcb32a16-9097-40bc-9cd9-eee14f505d1d => generated 1363 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 14 13:05:41.229346 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.api.openstack.wsgi [None req-6cfc3436-826e-4187-bb69-c60ba6e188ef tempest-AttachVolumeTestJSON-709357402 tempest-AttachVolumeTestJSON-709357402-project] Calling method '>' {{(pid=116063) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 13:05:41.230291 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.compute.api [None req-6cfc3436-826e-4187-bb69-c60ba6e188ef tempest-AttachVolumeTestJSON-709357402 tempest-AttachVolumeTestJSON-709357402-project] [instance: bcb32a16-9097-40bc-9cd9-eee14f505d1d] Fetching instance by UUID {{(pid=116063) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 13:05:41.237304 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-6cfc3436-826e-4187-bb69-c60ba6e188ef tempest-AttachVolumeTestJSON-709357402 tempest-AttachVolumeTestJSON-709357402-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 13:05:41.237751 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-6cfc3436-826e-4187-bb69-c60ba6e188ef tempest-AttachVolumeTestJSON-709357402 tempest-AttachVolumeTestJSON-709357402-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 13:05:41.238524 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-6cfc3436-826e-4187-bb69-c60ba6e188ef tempest-AttachVolumeTestJSON-709357402 tempest-AttachVolumeTestJSON-709357402-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 13:05:41.238952 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-6cfc3436-826e-4187-bb69-c60ba6e188ef tempest-AttachVolumeTestJSON-709357402 tempest-AttachVolumeTestJSON-709357402-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 13:05:41.376673 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.policy [None req-6cfc3436-826e-4187-bb69-c60ba6e188ef tempest-AttachVolumeTestJSON-709357402 tempest-AttachVolumeTestJSON-709357402-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '083128ec42474a3e82a2b0fc8c278f4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b1a390d20a54f4d9529d286ab7764a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116063) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 13:05:41.384507 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: INFO nova.api.openstack.requestlog [None req-6cfc3436-826e-4187-bb69-c60ba6e188ef tempest-AttachVolumeTestJSON-709357402 tempest-AttachVolumeTestJSON-709357402-project] 10.222.0.49 "GET /compute/v2.1/servers/bcb32a16-9097-40bc-9cd9-eee14f505d1d" status: 200 len: 1363 microversion: 2.1 time: 0.162097 Dec 14 13:05:41.385118 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: [pid: 116063|app: 0|req: 501/981] 10.222.0.49 () {58 vars in 1235 bytes} [Tue Dec 14 13:05:41 2021] GET /compute/v2.1/servers/bcb32a16-9097-40bc-9cd9-eee14f505d1d => generated 1363 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 14 13:05:42.405710 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.api.openstack.wsgi [None req-4632ae84-8895-4cdb-86c8-2a128fd73b6f tempest-AttachVolumeTestJSON-709357402 tempest-AttachVolumeTestJSON-709357402-project] Calling method '>' {{(pid=116064) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 13:05:42.406668 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.compute.api [None req-4632ae84-8895-4cdb-86c8-2a128fd73b6f tempest-AttachVolumeTestJSON-709357402 tempest-AttachVolumeTestJSON-709357402-project] [instance: bcb32a16-9097-40bc-9cd9-eee14f505d1d] Fetching instance by UUID {{(pid=116064) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 13:05:42.418163 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-4632ae84-8895-4cdb-86c8-2a128fd73b6f tempest-AttachVolumeTestJSON-709357402 tempest-AttachVolumeTestJSON-709357402-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 13:05:42.418917 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-4632ae84-8895-4cdb-86c8-2a128fd73b6f tempest-AttachVolumeTestJSON-709357402 tempest-AttachVolumeTestJSON-709357402-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 13:05:42.420200 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-4632ae84-8895-4cdb-86c8-2a128fd73b6f tempest-AttachVolumeTestJSON-709357402 tempest-AttachVolumeTestJSON-709357402-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 13:05:42.420916 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-4632ae84-8895-4cdb-86c8-2a128fd73b6f tempest-AttachVolumeTestJSON-709357402 tempest-AttachVolumeTestJSON-709357402-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 13:05:42.563621 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.policy [None req-4632ae84-8895-4cdb-86c8-2a128fd73b6f tempest-AttachVolumeTestJSON-709357402 tempest-AttachVolumeTestJSON-709357402-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '083128ec42474a3e82a2b0fc8c278f4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b1a390d20a54f4d9529d286ab7764a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116064) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 13:05:42.571043 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: INFO nova.api.openstack.requestlog [None req-4632ae84-8895-4cdb-86c8-2a128fd73b6f tempest-AttachVolumeTestJSON-709357402 tempest-AttachVolumeTestJSON-709357402-project] 10.222.0.49 "GET /compute/v2.1/servers/bcb32a16-9097-40bc-9cd9-eee14f505d1d" status: 200 len: 1363 microversion: 2.1 time: 0.171757 Dec 14 13:05:42.571635 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: [pid: 116064|app: 0|req: 481/982] 10.222.0.49 () {58 vars in 1235 bytes} [Tue Dec 14 13:05:42 2021] GET /compute/v2.1/servers/bcb32a16-9097-40bc-9cd9-eee14f505d1d => generated 1363 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 14 13:05:43.591595 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.api.openstack.wsgi [None req-75a6a53e-7a3c-4657-9851-0c680bf3b6d6 tempest-AttachVolumeTestJSON-709357402 tempest-AttachVolumeTestJSON-709357402-project] Calling method '>' {{(pid=116063) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 13:05:43.592667 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.compute.api [None req-75a6a53e-7a3c-4657-9851-0c680bf3b6d6 tempest-AttachVolumeTestJSON-709357402 tempest-AttachVolumeTestJSON-709357402-project] [instance: bcb32a16-9097-40bc-9cd9-eee14f505d1d] Fetching instance by UUID {{(pid=116063) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 13:05:43.603359 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-75a6a53e-7a3c-4657-9851-0c680bf3b6d6 tempest-AttachVolumeTestJSON-709357402 tempest-AttachVolumeTestJSON-709357402-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 13:05:43.604110 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-75a6a53e-7a3c-4657-9851-0c680bf3b6d6 tempest-AttachVolumeTestJSON-709357402 tempest-AttachVolumeTestJSON-709357402-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 13:05:43.605389 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-75a6a53e-7a3c-4657-9851-0c680bf3b6d6 tempest-AttachVolumeTestJSON-709357402 tempest-AttachVolumeTestJSON-709357402-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 13:05:43.605818 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-75a6a53e-7a3c-4657-9851-0c680bf3b6d6 tempest-AttachVolumeTestJSON-709357402 tempest-AttachVolumeTestJSON-709357402-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 13:05:43.739074 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.policy [None req-75a6a53e-7a3c-4657-9851-0c680bf3b6d6 tempest-AttachVolumeTestJSON-709357402 tempest-AttachVolumeTestJSON-709357402-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '083128ec42474a3e82a2b0fc8c278f4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b1a390d20a54f4d9529d286ab7764a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116063) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 13:05:43.747701 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: INFO nova.api.openstack.requestlog [None req-75a6a53e-7a3c-4657-9851-0c680bf3b6d6 tempest-AttachVolumeTestJSON-709357402 tempest-AttachVolumeTestJSON-709357402-project] 10.222.0.49 "GET /compute/v2.1/servers/bcb32a16-9097-40bc-9cd9-eee14f505d1d" status: 200 len: 1363 microversion: 2.1 time: 0.162241 Dec 14 13:05:43.748277 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: [pid: 116063|app: 0|req: 502/983] 10.222.0.49 () {58 vars in 1235 bytes} [Tue Dec 14 13:05:43 2021] GET /compute/v2.1/servers/bcb32a16-9097-40bc-9cd9-eee14f505d1d => generated 1363 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 14 13:05:44.764775 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.api.openstack.wsgi [None req-51b8c823-dbe3-4b36-be3d-62fe72ae1334 tempest-AttachVolumeTestJSON-709357402 tempest-AttachVolumeTestJSON-709357402-project] Calling method '>' {{(pid=116064) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 13:05:44.765436 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.compute.api [None req-51b8c823-dbe3-4b36-be3d-62fe72ae1334 tempest-AttachVolumeTestJSON-709357402 tempest-AttachVolumeTestJSON-709357402-project] [instance: bcb32a16-9097-40bc-9cd9-eee14f505d1d] Fetching instance by UUID {{(pid=116064) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 13:05:44.771967 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-51b8c823-dbe3-4b36-be3d-62fe72ae1334 tempest-AttachVolumeTestJSON-709357402 tempest-AttachVolumeTestJSON-709357402-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 13:05:44.772421 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-51b8c823-dbe3-4b36-be3d-62fe72ae1334 tempest-AttachVolumeTestJSON-709357402 tempest-AttachVolumeTestJSON-709357402-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 13:05:44.773250 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-51b8c823-dbe3-4b36-be3d-62fe72ae1334 tempest-AttachVolumeTestJSON-709357402 tempest-AttachVolumeTestJSON-709357402-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 13:05:44.773711 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-51b8c823-dbe3-4b36-be3d-62fe72ae1334 tempest-AttachVolumeTestJSON-709357402 tempest-AttachVolumeTestJSON-709357402-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 13:05:44.912386 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.policy [None req-51b8c823-dbe3-4b36-be3d-62fe72ae1334 tempest-AttachVolumeTestJSON-709357402 tempest-AttachVolumeTestJSON-709357402-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '083128ec42474a3e82a2b0fc8c278f4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b1a390d20a54f4d9529d286ab7764a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116064) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 13:05:44.920262 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: INFO nova.api.openstack.requestlog [None req-51b8c823-dbe3-4b36-be3d-62fe72ae1334 tempest-AttachVolumeTestJSON-709357402 tempest-AttachVolumeTestJSON-709357402-project] 10.222.0.49 "GET /compute/v2.1/servers/bcb32a16-9097-40bc-9cd9-eee14f505d1d" status: 200 len: 1363 microversion: 2.1 time: 0.159484 Dec 14 13:05:44.920885 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: [pid: 116064|app: 0|req: 482/984] 10.222.0.49 () {58 vars in 1235 bytes} [Tue Dec 14 13:05:44 2021] GET /compute/v2.1/servers/bcb32a16-9097-40bc-9cd9-eee14f505d1d => generated 1363 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 14 13:05:45.940137 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.api.openstack.wsgi [None req-2a6d864b-c9d5-4b3e-91b3-9d8f96729681 tempest-AttachVolumeTestJSON-709357402 tempest-AttachVolumeTestJSON-709357402-project] Calling method '>' {{(pid=116063) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 13:05:45.941059 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.compute.api [None req-2a6d864b-c9d5-4b3e-91b3-9d8f96729681 tempest-AttachVolumeTestJSON-709357402 tempest-AttachVolumeTestJSON-709357402-project] [instance: bcb32a16-9097-40bc-9cd9-eee14f505d1d] Fetching instance by UUID {{(pid=116063) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 13:05:45.950462 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-2a6d864b-c9d5-4b3e-91b3-9d8f96729681 tempest-AttachVolumeTestJSON-709357402 tempest-AttachVolumeTestJSON-709357402-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 13:05:45.950915 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-2a6d864b-c9d5-4b3e-91b3-9d8f96729681 tempest-AttachVolumeTestJSON-709357402 tempest-AttachVolumeTestJSON-709357402-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 13:05:45.951688 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-2a6d864b-c9d5-4b3e-91b3-9d8f96729681 tempest-AttachVolumeTestJSON-709357402 tempest-AttachVolumeTestJSON-709357402-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 13:05:45.952146 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-2a6d864b-c9d5-4b3e-91b3-9d8f96729681 tempest-AttachVolumeTestJSON-709357402 tempest-AttachVolumeTestJSON-709357402-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 13:05:46.093298 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.policy [None req-2a6d864b-c9d5-4b3e-91b3-9d8f96729681 tempest-AttachVolumeTestJSON-709357402 tempest-AttachVolumeTestJSON-709357402-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '083128ec42474a3e82a2b0fc8c278f4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b1a390d20a54f4d9529d286ab7764a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116063) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 13:05:46.104505 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: INFO nova.api.openstack.requestlog [None req-2a6d864b-c9d5-4b3e-91b3-9d8f96729681 tempest-AttachVolumeTestJSON-709357402 tempest-AttachVolumeTestJSON-709357402-project] 10.222.0.49 "GET /compute/v2.1/servers/bcb32a16-9097-40bc-9cd9-eee14f505d1d" status: 200 len: 1363 microversion: 2.1 time: 0.169911 Dec 14 13:05:46.105329 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: [pid: 116063|app: 0|req: 503/985] 10.222.0.49 () {58 vars in 1235 bytes} [Tue Dec 14 13:05:45 2021] GET /compute/v2.1/servers/bcb32a16-9097-40bc-9cd9-eee14f505d1d => generated 1363 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 14 13:05:46.865143 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.api.openstack.wsgi [req-71676f39-becd-4537-82ac-417b531a4c33 req-9c421b20-65d0-481e-bf0a-05f067fa5b0e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bcb32a16-9097-40bc-9cd9-eee14f505d1d", "name": "network-vif-plugged", "status": "completed", "tag": "f2dc7c1b-e719-44e8-b9aa-992821506ebe"}]} {{(pid=116064) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 14 13:05:46.866919 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 14 13:05:46.866919 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: warnings.warn(msg) Dec 14 13:05:46.874522 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [req-71676f39-becd-4537-82ac-417b531a4c33 req-9c421b20-65d0-481e-bf0a-05f067fa5b0e service nova] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 13:05:46.874969 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [req-71676f39-becd-4537-82ac-417b531a4c33 req-9c421b20-65d0-481e-bf0a-05f067fa5b0e service nova] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 13:05:46.886447 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: INFO nova.api.openstack.compute.server_external_events [req-71676f39-becd-4537-82ac-417b531a4c33 req-9c421b20-65d0-481e-bf0a-05f067fa5b0e service nova] Creating event network-vif-plugged:f2dc7c1b-e719-44e8-b9aa-992821506ebe for instance bcb32a16-9097-40bc-9cd9-eee14f505d1d on hv-cinder-78447 Dec 14 13:05:46.891417 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: INFO nova.api.openstack.requestlog [req-71676f39-becd-4537-82ac-417b531a4c33 req-9c421b20-65d0-481e-bf0a-05f067fa5b0e service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032107 Dec 14 13:05:46.892200 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: [pid: 116064|app: 0|req: 483/986] 10.222.0.49 () {64 vars in 1317 bytes} [Tue Dec 14 13:05:46 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 14 13:05:47.126090 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.api.openstack.wsgi [None req-fb104392-328f-4680-8688-06292e04a5b5 tempest-AttachVolumeTestJSON-709357402 tempest-AttachVolumeTestJSON-709357402-project] Calling method '>' {{(pid=116063) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 13:05:47.126702 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.compute.api [None req-fb104392-328f-4680-8688-06292e04a5b5 tempest-AttachVolumeTestJSON-709357402 tempest-AttachVolumeTestJSON-709357402-project] [instance: bcb32a16-9097-40bc-9cd9-eee14f505d1d] Fetching instance by UUID {{(pid=116063) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 13:05:47.132842 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-fb104392-328f-4680-8688-06292e04a5b5 tempest-AttachVolumeTestJSON-709357402 tempest-AttachVolumeTestJSON-709357402-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 13:05:47.133335 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-fb104392-328f-4680-8688-06292e04a5b5 tempest-AttachVolumeTestJSON-709357402 tempest-AttachVolumeTestJSON-709357402-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 13:05:47.134108 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-fb104392-328f-4680-8688-06292e04a5b5 tempest-AttachVolumeTestJSON-709357402 tempest-AttachVolumeTestJSON-709357402-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 13:05:47.134567 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-fb104392-328f-4680-8688-06292e04a5b5 tempest-AttachVolumeTestJSON-709357402 tempest-AttachVolumeTestJSON-709357402-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 13:05:47.275297 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.policy [None req-fb104392-328f-4680-8688-06292e04a5b5 tempest-AttachVolumeTestJSON-709357402 tempest-AttachVolumeTestJSON-709357402-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '083128ec42474a3e82a2b0fc8c278f4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b1a390d20a54f4d9529d286ab7764a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116063) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 13:05:47.286836 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: INFO nova.api.openstack.requestlog [None req-fb104392-328f-4680-8688-06292e04a5b5 tempest-AttachVolumeTestJSON-709357402 tempest-AttachVolumeTestJSON-709357402-project] 10.222.0.49 "GET /compute/v2.1/servers/bcb32a16-9097-40bc-9cd9-eee14f505d1d" status: 200 len: 1363 microversion: 2.1 time: 0.164313 Dec 14 13:05:47.287658 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: [pid: 116063|app: 0|req: 504/987] 10.222.0.49 () {58 vars in 1235 bytes} [Tue Dec 14 13:05:47 2021] GET /compute/v2.1/servers/bcb32a16-9097-40bc-9cd9-eee14f505d1d => generated 1363 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 14 13:05:48.307361 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.api.openstack.wsgi [None req-c27eda68-70dc-446d-85c1-460e642e7abc tempest-AttachVolumeTestJSON-709357402 tempest-AttachVolumeTestJSON-709357402-project] Calling method '>' {{(pid=116064) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 13:05:48.308028 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.compute.api [None req-c27eda68-70dc-446d-85c1-460e642e7abc tempest-AttachVolumeTestJSON-709357402 tempest-AttachVolumeTestJSON-709357402-project] [instance: bcb32a16-9097-40bc-9cd9-eee14f505d1d] Fetching instance by UUID {{(pid=116064) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 13:05:48.315072 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-c27eda68-70dc-446d-85c1-460e642e7abc tempest-AttachVolumeTestJSON-709357402 tempest-AttachVolumeTestJSON-709357402-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 13:05:48.315596 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-c27eda68-70dc-446d-85c1-460e642e7abc tempest-AttachVolumeTestJSON-709357402 tempest-AttachVolumeTestJSON-709357402-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 13:05:48.316453 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-c27eda68-70dc-446d-85c1-460e642e7abc tempest-AttachVolumeTestJSON-709357402 tempest-AttachVolumeTestJSON-709357402-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 13:05:48.317065 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-c27eda68-70dc-446d-85c1-460e642e7abc tempest-AttachVolumeTestJSON-709357402 tempest-AttachVolumeTestJSON-709357402-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 13:05:48.465970 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.policy [None req-c27eda68-70dc-446d-85c1-460e642e7abc tempest-AttachVolumeTestJSON-709357402 tempest-AttachVolumeTestJSON-709357402-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '083128ec42474a3e82a2b0fc8c278f4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b1a390d20a54f4d9529d286ab7764a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116064) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 13:05:48.473582 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: INFO nova.api.openstack.requestlog [None req-c27eda68-70dc-446d-85c1-460e642e7abc tempest-AttachVolumeTestJSON-709357402 tempest-AttachVolumeTestJSON-709357402-project] 10.222.0.49 "GET /compute/v2.1/servers/bcb32a16-9097-40bc-9cd9-eee14f505d1d" status: 200 len: 1548 microversion: 2.1 time: 0.170848 Dec 14 13:05:48.474158 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: [pid: 116064|app: 0|req: 484/988] 10.222.0.49 () {58 vars in 1235 bytes} [Tue Dec 14 13:05:48 2021] GET /compute/v2.1/servers/bcb32a16-9097-40bc-9cd9-eee14f505d1d => generated 1548 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 14 13:05:48.489954 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.api.openstack.wsgi [None req-5d5041ea-1235-4295-a9e0-72865758bc27 tempest-AttachVolumeTestJSON-709357402 tempest-AttachVolumeTestJSON-709357402-project] Calling method '>' {{(pid=116063) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 13:05:48.490568 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.compute.api [None req-5d5041ea-1235-4295-a9e0-72865758bc27 tempest-AttachVolumeTestJSON-709357402 tempest-AttachVolumeTestJSON-709357402-project] [instance: bcb32a16-9097-40bc-9cd9-eee14f505d1d] Fetching instance by UUID {{(pid=116063) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 13:05:48.496770 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-5d5041ea-1235-4295-a9e0-72865758bc27 tempest-AttachVolumeTestJSON-709357402 tempest-AttachVolumeTestJSON-709357402-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 13:05:48.497272 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-5d5041ea-1235-4295-a9e0-72865758bc27 tempest-AttachVolumeTestJSON-709357402 tempest-AttachVolumeTestJSON-709357402-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 13:05:48.498047 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-5d5041ea-1235-4295-a9e0-72865758bc27 tempest-AttachVolumeTestJSON-709357402 tempest-AttachVolumeTestJSON-709357402-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 13:05:48.498478 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-5d5041ea-1235-4295-a9e0-72865758bc27 tempest-AttachVolumeTestJSON-709357402 tempest-AttachVolumeTestJSON-709357402-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 13:05:48.579922 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: INFO nova.api.openstack.requestlog [None req-5d5041ea-1235-4295-a9e0-72865758bc27 tempest-AttachVolumeTestJSON-709357402 tempest-AttachVolumeTestJSON-709357402-project] 10.222.0.49 "GET /compute/v2.1/servers/bcb32a16-9097-40bc-9cd9-eee14f505d1d/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.093612 Dec 14 13:05:48.580556 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: [pid: 116063|app: 0|req: 505/989] 10.222.0.49 () {58 vars in 1274 bytes} [Tue Dec 14 13:05:48 2021] GET /compute/v2.1/servers/bcb32a16-9097-40bc-9cd9-eee14f505d1d/os-interface => generated 284 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 14 13:05:49.526163 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.api.openstack.wsgi [None req-ad83cb7f-fced-453c-a4c4-158a488a5b51 tempest-AttachVolumeTestJSON-709357402 tempest-AttachVolumeTestJSON-709357402-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116064) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 14 13:05:49.527095 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.compute.api [None req-ad83cb7f-fced-453c-a4c4-158a488a5b51 tempest-AttachVolumeTestJSON-709357402 tempest-AttachVolumeTestJSON-709357402-project] [instance: bcb32a16-9097-40bc-9cd9-eee14f505d1d] Fetching instance by UUID {{(pid=116064) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 13:05:49.529314 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.api.openstack.wsgi [req-7e1e3c96-576d-4b90-811f-35087b68678f req-395fbde9-eb2b-48f3-a5f6-04b04bef233a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bcb32a16-9097-40bc-9cd9-eee14f505d1d", "tag": "f2dc7c1b-e719-44e8-b9aa-992821506ebe"}]} {{(pid=116063) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 14 13:05:49.530869 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 14 13:05:49.530869 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: warnings.warn(msg) Dec 14 13:05:49.538821 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-ad83cb7f-fced-453c-a4c4-158a488a5b51 tempest-AttachVolumeTestJSON-709357402 tempest-AttachVolumeTestJSON-709357402-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 13:05:49.539268 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-ad83cb7f-fced-453c-a4c4-158a488a5b51 tempest-AttachVolumeTestJSON-709357402 tempest-AttachVolumeTestJSON-709357402-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 13:05:49.540382 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-ad83cb7f-fced-453c-a4c4-158a488a5b51 tempest-AttachVolumeTestJSON-709357402 tempest-AttachVolumeTestJSON-709357402-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 13:05:49.540817 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-ad83cb7f-fced-453c-a4c4-158a488a5b51 tempest-AttachVolumeTestJSON-709357402 tempest-AttachVolumeTestJSON-709357402-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 13:05:49.548682 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [req-7e1e3c96-576d-4b90-811f-35087b68678f req-395fbde9-eb2b-48f3-a5f6-04b04bef233a service nova] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 13:05:49.549145 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [req-7e1e3c96-576d-4b90-811f-35087b68678f req-395fbde9-eb2b-48f3-a5f6-04b04bef233a service nova] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 13:05:49.567860 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: INFO nova.api.openstack.compute.server_external_events [req-7e1e3c96-576d-4b90-811f-35087b68678f req-395fbde9-eb2b-48f3-a5f6-04b04bef233a service nova] Creating event network-changed:f2dc7c1b-e719-44e8-b9aa-992821506ebe for instance bcb32a16-9097-40bc-9cd9-eee14f505d1d on hv-cinder-78447 Dec 14 13:05:49.576941 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: INFO nova.api.openstack.requestlog [req-7e1e3c96-576d-4b90-811f-35087b68678f req-395fbde9-eb2b-48f3-a5f6-04b04bef233a service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.051683 Dec 14 13:05:49.577951 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: [pid: 116063|app: 0|req: 506/990] 10.222.0.49 () {64 vars in 1317 bytes} [Tue Dec 14 13:05:49 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 14 13:05:49.618695 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: INFO nova.api.openstack.requestlog [None req-ad83cb7f-fced-453c-a4c4-158a488a5b51 tempest-AttachVolumeTestJSON-709357402 tempest-AttachVolumeTestJSON-709357402-project] 10.222.0.49 "POST /compute/v2.1/servers/bcb32a16-9097-40bc-9cd9-eee14f505d1d/action" status: 200 len: 14 microversion: 2.1 time: 0.096238 Dec 14 13:05:49.619705 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: [pid: 116064|app: 0|req: 485/991] 10.222.0.49 () {60 vars in 1277 bytes} [Tue Dec 14 13:05:49 2021] POST /compute/v2.1/servers/bcb32a16-9097-40bc-9cd9-eee14f505d1d/action => generated 14 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Dec 14 13:05:50.631472 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.api.openstack.wsgi [None req-e0504edc-66ee-42ea-a112-d769dad4d673 tempest-AttachVolumeTestJSON-709357402 tempest-AttachVolumeTestJSON-709357402-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116063) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 14 13:05:50.633310 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.compute.api [None req-e0504edc-66ee-42ea-a112-d769dad4d673 tempest-AttachVolumeTestJSON-709357402 tempest-AttachVolumeTestJSON-709357402-project] [instance: bcb32a16-9097-40bc-9cd9-eee14f505d1d] Fetching instance by UUID {{(pid=116063) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 13:05:50.639921 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-e0504edc-66ee-42ea-a112-d769dad4d673 tempest-AttachVolumeTestJSON-709357402 tempest-AttachVolumeTestJSON-709357402-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 13:05:50.640447 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-e0504edc-66ee-42ea-a112-d769dad4d673 tempest-AttachVolumeTestJSON-709357402 tempest-AttachVolumeTestJSON-709357402-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 13:05:50.641351 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-e0504edc-66ee-42ea-a112-d769dad4d673 tempest-AttachVolumeTestJSON-709357402 tempest-AttachVolumeTestJSON-709357402-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 13:05:50.641848 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-e0504edc-66ee-42ea-a112-d769dad4d673 tempest-AttachVolumeTestJSON-709357402 tempest-AttachVolumeTestJSON-709357402-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 13:05:50.702193 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: INFO nova.api.openstack.requestlog [None req-e0504edc-66ee-42ea-a112-d769dad4d673 tempest-AttachVolumeTestJSON-709357402 tempest-AttachVolumeTestJSON-709357402-project] 10.222.0.49 "POST /compute/v2.1/servers/bcb32a16-9097-40bc-9cd9-eee14f505d1d/action" status: 200 len: 14 microversion: 2.1 time: 0.074563 Dec 14 13:05:50.703299 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: [pid: 116063|app: 0|req: 507/992] 10.222.0.49 () {60 vars in 1277 bytes} [Tue Dec 14 13:05:50 2021] POST /compute/v2.1/servers/bcb32a16-9097-40bc-9cd9-eee14f505d1d/action => generated 14 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Dec 14 13:05:51.714210 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.api.openstack.wsgi [None req-9f764d7f-bfce-489b-845e-bbe51dba6bb9 tempest-AttachVolumeTestJSON-709357402 tempest-AttachVolumeTestJSON-709357402-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116064) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 14 13:05:51.715232 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.compute.api [None req-9f764d7f-bfce-489b-845e-bbe51dba6bb9 tempest-AttachVolumeTestJSON-709357402 tempest-AttachVolumeTestJSON-709357402-project] [instance: bcb32a16-9097-40bc-9cd9-eee14f505d1d] Fetching instance by UUID {{(pid=116064) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 13:05:51.724929 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-9f764d7f-bfce-489b-845e-bbe51dba6bb9 tempest-AttachVolumeTestJSON-709357402 tempest-AttachVolumeTestJSON-709357402-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 13:05:51.725426 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-9f764d7f-bfce-489b-845e-bbe51dba6bb9 tempest-AttachVolumeTestJSON-709357402 tempest-AttachVolumeTestJSON-709357402-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 13:05:51.726393 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-9f764d7f-bfce-489b-845e-bbe51dba6bb9 tempest-AttachVolumeTestJSON-709357402 tempest-AttachVolumeTestJSON-709357402-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 13:05:51.726866 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-9f764d7f-bfce-489b-845e-bbe51dba6bb9 tempest-AttachVolumeTestJSON-709357402 tempest-AttachVolumeTestJSON-709357402-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 13:05:51.789228 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: INFO nova.api.openstack.requestlog [None req-9f764d7f-bfce-489b-845e-bbe51dba6bb9 tempest-AttachVolumeTestJSON-709357402 tempest-AttachVolumeTestJSON-709357402-project] 10.222.0.49 "POST /compute/v2.1/servers/bcb32a16-9097-40bc-9cd9-eee14f505d1d/action" status: 200 len: 14 microversion: 2.1 time: 0.078873 Dec 14 13:05:51.790334 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: [pid: 116064|app: 0|req: 486/993] 10.222.0.49 () {60 vars in 1277 bytes} [Tue Dec 14 13:05:51 2021] POST /compute/v2.1/servers/bcb32a16-9097-40bc-9cd9-eee14f505d1d/action => generated 14 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Dec 14 13:05:52.801766 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.api.openstack.wsgi [None req-39579ee5-3d52-40c9-9c50-c30c197a2950 tempest-AttachVolumeTestJSON-709357402 tempest-AttachVolumeTestJSON-709357402-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116063) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 14 13:05:52.802997 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.compute.api [None req-39579ee5-3d52-40c9-9c50-c30c197a2950 tempest-AttachVolumeTestJSON-709357402 tempest-AttachVolumeTestJSON-709357402-project] [instance: bcb32a16-9097-40bc-9cd9-eee14f505d1d] Fetching instance by UUID {{(pid=116063) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 13:05:52.810303 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-39579ee5-3d52-40c9-9c50-c30c197a2950 tempest-AttachVolumeTestJSON-709357402 tempest-AttachVolumeTestJSON-709357402-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 13:05:52.810746 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-39579ee5-3d52-40c9-9c50-c30c197a2950 tempest-AttachVolumeTestJSON-709357402 tempest-AttachVolumeTestJSON-709357402-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 13:05:52.811521 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-39579ee5-3d52-40c9-9c50-c30c197a2950 tempest-AttachVolumeTestJSON-709357402 tempest-AttachVolumeTestJSON-709357402-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 13:05:52.811953 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-39579ee5-3d52-40c9-9c50-c30c197a2950 tempest-AttachVolumeTestJSON-709357402 tempest-AttachVolumeTestJSON-709357402-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 13:05:52.877040 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: INFO nova.api.openstack.requestlog [None req-39579ee5-3d52-40c9-9c50-c30c197a2950 tempest-AttachVolumeTestJSON-709357402 tempest-AttachVolumeTestJSON-709357402-project] 10.222.0.49 "POST /compute/v2.1/servers/bcb32a16-9097-40bc-9cd9-eee14f505d1d/action" status: 200 len: 14 microversion: 2.1 time: 0.078507 Dec 14 13:05:52.878168 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: [pid: 116063|app: 0|req: 508/994] 10.222.0.49 () {60 vars in 1277 bytes} [Tue Dec 14 13:05:52 2021] POST /compute/v2.1/servers/bcb32a16-9097-40bc-9cd9-eee14f505d1d/action => generated 14 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Dec 14 13:05:53.888131 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.api.openstack.wsgi [None req-30d7480d-cb88-4571-8c26-fba9a0e51185 tempest-AttachVolumeTestJSON-709357402 tempest-AttachVolumeTestJSON-709357402-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116064) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 14 13:05:53.889766 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.compute.api [None req-30d7480d-cb88-4571-8c26-fba9a0e51185 tempest-AttachVolumeTestJSON-709357402 tempest-AttachVolumeTestJSON-709357402-project] [instance: bcb32a16-9097-40bc-9cd9-eee14f505d1d] Fetching instance by UUID {{(pid=116064) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 13:05:53.896678 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-30d7480d-cb88-4571-8c26-fba9a0e51185 tempest-AttachVolumeTestJSON-709357402 tempest-AttachVolumeTestJSON-709357402-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 13:05:53.897156 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-30d7480d-cb88-4571-8c26-fba9a0e51185 tempest-AttachVolumeTestJSON-709357402 tempest-AttachVolumeTestJSON-709357402-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 13:05:53.897944 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-30d7480d-cb88-4571-8c26-fba9a0e51185 tempest-AttachVolumeTestJSON-709357402 tempest-AttachVolumeTestJSON-709357402-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 13:05:53.898345 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-30d7480d-cb88-4571-8c26-fba9a0e51185 tempest-AttachVolumeTestJSON-709357402 tempest-AttachVolumeTestJSON-709357402-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 13:05:53.955524 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: INFO nova.api.openstack.requestlog [None req-30d7480d-cb88-4571-8c26-fba9a0e51185 tempest-AttachVolumeTestJSON-709357402 tempest-AttachVolumeTestJSON-709357402-project] 10.222.0.49 "POST /compute/v2.1/servers/bcb32a16-9097-40bc-9cd9-eee14f505d1d/action" status: 200 len: 14 microversion: 2.1 time: 0.071789 Dec 14 13:05:53.956231 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: [pid: 116064|app: 0|req: 487/995] 10.222.0.49 () {60 vars in 1277 bytes} [Tue Dec 14 13:05:53 2021] POST /compute/v2.1/servers/bcb32a16-9097-40bc-9cd9-eee14f505d1d/action => generated 14 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Dec 14 13:05:54.967212 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.api.openstack.wsgi [None req-be99c8c3-0ff2-4906-afd5-db71385a3dd8 tempest-AttachVolumeTestJSON-709357402 tempest-AttachVolumeTestJSON-709357402-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116063) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 14 13:05:54.968208 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.compute.api [None req-be99c8c3-0ff2-4906-afd5-db71385a3dd8 tempest-AttachVolumeTestJSON-709357402 tempest-AttachVolumeTestJSON-709357402-project] [instance: bcb32a16-9097-40bc-9cd9-eee14f505d1d] Fetching instance by UUID {{(pid=116063) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 13:05:54.975234 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-be99c8c3-0ff2-4906-afd5-db71385a3dd8 tempest-AttachVolumeTestJSON-709357402 tempest-AttachVolumeTestJSON-709357402-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 13:05:54.975665 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-be99c8c3-0ff2-4906-afd5-db71385a3dd8 tempest-AttachVolumeTestJSON-709357402 tempest-AttachVolumeTestJSON-709357402-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 13:05:54.976456 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-be99c8c3-0ff2-4906-afd5-db71385a3dd8 tempest-AttachVolumeTestJSON-709357402 tempest-AttachVolumeTestJSON-709357402-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 13:05:54.976911 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-be99c8c3-0ff2-4906-afd5-db71385a3dd8 tempest-AttachVolumeTestJSON-709357402 tempest-AttachVolumeTestJSON-709357402-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 13:05:55.034821 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: INFO nova.api.openstack.requestlog [None req-be99c8c3-0ff2-4906-afd5-db71385a3dd8 tempest-AttachVolumeTestJSON-709357402 tempest-AttachVolumeTestJSON-709357402-project] 10.222.0.49 "POST /compute/v2.1/servers/bcb32a16-9097-40bc-9cd9-eee14f505d1d/action" status: 200 len: 14 microversion: 2.1 time: 0.071376 Dec 14 13:05:55.035333 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: [pid: 116063|app: 0|req: 509/996] 10.222.0.49 () {60 vars in 1277 bytes} [Tue Dec 14 13:05:54 2021] POST /compute/v2.1/servers/bcb32a16-9097-40bc-9cd9-eee14f505d1d/action => generated 14 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Dec 14 13:05:56.047314 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.api.openstack.wsgi [None req-66884c1a-b44b-4269-b306-7498cece67a5 tempest-AttachVolumeTestJSON-709357402 tempest-AttachVolumeTestJSON-709357402-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116064) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 14 13:05:56.048373 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.compute.api [None req-66884c1a-b44b-4269-b306-7498cece67a5 tempest-AttachVolumeTestJSON-709357402 tempest-AttachVolumeTestJSON-709357402-project] [instance: bcb32a16-9097-40bc-9cd9-eee14f505d1d] Fetching instance by UUID {{(pid=116064) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 13:05:56.055603 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-66884c1a-b44b-4269-b306-7498cece67a5 tempest-AttachVolumeTestJSON-709357402 tempest-AttachVolumeTestJSON-709357402-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 13:05:56.056088 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-66884c1a-b44b-4269-b306-7498cece67a5 tempest-AttachVolumeTestJSON-709357402 tempest-AttachVolumeTestJSON-709357402-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 13:05:56.056872 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-66884c1a-b44b-4269-b306-7498cece67a5 tempest-AttachVolumeTestJSON-709357402 tempest-AttachVolumeTestJSON-709357402-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 13:05:56.057460 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-66884c1a-b44b-4269-b306-7498cece67a5 tempest-AttachVolumeTestJSON-709357402 tempest-AttachVolumeTestJSON-709357402-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 13:05:56.114976 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: INFO nova.api.openstack.requestlog [None req-66884c1a-b44b-4269-b306-7498cece67a5 tempest-AttachVolumeTestJSON-709357402 tempest-AttachVolumeTestJSON-709357402-project] 10.222.0.49 "POST /compute/v2.1/servers/bcb32a16-9097-40bc-9cd9-eee14f505d1d/action" status: 200 len: 14 microversion: 2.1 time: 0.072250 Dec 14 13:05:56.118263 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: [pid: 116064|app: 0|req: 488/997] 10.222.0.49 () {60 vars in 1277 bytes} [Tue Dec 14 13:05:56 2021] POST /compute/v2.1/servers/bcb32a16-9097-40bc-9cd9-eee14f505d1d/action => generated 14 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Dec 14 13:05:57.131919 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.api.openstack.wsgi [None req-4bce042b-ac57-43af-841c-026b77a59905 tempest-AttachVolumeTestJSON-709357402 tempest-AttachVolumeTestJSON-709357402-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116063) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 14 13:05:57.132664 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.compute.api [None req-4bce042b-ac57-43af-841c-026b77a59905 tempest-AttachVolumeTestJSON-709357402 tempest-AttachVolumeTestJSON-709357402-project] [instance: bcb32a16-9097-40bc-9cd9-eee14f505d1d] Fetching instance by UUID {{(pid=116063) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 13:05:57.141348 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-4bce042b-ac57-43af-841c-026b77a59905 tempest-AttachVolumeTestJSON-709357402 tempest-AttachVolumeTestJSON-709357402-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 13:05:57.141797 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-4bce042b-ac57-43af-841c-026b77a59905 tempest-AttachVolumeTestJSON-709357402 tempest-AttachVolumeTestJSON-709357402-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 13:05:57.142582 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-4bce042b-ac57-43af-841c-026b77a59905 tempest-AttachVolumeTestJSON-709357402 tempest-AttachVolumeTestJSON-709357402-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 13:05:57.143017 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-4bce042b-ac57-43af-841c-026b77a59905 tempest-AttachVolumeTestJSON-709357402 tempest-AttachVolumeTestJSON-709357402-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 13:05:57.208983 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: INFO nova.api.openstack.requestlog [None req-4bce042b-ac57-43af-841c-026b77a59905 tempest-AttachVolumeTestJSON-709357402 tempest-AttachVolumeTestJSON-709357402-project] 10.222.0.49 "POST /compute/v2.1/servers/bcb32a16-9097-40bc-9cd9-eee14f505d1d/action" status: 200 len: 14 microversion: 2.1 time: 0.084462 Dec 14 13:05:57.209621 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: [pid: 116063|app: 0|req: 510/998] 10.222.0.49 () {60 vars in 1277 bytes} [Tue Dec 14 13:05:57 2021] POST /compute/v2.1/servers/bcb32a16-9097-40bc-9cd9-eee14f505d1d/action => generated 14 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Dec 14 13:05:58.223663 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.api.openstack.wsgi [None req-8d03f5c4-14ad-4dda-a353-bb1e60af6a44 tempest-AttachVolumeTestJSON-709357402 tempest-AttachVolumeTestJSON-709357402-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116064) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 14 13:05:58.224657 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.compute.api [None req-8d03f5c4-14ad-4dda-a353-bb1e60af6a44 tempest-AttachVolumeTestJSON-709357402 tempest-AttachVolumeTestJSON-709357402-project] [instance: bcb32a16-9097-40bc-9cd9-eee14f505d1d] Fetching instance by UUID {{(pid=116064) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 13:05:58.234994 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-8d03f5c4-14ad-4dda-a353-bb1e60af6a44 tempest-AttachVolumeTestJSON-709357402 tempest-AttachVolumeTestJSON-709357402-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 13:05:58.235594 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-8d03f5c4-14ad-4dda-a353-bb1e60af6a44 tempest-AttachVolumeTestJSON-709357402 tempest-AttachVolumeTestJSON-709357402-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 13:05:58.236781 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-8d03f5c4-14ad-4dda-a353-bb1e60af6a44 tempest-AttachVolumeTestJSON-709357402 tempest-AttachVolumeTestJSON-709357402-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 13:05:58.237497 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-8d03f5c4-14ad-4dda-a353-bb1e60af6a44 tempest-AttachVolumeTestJSON-709357402 tempest-AttachVolumeTestJSON-709357402-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 13:06:00.296805 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: INFO nova.api.openstack.requestlog [None req-8d03f5c4-14ad-4dda-a353-bb1e60af6a44 tempest-AttachVolumeTestJSON-709357402 tempest-AttachVolumeTestJSON-709357402-project] 10.222.0.49 "POST /compute/v2.1/servers/bcb32a16-9097-40bc-9cd9-eee14f505d1d/action" status: 200 len: 14 microversion: 2.1 time: 2.078707 Dec 14 13:06:00.297554 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: [pid: 116064|app: 0|req: 489/999] 10.222.0.49 () {60 vars in 1277 bytes} [Tue Dec 14 13:05:58 2021] POST /compute/v2.1/servers/bcb32a16-9097-40bc-9cd9-eee14f505d1d/action => generated 14 bytes in 2081 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Dec 14 13:06:01.312495 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.api.openstack.wsgi [None req-2f6298b3-da59-4fb8-8796-e3a65ca7399d tempest-AttachVolumeTestJSON-709357402 tempest-AttachVolumeTestJSON-709357402-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116063) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 14 13:06:01.313626 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.compute.api [None req-2f6298b3-da59-4fb8-8796-e3a65ca7399d tempest-AttachVolumeTestJSON-709357402 tempest-AttachVolumeTestJSON-709357402-project] [instance: bcb32a16-9097-40bc-9cd9-eee14f505d1d] Fetching instance by UUID {{(pid=116063) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 13:06:01.321545 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-2f6298b3-da59-4fb8-8796-e3a65ca7399d tempest-AttachVolumeTestJSON-709357402 tempest-AttachVolumeTestJSON-709357402-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 13:06:01.322037 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-2f6298b3-da59-4fb8-8796-e3a65ca7399d tempest-AttachVolumeTestJSON-709357402 tempest-AttachVolumeTestJSON-709357402-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 13:06:01.324105 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-2f6298b3-da59-4fb8-8796-e3a65ca7399d tempest-AttachVolumeTestJSON-709357402 tempest-AttachVolumeTestJSON-709357402-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 13:06:01.326050 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-2f6298b3-da59-4fb8-8796-e3a65ca7399d tempest-AttachVolumeTestJSON-709357402 tempest-AttachVolumeTestJSON-709357402-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 13:06:01.407324 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: INFO nova.api.openstack.requestlog [None req-2f6298b3-da59-4fb8-8796-e3a65ca7399d tempest-AttachVolumeTestJSON-709357402 tempest-AttachVolumeTestJSON-709357402-project] 10.222.0.49 "POST /compute/v2.1/servers/bcb32a16-9097-40bc-9cd9-eee14f505d1d/action" status: 200 len: 14 microversion: 2.1 time: 0.099724 Dec 14 13:06:01.408068 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: [pid: 116063|app: 0|req: 511/1000] 10.222.0.49 () {60 vars in 1277 bytes} [Tue Dec 14 13:06:01 2021] POST /compute/v2.1/servers/bcb32a16-9097-40bc-9cd9-eee14f505d1d/action => generated 14 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Dec 14 13:06:02.421664 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.api.openstack.wsgi [None req-b7f2b8ab-304e-4caa-967a-ada0a8b4e681 tempest-AttachVolumeTestJSON-709357402 tempest-AttachVolumeTestJSON-709357402-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116064) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 14 13:06:02.422763 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.compute.api [None req-b7f2b8ab-304e-4caa-967a-ada0a8b4e681 tempest-AttachVolumeTestJSON-709357402 tempest-AttachVolumeTestJSON-709357402-project] [instance: bcb32a16-9097-40bc-9cd9-eee14f505d1d] Fetching instance by UUID {{(pid=116064) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 13:06:02.432049 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-b7f2b8ab-304e-4caa-967a-ada0a8b4e681 tempest-AttachVolumeTestJSON-709357402 tempest-AttachVolumeTestJSON-709357402-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 13:06:02.432573 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-b7f2b8ab-304e-4caa-967a-ada0a8b4e681 tempest-AttachVolumeTestJSON-709357402 tempest-AttachVolumeTestJSON-709357402-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 13:06:02.433396 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-b7f2b8ab-304e-4caa-967a-ada0a8b4e681 tempest-AttachVolumeTestJSON-709357402 tempest-AttachVolumeTestJSON-709357402-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 13:06:02.433829 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-b7f2b8ab-304e-4caa-967a-ada0a8b4e681 tempest-AttachVolumeTestJSON-709357402 tempest-AttachVolumeTestJSON-709357402-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 13:06:02.513047 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: INFO nova.api.openstack.requestlog [None req-b7f2b8ab-304e-4caa-967a-ada0a8b4e681 tempest-AttachVolumeTestJSON-709357402 tempest-AttachVolumeTestJSON-709357402-project] 10.222.0.49 "POST /compute/v2.1/servers/bcb32a16-9097-40bc-9cd9-eee14f505d1d/action" status: 200 len: 10893 microversion: 2.1 time: 0.096438 Dec 14 13:06:02.513685 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: [pid: 116064|app: 0|req: 490/1001] 10.222.0.49 () {60 vars in 1277 bytes} [Tue Dec 14 13:06:02 2021] POST /compute/v2.1/servers/bcb32a16-9097-40bc-9cd9-eee14f505d1d/action => generated 10893 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 14 13:06:03.524109 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.api.openstack.wsgi [None req-528b89b3-0b1a-4b8a-81dd-bdffe8ff4080 tempest-AttachVolumeTestJSON-709357402 tempest-AttachVolumeTestJSON-709357402-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116063) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 14 13:06:03.525215 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.compute.api [None req-528b89b3-0b1a-4b8a-81dd-bdffe8ff4080 tempest-AttachVolumeTestJSON-709357402 tempest-AttachVolumeTestJSON-709357402-project] [instance: bcb32a16-9097-40bc-9cd9-eee14f505d1d] Fetching instance by UUID {{(pid=116063) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 13:06:03.532183 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-528b89b3-0b1a-4b8a-81dd-bdffe8ff4080 tempest-AttachVolumeTestJSON-709357402 tempest-AttachVolumeTestJSON-709357402-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 13:06:03.532895 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-528b89b3-0b1a-4b8a-81dd-bdffe8ff4080 tempest-AttachVolumeTestJSON-709357402 tempest-AttachVolumeTestJSON-709357402-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 13:06:03.533699 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-528b89b3-0b1a-4b8a-81dd-bdffe8ff4080 tempest-AttachVolumeTestJSON-709357402 tempest-AttachVolumeTestJSON-709357402-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 13:06:03.534130 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-528b89b3-0b1a-4b8a-81dd-bdffe8ff4080 tempest-AttachVolumeTestJSON-709357402 tempest-AttachVolumeTestJSON-709357402-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 13:06:03.606733 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: INFO nova.api.openstack.requestlog [None req-528b89b3-0b1a-4b8a-81dd-bdffe8ff4080 tempest-AttachVolumeTestJSON-709357402 tempest-AttachVolumeTestJSON-709357402-project] 10.222.0.49 "POST /compute/v2.1/servers/bcb32a16-9097-40bc-9cd9-eee14f505d1d/action" status: 200 len: 18208 microversion: 2.1 time: 0.086516 Dec 14 13:06:03.608523 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: [pid: 116063|app: 0|req: 512/1002] 10.222.0.49 () {60 vars in 1277 bytes} [Tue Dec 14 13:06:03 2021] POST /compute/v2.1/servers/bcb32a16-9097-40bc-9cd9-eee14f505d1d/action => generated 18208 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 14 13:06:04.624814 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.api.openstack.wsgi [None req-4e06b774-cd74-4629-a831-b6e3dc4f2499 tempest-AttachVolumeTestJSON-709357402 tempest-AttachVolumeTestJSON-709357402-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116064) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 14 13:06:04.626496 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.compute.api [None req-4e06b774-cd74-4629-a831-b6e3dc4f2499 tempest-AttachVolumeTestJSON-709357402 tempest-AttachVolumeTestJSON-709357402-project] [instance: bcb32a16-9097-40bc-9cd9-eee14f505d1d] Fetching instance by UUID {{(pid=116064) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 13:06:04.637785 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-4e06b774-cd74-4629-a831-b6e3dc4f2499 tempest-AttachVolumeTestJSON-709357402 tempest-AttachVolumeTestJSON-709357402-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 13:06:04.638221 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-4e06b774-cd74-4629-a831-b6e3dc4f2499 tempest-AttachVolumeTestJSON-709357402 tempest-AttachVolumeTestJSON-709357402-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 13:06:04.639009 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-4e06b774-cd74-4629-a831-b6e3dc4f2499 tempest-AttachVolumeTestJSON-709357402 tempest-AttachVolumeTestJSON-709357402-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 13:06:04.639440 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-4e06b774-cd74-4629-a831-b6e3dc4f2499 tempest-AttachVolumeTestJSON-709357402 tempest-AttachVolumeTestJSON-709357402-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 13:06:04.713468 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: INFO nova.api.openstack.requestlog [None req-4e06b774-cd74-4629-a831-b6e3dc4f2499 tempest-AttachVolumeTestJSON-709357402 tempest-AttachVolumeTestJSON-709357402-project] 10.222.0.49 "POST /compute/v2.1/servers/bcb32a16-9097-40bc-9cd9-eee14f505d1d/action" status: 200 len: 19133 microversion: 2.1 time: 0.095948 Dec 14 13:06:04.714167 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: [pid: 116064|app: 0|req: 491/1003] 10.222.0.49 () {60 vars in 1277 bytes} [Tue Dec 14 13:06:04 2021] POST /compute/v2.1/servers/bcb32a16-9097-40bc-9cd9-eee14f505d1d/action => generated 19133 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 14 13:06:05.725779 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.api.openstack.wsgi [None req-8a08fa07-889a-4922-ade9-c26dc13a8fcb tempest-AttachVolumeTestJSON-709357402 tempest-AttachVolumeTestJSON-709357402-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116063) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 14 13:06:05.726912 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.compute.api [None req-8a08fa07-889a-4922-ade9-c26dc13a8fcb tempest-AttachVolumeTestJSON-709357402 tempest-AttachVolumeTestJSON-709357402-project] [instance: bcb32a16-9097-40bc-9cd9-eee14f505d1d] Fetching instance by UUID {{(pid=116063) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 13:06:05.733904 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-8a08fa07-889a-4922-ade9-c26dc13a8fcb tempest-AttachVolumeTestJSON-709357402 tempest-AttachVolumeTestJSON-709357402-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 13:06:05.734349 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-8a08fa07-889a-4922-ade9-c26dc13a8fcb tempest-AttachVolumeTestJSON-709357402 tempest-AttachVolumeTestJSON-709357402-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 13:06:05.735133 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-8a08fa07-889a-4922-ade9-c26dc13a8fcb tempest-AttachVolumeTestJSON-709357402 tempest-AttachVolumeTestJSON-709357402-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 13:06:05.735564 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-8a08fa07-889a-4922-ade9-c26dc13a8fcb tempest-AttachVolumeTestJSON-709357402 tempest-AttachVolumeTestJSON-709357402-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 13:06:05.808200 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: INFO nova.api.openstack.requestlog [None req-8a08fa07-889a-4922-ade9-c26dc13a8fcb tempest-AttachVolumeTestJSON-709357402 tempest-AttachVolumeTestJSON-709357402-project] 10.222.0.49 "POST /compute/v2.1/servers/bcb32a16-9097-40bc-9cd9-eee14f505d1d/action" status: 200 len: 21674 microversion: 2.1 time: 0.086208 Dec 14 13:06:05.808916 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: [pid: 116063|app: 0|req: 513/1004] 10.222.0.49 () {60 vars in 1277 bytes} [Tue Dec 14 13:06:05 2021] POST /compute/v2.1/servers/bcb32a16-9097-40bc-9cd9-eee14f505d1d/action => generated 21674 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 14 13:06:06.820456 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.api.openstack.wsgi [None req-cf444c47-858f-423a-a59c-316385430112 tempest-AttachVolumeTestJSON-709357402 tempest-AttachVolumeTestJSON-709357402-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116064) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 14 13:06:06.821489 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.compute.api [None req-cf444c47-858f-423a-a59c-316385430112 tempest-AttachVolumeTestJSON-709357402 tempest-AttachVolumeTestJSON-709357402-project] [instance: bcb32a16-9097-40bc-9cd9-eee14f505d1d] Fetching instance by UUID {{(pid=116064) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 13:06:06.828752 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-cf444c47-858f-423a-a59c-316385430112 tempest-AttachVolumeTestJSON-709357402 tempest-AttachVolumeTestJSON-709357402-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 13:06:06.829234 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-cf444c47-858f-423a-a59c-316385430112 tempest-AttachVolumeTestJSON-709357402 tempest-AttachVolumeTestJSON-709357402-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 13:06:06.830018 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-cf444c47-858f-423a-a59c-316385430112 tempest-AttachVolumeTestJSON-709357402 tempest-AttachVolumeTestJSON-709357402-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 13:06:06.830455 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-cf444c47-858f-423a-a59c-316385430112 tempest-AttachVolumeTestJSON-709357402 tempest-AttachVolumeTestJSON-709357402-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 13:06:06.900053 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: INFO nova.api.openstack.requestlog [None req-cf444c47-858f-423a-a59c-316385430112 tempest-AttachVolumeTestJSON-709357402 tempest-AttachVolumeTestJSON-709357402-project] 10.222.0.49 "POST /compute/v2.1/servers/bcb32a16-9097-40bc-9cd9-eee14f505d1d/action" status: 200 len: 23235 microversion: 2.1 time: 0.083652 Dec 14 13:06:06.900697 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: [pid: 116064|app: 0|req: 492/1005] 10.222.0.49 () {60 vars in 1277 bytes} [Tue Dec 14 13:06:06 2021] POST /compute/v2.1/servers/bcb32a16-9097-40bc-9cd9-eee14f505d1d/action => generated 23235 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 14 13:06:07.912371 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.api.openstack.wsgi [None req-64f16667-c0cb-4000-9267-646b50a99c26 tempest-AttachVolumeTestJSON-709357402 tempest-AttachVolumeTestJSON-709357402-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116063) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 14 13:06:07.913405 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.compute.api [None req-64f16667-c0cb-4000-9267-646b50a99c26 tempest-AttachVolumeTestJSON-709357402 tempest-AttachVolumeTestJSON-709357402-project] [instance: bcb32a16-9097-40bc-9cd9-eee14f505d1d] Fetching instance by UUID {{(pid=116063) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 13:06:07.920840 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-64f16667-c0cb-4000-9267-646b50a99c26 tempest-AttachVolumeTestJSON-709357402 tempest-AttachVolumeTestJSON-709357402-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 13:06:07.921311 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-64f16667-c0cb-4000-9267-646b50a99c26 tempest-AttachVolumeTestJSON-709357402 tempest-AttachVolumeTestJSON-709357402-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 13:06:07.922074 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-64f16667-c0cb-4000-9267-646b50a99c26 tempest-AttachVolumeTestJSON-709357402 tempest-AttachVolumeTestJSON-709357402-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 13:06:07.922499 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-64f16667-c0cb-4000-9267-646b50a99c26 tempest-AttachVolumeTestJSON-709357402 tempest-AttachVolumeTestJSON-709357402-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 13:06:07.996318 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: INFO nova.api.openstack.requestlog [None req-64f16667-c0cb-4000-9267-646b50a99c26 tempest-AttachVolumeTestJSON-709357402 tempest-AttachVolumeTestJSON-709357402-project] 10.222.0.49 "POST /compute/v2.1/servers/bcb32a16-9097-40bc-9cd9-eee14f505d1d/action" status: 200 len: 24579 microversion: 2.1 time: 0.087759 Dec 14 13:06:07.997315 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: [pid: 116063|app: 0|req: 514/1006] 10.222.0.49 () {60 vars in 1277 bytes} [Tue Dec 14 13:06:07 2021] POST /compute/v2.1/servers/bcb32a16-9097-40bc-9cd9-eee14f505d1d/action => generated 24579 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 14 13:06:09.010250 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.api.openstack.wsgi [None req-6d12ae0d-bd17-43e2-b0f2-3b42080608af tempest-AttachVolumeTestJSON-709357402 tempest-AttachVolumeTestJSON-709357402-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116064) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 14 13:06:09.011258 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.compute.api [None req-6d12ae0d-bd17-43e2-b0f2-3b42080608af tempest-AttachVolumeTestJSON-709357402 tempest-AttachVolumeTestJSON-709357402-project] [instance: bcb32a16-9097-40bc-9cd9-eee14f505d1d] Fetching instance by UUID {{(pid=116064) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 13:06:09.018320 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-6d12ae0d-bd17-43e2-b0f2-3b42080608af tempest-AttachVolumeTestJSON-709357402 tempest-AttachVolumeTestJSON-709357402-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 13:06:09.018773 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-6d12ae0d-bd17-43e2-b0f2-3b42080608af tempest-AttachVolumeTestJSON-709357402 tempest-AttachVolumeTestJSON-709357402-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 13:06:09.019558 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-6d12ae0d-bd17-43e2-b0f2-3b42080608af tempest-AttachVolumeTestJSON-709357402 tempest-AttachVolumeTestJSON-709357402-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 13:06:09.019991 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-6d12ae0d-bd17-43e2-b0f2-3b42080608af tempest-AttachVolumeTestJSON-709357402 tempest-AttachVolumeTestJSON-709357402-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 13:06:09.105243 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: INFO nova.api.openstack.requestlog [None req-6d12ae0d-bd17-43e2-b0f2-3b42080608af tempest-AttachVolumeTestJSON-709357402 tempest-AttachVolumeTestJSON-709357402-project] 10.222.0.49 "POST /compute/v2.1/servers/bcb32a16-9097-40bc-9cd9-eee14f505d1d/action" status: 200 len: 26204 microversion: 2.1 time: 0.099697 Dec 14 13:06:09.106005 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: [pid: 116064|app: 0|req: 493/1007] 10.222.0.49 () {60 vars in 1277 bytes} [Tue Dec 14 13:06:09 2021] POST /compute/v2.1/servers/bcb32a16-9097-40bc-9cd9-eee14f505d1d/action => generated 26204 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 14 13:06:10.116920 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.api.openstack.wsgi [None req-84338099-41e9-47e0-b0c1-5822e9058c0d tempest-AttachVolumeTestJSON-709357402 tempest-AttachVolumeTestJSON-709357402-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116063) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 14 13:06:10.117975 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.compute.api [None req-84338099-41e9-47e0-b0c1-5822e9058c0d tempest-AttachVolumeTestJSON-709357402 tempest-AttachVolumeTestJSON-709357402-project] [instance: bcb32a16-9097-40bc-9cd9-eee14f505d1d] Fetching instance by UUID {{(pid=116063) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 13:06:10.124989 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-84338099-41e9-47e0-b0c1-5822e9058c0d tempest-AttachVolumeTestJSON-709357402 tempest-AttachVolumeTestJSON-709357402-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 13:06:10.125430 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-84338099-41e9-47e0-b0c1-5822e9058c0d tempest-AttachVolumeTestJSON-709357402 tempest-AttachVolumeTestJSON-709357402-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 13:06:10.126205 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-84338099-41e9-47e0-b0c1-5822e9058c0d tempest-AttachVolumeTestJSON-709357402 tempest-AttachVolumeTestJSON-709357402-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 13:06:10.126635 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-84338099-41e9-47e0-b0c1-5822e9058c0d tempest-AttachVolumeTestJSON-709357402 tempest-AttachVolumeTestJSON-709357402-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 13:06:10.210671 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: INFO nova.api.openstack.requestlog [None req-84338099-41e9-47e0-b0c1-5822e9058c0d tempest-AttachVolumeTestJSON-709357402 tempest-AttachVolumeTestJSON-709357402-project] 10.222.0.49 "POST /compute/v2.1/servers/bcb32a16-9097-40bc-9cd9-eee14f505d1d/action" status: 200 len: 27431 microversion: 2.1 time: 0.097640 Dec 14 13:06:10.212206 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: [pid: 116063|app: 0|req: 515/1008] 10.222.0.49 () {60 vars in 1277 bytes} [Tue Dec 14 13:06:10 2021] POST /compute/v2.1/servers/bcb32a16-9097-40bc-9cd9-eee14f505d1d/action => generated 27431 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 14 13:06:11.227370 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.api.openstack.wsgi [None req-e850a304-55a8-43de-976b-06611a231d39 tempest-AttachVolumeTestJSON-709357402 tempest-AttachVolumeTestJSON-709357402-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116064) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 14 13:06:11.228741 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.compute.api [None req-e850a304-55a8-43de-976b-06611a231d39 tempest-AttachVolumeTestJSON-709357402 tempest-AttachVolumeTestJSON-709357402-project] [instance: bcb32a16-9097-40bc-9cd9-eee14f505d1d] Fetching instance by UUID {{(pid=116064) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 13:06:11.236691 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-e850a304-55a8-43de-976b-06611a231d39 tempest-AttachVolumeTestJSON-709357402 tempest-AttachVolumeTestJSON-709357402-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 13:06:11.237168 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-e850a304-55a8-43de-976b-06611a231d39 tempest-AttachVolumeTestJSON-709357402 tempest-AttachVolumeTestJSON-709357402-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 13:06:11.237948 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-e850a304-55a8-43de-976b-06611a231d39 tempest-AttachVolumeTestJSON-709357402 tempest-AttachVolumeTestJSON-709357402-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 13:06:11.238377 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-e850a304-55a8-43de-976b-06611a231d39 tempest-AttachVolumeTestJSON-709357402 tempest-AttachVolumeTestJSON-709357402-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 13:06:11.313120 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: INFO nova.api.openstack.requestlog [None req-e850a304-55a8-43de-976b-06611a231d39 tempest-AttachVolumeTestJSON-709357402 tempest-AttachVolumeTestJSON-709357402-project] 10.222.0.49 "POST /compute/v2.1/servers/bcb32a16-9097-40bc-9cd9-eee14f505d1d/action" status: 200 len: 27960 microversion: 2.1 time: 0.092255 Dec 14 13:06:11.313923 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: [pid: 116064|app: 0|req: 494/1009] 10.222.0.49 () {60 vars in 1277 bytes} [Tue Dec 14 13:06:11 2021] POST /compute/v2.1/servers/bcb32a16-9097-40bc-9cd9-eee14f505d1d/action => generated 27960 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 14 13:06:12.330214 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.api.openstack.wsgi [None req-40faf881-94cb-4aeb-80be-72165a4760cc tempest-AttachVolumeTestJSON-709357402 tempest-AttachVolumeTestJSON-709357402-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116063) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 14 13:06:12.331833 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.compute.api [None req-40faf881-94cb-4aeb-80be-72165a4760cc tempest-AttachVolumeTestJSON-709357402 tempest-AttachVolumeTestJSON-709357402-project] [instance: bcb32a16-9097-40bc-9cd9-eee14f505d1d] Fetching instance by UUID {{(pid=116063) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 13:06:12.342239 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-40faf881-94cb-4aeb-80be-72165a4760cc tempest-AttachVolumeTestJSON-709357402 tempest-AttachVolumeTestJSON-709357402-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 13:06:12.342688 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-40faf881-94cb-4aeb-80be-72165a4760cc tempest-AttachVolumeTestJSON-709357402 tempest-AttachVolumeTestJSON-709357402-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 13:06:12.343465 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-40faf881-94cb-4aeb-80be-72165a4760cc tempest-AttachVolumeTestJSON-709357402 tempest-AttachVolumeTestJSON-709357402-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 13:06:12.343900 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-40faf881-94cb-4aeb-80be-72165a4760cc tempest-AttachVolumeTestJSON-709357402 tempest-AttachVolumeTestJSON-709357402-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 13:06:12.426680 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: INFO nova.api.openstack.requestlog [None req-40faf881-94cb-4aeb-80be-72165a4760cc tempest-AttachVolumeTestJSON-709357402 tempest-AttachVolumeTestJSON-709357402-project] 10.222.0.49 "POST /compute/v2.1/servers/bcb32a16-9097-40bc-9cd9-eee14f505d1d/action" status: 200 len: 28214 microversion: 2.1 time: 0.102787 Dec 14 13:06:12.427691 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: [pid: 116063|app: 0|req: 516/1010] 10.222.0.49 () {60 vars in 1277 bytes} [Tue Dec 14 13:06:12 2021] POST /compute/v2.1/servers/bcb32a16-9097-40bc-9cd9-eee14f505d1d/action => generated 28214 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 14 13:06:13.445665 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.api.openstack.wsgi [None req-e6d5746f-5b0a-48e5-b75a-9b607dc25fb2 tempest-AttachVolumeTestJSON-709357402 tempest-AttachVolumeTestJSON-709357402-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116064) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 14 13:06:13.447331 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.compute.api [None req-e6d5746f-5b0a-48e5-b75a-9b607dc25fb2 tempest-AttachVolumeTestJSON-709357402 tempest-AttachVolumeTestJSON-709357402-project] [instance: bcb32a16-9097-40bc-9cd9-eee14f505d1d] Fetching instance by UUID {{(pid=116064) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 13:06:13.455333 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-e6d5746f-5b0a-48e5-b75a-9b607dc25fb2 tempest-AttachVolumeTestJSON-709357402 tempest-AttachVolumeTestJSON-709357402-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 13:06:13.455783 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-e6d5746f-5b0a-48e5-b75a-9b607dc25fb2 tempest-AttachVolumeTestJSON-709357402 tempest-AttachVolumeTestJSON-709357402-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 13:06:13.456571 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-e6d5746f-5b0a-48e5-b75a-9b607dc25fb2 tempest-AttachVolumeTestJSON-709357402 tempest-AttachVolumeTestJSON-709357402-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 13:06:13.457044 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-e6d5746f-5b0a-48e5-b75a-9b607dc25fb2 tempest-AttachVolumeTestJSON-709357402 tempest-AttachVolumeTestJSON-709357402-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 13:06:13.518683 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: INFO nova.api.openstack.requestlog [None req-e6d5746f-5b0a-48e5-b75a-9b607dc25fb2 tempest-AttachVolumeTestJSON-709357402 tempest-AttachVolumeTestJSON-709357402-project] 10.222.0.49 "POST /compute/v2.1/servers/bcb32a16-9097-40bc-9cd9-eee14f505d1d/action" status: 200 len: 28214 microversion: 2.1 time: 0.079783 Dec 14 13:06:13.519314 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: [pid: 116064|app: 0|req: 495/1011] 10.222.0.49 () {60 vars in 1277 bytes} [Tue Dec 14 13:06:13 2021] POST /compute/v2.1/servers/bcb32a16-9097-40bc-9cd9-eee14f505d1d/action => generated 28214 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 14 13:06:14.530778 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.api.openstack.wsgi [None req-0df7cc26-6261-4018-bdff-ed0569c155f2 tempest-AttachVolumeTestJSON-709357402 tempest-AttachVolumeTestJSON-709357402-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116063) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 14 13:06:14.531772 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.compute.api [None req-0df7cc26-6261-4018-bdff-ed0569c155f2 tempest-AttachVolumeTestJSON-709357402 tempest-AttachVolumeTestJSON-709357402-project] [instance: bcb32a16-9097-40bc-9cd9-eee14f505d1d] Fetching instance by UUID {{(pid=116063) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 13:06:14.538967 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-0df7cc26-6261-4018-bdff-ed0569c155f2 tempest-AttachVolumeTestJSON-709357402 tempest-AttachVolumeTestJSON-709357402-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 13:06:14.539719 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-0df7cc26-6261-4018-bdff-ed0569c155f2 tempest-AttachVolumeTestJSON-709357402 tempest-AttachVolumeTestJSON-709357402-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 13:06:14.540501 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-0df7cc26-6261-4018-bdff-ed0569c155f2 tempest-AttachVolumeTestJSON-709357402 tempest-AttachVolumeTestJSON-709357402-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 13:06:14.540959 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-0df7cc26-6261-4018-bdff-ed0569c155f2 tempest-AttachVolumeTestJSON-709357402 tempest-AttachVolumeTestJSON-709357402-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 13:06:14.615748 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: INFO nova.api.openstack.requestlog [None req-0df7cc26-6261-4018-bdff-ed0569c155f2 tempest-AttachVolumeTestJSON-709357402 tempest-AttachVolumeTestJSON-709357402-project] 10.222.0.49 "POST /compute/v2.1/servers/bcb32a16-9097-40bc-9cd9-eee14f505d1d/action" status: 200 len: 28505 microversion: 2.1 time: 0.089249 Dec 14 13:06:14.616378 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: [pid: 116063|app: 0|req: 517/1012] 10.222.0.49 () {60 vars in 1277 bytes} [Tue Dec 14 13:06:14 2021] POST /compute/v2.1/servers/bcb32a16-9097-40bc-9cd9-eee14f505d1d/action => generated 28505 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 14 13:06:15.628320 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.api.openstack.wsgi [None req-d830508c-2c4a-4bdb-8fd6-404992695c66 tempest-AttachVolumeTestJSON-709357402 tempest-AttachVolumeTestJSON-709357402-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116064) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 14 13:06:15.630038 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.compute.api [None req-d830508c-2c4a-4bdb-8fd6-404992695c66 tempest-AttachVolumeTestJSON-709357402 tempest-AttachVolumeTestJSON-709357402-project] [instance: bcb32a16-9097-40bc-9cd9-eee14f505d1d] Fetching instance by UUID {{(pid=116064) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 13:06:15.639806 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-d830508c-2c4a-4bdb-8fd6-404992695c66 tempest-AttachVolumeTestJSON-709357402 tempest-AttachVolumeTestJSON-709357402-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 13:06:15.640342 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-d830508c-2c4a-4bdb-8fd6-404992695c66 tempest-AttachVolumeTestJSON-709357402 tempest-AttachVolumeTestJSON-709357402-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 13:06:15.641235 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-d830508c-2c4a-4bdb-8fd6-404992695c66 tempest-AttachVolumeTestJSON-709357402 tempest-AttachVolumeTestJSON-709357402-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 13:06:15.641758 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-d830508c-2c4a-4bdb-8fd6-404992695c66 tempest-AttachVolumeTestJSON-709357402 tempest-AttachVolumeTestJSON-709357402-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 13:06:15.732930 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: INFO nova.api.openstack.requestlog [None req-d830508c-2c4a-4bdb-8fd6-404992695c66 tempest-AttachVolumeTestJSON-709357402 tempest-AttachVolumeTestJSON-709357402-project] 10.222.0.49 "POST /compute/v2.1/servers/bcb32a16-9097-40bc-9cd9-eee14f505d1d/action" status: 200 len: 28673 microversion: 2.1 time: 0.108515 Dec 14 13:06:15.734453 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: [pid: 116064|app: 0|req: 496/1013] 10.222.0.49 () {60 vars in 1277 bytes} [Tue Dec 14 13:06:15 2021] POST /compute/v2.1/servers/bcb32a16-9097-40bc-9cd9-eee14f505d1d/action => generated 28673 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 14 13:06:16.746137 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.api.openstack.wsgi [None req-84f8c70a-0ab2-4854-8484-888402c7c0f9 tempest-AttachVolumeTestJSON-709357402 tempest-AttachVolumeTestJSON-709357402-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116063) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 14 13:06:16.747260 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.compute.api [None req-84f8c70a-0ab2-4854-8484-888402c7c0f9 tempest-AttachVolumeTestJSON-709357402 tempest-AttachVolumeTestJSON-709357402-project] [instance: bcb32a16-9097-40bc-9cd9-eee14f505d1d] Fetching instance by UUID {{(pid=116063) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 13:06:16.754657 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-84f8c70a-0ab2-4854-8484-888402c7c0f9 tempest-AttachVolumeTestJSON-709357402 tempest-AttachVolumeTestJSON-709357402-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 13:06:16.754891 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-84f8c70a-0ab2-4854-8484-888402c7c0f9 tempest-AttachVolumeTestJSON-709357402 tempest-AttachVolumeTestJSON-709357402-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 13:06:16.755690 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-84f8c70a-0ab2-4854-8484-888402c7c0f9 tempest-AttachVolumeTestJSON-709357402 tempest-AttachVolumeTestJSON-709357402-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 13:06:16.756126 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-84f8c70a-0ab2-4854-8484-888402c7c0f9 tempest-AttachVolumeTestJSON-709357402 tempest-AttachVolumeTestJSON-709357402-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 13:06:16.820540 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: INFO nova.api.openstack.requestlog [None req-84f8c70a-0ab2-4854-8484-888402c7c0f9 tempest-AttachVolumeTestJSON-709357402 tempest-AttachVolumeTestJSON-709357402-project] 10.222.0.49 "POST /compute/v2.1/servers/bcb32a16-9097-40bc-9cd9-eee14f505d1d/action" status: 200 len: 28673 microversion: 2.1 time: 0.078753 Dec 14 13:06:16.821890 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: [pid: 116063|app: 0|req: 518/1014] 10.222.0.49 () {60 vars in 1277 bytes} [Tue Dec 14 13:06:16 2021] POST /compute/v2.1/servers/bcb32a16-9097-40bc-9cd9-eee14f505d1d/action => generated 28673 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 14 13:06:17.832220 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.api.openstack.wsgi [None req-aa871e90-ec48-4f2f-9df9-52c2ef85b794 tempest-AttachVolumeTestJSON-709357402 tempest-AttachVolumeTestJSON-709357402-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116064) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 14 13:06:17.833446 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.compute.api [None req-aa871e90-ec48-4f2f-9df9-52c2ef85b794 tempest-AttachVolumeTestJSON-709357402 tempest-AttachVolumeTestJSON-709357402-project] [instance: bcb32a16-9097-40bc-9cd9-eee14f505d1d] Fetching instance by UUID {{(pid=116064) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 13:06:17.840439 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-aa871e90-ec48-4f2f-9df9-52c2ef85b794 tempest-AttachVolumeTestJSON-709357402 tempest-AttachVolumeTestJSON-709357402-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 13:06:17.840907 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-aa871e90-ec48-4f2f-9df9-52c2ef85b794 tempest-AttachVolumeTestJSON-709357402 tempest-AttachVolumeTestJSON-709357402-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 13:06:17.841906 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-aa871e90-ec48-4f2f-9df9-52c2ef85b794 tempest-AttachVolumeTestJSON-709357402 tempest-AttachVolumeTestJSON-709357402-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 13:06:17.842346 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-aa871e90-ec48-4f2f-9df9-52c2ef85b794 tempest-AttachVolumeTestJSON-709357402 tempest-AttachVolumeTestJSON-709357402-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 13:06:17.908466 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: INFO nova.api.openstack.requestlog [None req-aa871e90-ec48-4f2f-9df9-52c2ef85b794 tempest-AttachVolumeTestJSON-709357402 tempest-AttachVolumeTestJSON-709357402-project] 10.222.0.49 "POST /compute/v2.1/servers/bcb32a16-9097-40bc-9cd9-eee14f505d1d/action" status: 200 len: 28673 microversion: 2.1 time: 0.080269 Dec 14 13:06:17.909438 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: [pid: 116064|app: 0|req: 497/1015] 10.222.0.49 () {60 vars in 1277 bytes} [Tue Dec 14 13:06:17 2021] POST /compute/v2.1/servers/bcb32a16-9097-40bc-9cd9-eee14f505d1d/action => generated 28673 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 14 13:06:18.923193 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.api.openstack.wsgi [None req-5864791d-df9f-4575-b68c-ea60d9a81803 tempest-AttachVolumeTestJSON-709357402 tempest-AttachVolumeTestJSON-709357402-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116063) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 14 13:06:18.925385 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.compute.api [None req-5864791d-df9f-4575-b68c-ea60d9a81803 tempest-AttachVolumeTestJSON-709357402 tempest-AttachVolumeTestJSON-709357402-project] [instance: bcb32a16-9097-40bc-9cd9-eee14f505d1d] Fetching instance by UUID {{(pid=116063) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 13:06:18.933767 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-5864791d-df9f-4575-b68c-ea60d9a81803 tempest-AttachVolumeTestJSON-709357402 tempest-AttachVolumeTestJSON-709357402-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 13:06:18.934502 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-5864791d-df9f-4575-b68c-ea60d9a81803 tempest-AttachVolumeTestJSON-709357402 tempest-AttachVolumeTestJSON-709357402-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 13:06:18.935523 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-5864791d-df9f-4575-b68c-ea60d9a81803 tempest-AttachVolumeTestJSON-709357402 tempest-AttachVolumeTestJSON-709357402-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 13:06:18.936319 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-5864791d-df9f-4575-b68c-ea60d9a81803 tempest-AttachVolumeTestJSON-709357402 tempest-AttachVolumeTestJSON-709357402-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 13:06:19.018909 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: INFO nova.api.openstack.requestlog [None req-5864791d-df9f-4575-b68c-ea60d9a81803 tempest-AttachVolumeTestJSON-709357402 tempest-AttachVolumeTestJSON-709357402-project] 10.222.0.49 "POST /compute/v2.1/servers/bcb32a16-9097-40bc-9cd9-eee14f505d1d/action" status: 200 len: 29212 microversion: 2.1 time: 0.100409 Dec 14 13:06:19.020424 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: [pid: 116063|app: 0|req: 519/1016] 10.222.0.49 () {60 vars in 1277 bytes} [Tue Dec 14 13:06:18 2021] POST /compute/v2.1/servers/bcb32a16-9097-40bc-9cd9-eee14f505d1d/action => generated 29212 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 14 13:06:20.031231 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.api.openstack.wsgi [None req-a6c582fd-25b2-4bfe-a6da-a030289a6f53 tempest-AttachVolumeTestJSON-709357402 tempest-AttachVolumeTestJSON-709357402-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116064) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 14 13:06:20.032415 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.compute.api [None req-a6c582fd-25b2-4bfe-a6da-a030289a6f53 tempest-AttachVolumeTestJSON-709357402 tempest-AttachVolumeTestJSON-709357402-project] [instance: bcb32a16-9097-40bc-9cd9-eee14f505d1d] Fetching instance by UUID {{(pid=116064) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 13:06:20.039152 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-a6c582fd-25b2-4bfe-a6da-a030289a6f53 tempest-AttachVolumeTestJSON-709357402 tempest-AttachVolumeTestJSON-709357402-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 13:06:20.040377 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-a6c582fd-25b2-4bfe-a6da-a030289a6f53 tempest-AttachVolumeTestJSON-709357402 tempest-AttachVolumeTestJSON-709357402-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 13:06:20.041435 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-a6c582fd-25b2-4bfe-a6da-a030289a6f53 tempest-AttachVolumeTestJSON-709357402 tempest-AttachVolumeTestJSON-709357402-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 13:06:20.041965 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-a6c582fd-25b2-4bfe-a6da-a030289a6f53 tempest-AttachVolumeTestJSON-709357402 tempest-AttachVolumeTestJSON-709357402-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 13:06:20.120672 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: INFO nova.api.openstack.requestlog [None req-a6c582fd-25b2-4bfe-a6da-a030289a6f53 tempest-AttachVolumeTestJSON-709357402 tempest-AttachVolumeTestJSON-709357402-project] 10.222.0.49 "POST /compute/v2.1/servers/bcb32a16-9097-40bc-9cd9-eee14f505d1d/action" status: 200 len: 31579 microversion: 2.1 time: 0.094133 Dec 14 13:06:20.122401 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: [pid: 116064|app: 0|req: 498/1017] 10.222.0.49 () {60 vars in 1277 bytes} [Tue Dec 14 13:06:20 2021] POST /compute/v2.1/servers/bcb32a16-9097-40bc-9cd9-eee14f505d1d/action => generated 31579 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 14 13:06:21.132603 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.api.openstack.wsgi [None req-00d41af9-97e4-4901-bcc6-0d1a9055fe27 tempest-AttachVolumeTestJSON-709357402 tempest-AttachVolumeTestJSON-709357402-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116063) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 14 13:06:21.134335 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.compute.api [None req-00d41af9-97e4-4901-bcc6-0d1a9055fe27 tempest-AttachVolumeTestJSON-709357402 tempest-AttachVolumeTestJSON-709357402-project] [instance: bcb32a16-9097-40bc-9cd9-eee14f505d1d] Fetching instance by UUID {{(pid=116063) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 13:06:21.143598 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-00d41af9-97e4-4901-bcc6-0d1a9055fe27 tempest-AttachVolumeTestJSON-709357402 tempest-AttachVolumeTestJSON-709357402-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 13:06:21.144055 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-00d41af9-97e4-4901-bcc6-0d1a9055fe27 tempest-AttachVolumeTestJSON-709357402 tempest-AttachVolumeTestJSON-709357402-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 13:06:21.145069 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-00d41af9-97e4-4901-bcc6-0d1a9055fe27 tempest-AttachVolumeTestJSON-709357402 tempest-AttachVolumeTestJSON-709357402-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 13:06:21.145652 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-00d41af9-97e4-4901-bcc6-0d1a9055fe27 tempest-AttachVolumeTestJSON-709357402 tempest-AttachVolumeTestJSON-709357402-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 13:06:21.233447 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: INFO nova.api.openstack.requestlog [None req-00d41af9-97e4-4901-bcc6-0d1a9055fe27 tempest-AttachVolumeTestJSON-709357402 tempest-AttachVolumeTestJSON-709357402-project] 10.222.0.49 "POST /compute/v2.1/servers/bcb32a16-9097-40bc-9cd9-eee14f505d1d/action" status: 200 len: 33262 microversion: 2.1 time: 0.104597 Dec 14 13:06:21.233723 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: [pid: 116063|app: 0|req: 520/1018] 10.222.0.49 () {60 vars in 1277 bytes} [Tue Dec 14 13:06:21 2021] POST /compute/v2.1/servers/bcb32a16-9097-40bc-9cd9-eee14f505d1d/action => generated 33262 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 14 13:06:22.245897 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.api.openstack.wsgi [None req-4757ce1a-50f7-4f1c-b250-ed71064c0da6 tempest-AttachVolumeTestJSON-709357402 tempest-AttachVolumeTestJSON-709357402-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116064) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 14 13:06:22.247605 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.compute.api [None req-4757ce1a-50f7-4f1c-b250-ed71064c0da6 tempest-AttachVolumeTestJSON-709357402 tempest-AttachVolumeTestJSON-709357402-project] [instance: bcb32a16-9097-40bc-9cd9-eee14f505d1d] Fetching instance by UUID {{(pid=116064) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 13:06:22.254717 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-4757ce1a-50f7-4f1c-b250-ed71064c0da6 tempest-AttachVolumeTestJSON-709357402 tempest-AttachVolumeTestJSON-709357402-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 13:06:22.255359 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-4757ce1a-50f7-4f1c-b250-ed71064c0da6 tempest-AttachVolumeTestJSON-709357402 tempest-AttachVolumeTestJSON-709357402-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 13:06:22.256339 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-4757ce1a-50f7-4f1c-b250-ed71064c0da6 tempest-AttachVolumeTestJSON-709357402 tempest-AttachVolumeTestJSON-709357402-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 13:06:22.256955 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-4757ce1a-50f7-4f1c-b250-ed71064c0da6 tempest-AttachVolumeTestJSON-709357402 tempest-AttachVolumeTestJSON-709357402-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 13:06:22.335300 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: INFO nova.api.openstack.requestlog [None req-4757ce1a-50f7-4f1c-b250-ed71064c0da6 tempest-AttachVolumeTestJSON-709357402 tempest-AttachVolumeTestJSON-709357402-project] 10.222.0.49 "POST /compute/v2.1/servers/bcb32a16-9097-40bc-9cd9-eee14f505d1d/action" status: 200 len: 34231 microversion: 2.1 time: 0.093588 Dec 14 13:06:22.336549 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: [pid: 116064|app: 0|req: 499/1019] 10.222.0.49 () {60 vars in 1277 bytes} [Tue Dec 14 13:06:22 2021] POST /compute/v2.1/servers/bcb32a16-9097-40bc-9cd9-eee14f505d1d/action => generated 34231 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 14 13:06:23.347957 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.api.openstack.wsgi [None req-aa0313cc-fe9f-4cd6-912d-c874f9812249 tempest-AttachVolumeTestJSON-709357402 tempest-AttachVolumeTestJSON-709357402-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116063) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 14 13:06:23.350258 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.compute.api [None req-aa0313cc-fe9f-4cd6-912d-c874f9812249 tempest-AttachVolumeTestJSON-709357402 tempest-AttachVolumeTestJSON-709357402-project] [instance: bcb32a16-9097-40bc-9cd9-eee14f505d1d] Fetching instance by UUID {{(pid=116063) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 13:06:23.357802 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-aa0313cc-fe9f-4cd6-912d-c874f9812249 tempest-AttachVolumeTestJSON-709357402 tempest-AttachVolumeTestJSON-709357402-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 13:06:23.358379 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-aa0313cc-fe9f-4cd6-912d-c874f9812249 tempest-AttachVolumeTestJSON-709357402 tempest-AttachVolumeTestJSON-709357402-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 13:06:23.359494 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-aa0313cc-fe9f-4cd6-912d-c874f9812249 tempest-AttachVolumeTestJSON-709357402 tempest-AttachVolumeTestJSON-709357402-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 13:06:23.360080 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-aa0313cc-fe9f-4cd6-912d-c874f9812249 tempest-AttachVolumeTestJSON-709357402 tempest-AttachVolumeTestJSON-709357402-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 13:06:23.432131 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: INFO nova.api.openstack.requestlog [None req-aa0313cc-fe9f-4cd6-912d-c874f9812249 tempest-AttachVolumeTestJSON-709357402 tempest-AttachVolumeTestJSON-709357402-project] 10.222.0.49 "POST /compute/v2.1/servers/bcb32a16-9097-40bc-9cd9-eee14f505d1d/action" status: 200 len: 35328 microversion: 2.1 time: 0.088086 Dec 14 13:06:23.433122 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: [pid: 116063|app: 0|req: 521/1020] 10.222.0.49 () {60 vars in 1277 bytes} [Tue Dec 14 13:06:23 2021] POST /compute/v2.1/servers/bcb32a16-9097-40bc-9cd9-eee14f505d1d/action => generated 35328 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 14 13:06:24.444125 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.api.openstack.wsgi [None req-c0b36f3c-f821-4520-af35-c1da9bbb67c2 tempest-AttachVolumeTestJSON-709357402 tempest-AttachVolumeTestJSON-709357402-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116064) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 14 13:06:24.445166 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.compute.api [None req-c0b36f3c-f821-4520-af35-c1da9bbb67c2 tempest-AttachVolumeTestJSON-709357402 tempest-AttachVolumeTestJSON-709357402-project] [instance: bcb32a16-9097-40bc-9cd9-eee14f505d1d] Fetching instance by UUID {{(pid=116064) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 13:06:24.467674 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-c0b36f3c-f821-4520-af35-c1da9bbb67c2 tempest-AttachVolumeTestJSON-709357402 tempest-AttachVolumeTestJSON-709357402-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 13:06:24.468135 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-c0b36f3c-f821-4520-af35-c1da9bbb67c2 tempest-AttachVolumeTestJSON-709357402 tempest-AttachVolumeTestJSON-709357402-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 13:06:24.468968 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-c0b36f3c-f821-4520-af35-c1da9bbb67c2 tempest-AttachVolumeTestJSON-709357402 tempest-AttachVolumeTestJSON-709357402-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 13:06:24.469396 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-c0b36f3c-f821-4520-af35-c1da9bbb67c2 tempest-AttachVolumeTestJSON-709357402 tempest-AttachVolumeTestJSON-709357402-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 13:06:24.545371 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: INFO nova.api.openstack.requestlog [None req-c0b36f3c-f821-4520-af35-c1da9bbb67c2 tempest-AttachVolumeTestJSON-709357402 tempest-AttachVolumeTestJSON-709357402-project] 10.222.0.49 "POST /compute/v2.1/servers/bcb32a16-9097-40bc-9cd9-eee14f505d1d/action" status: 200 len: 36825 microversion: 2.1 time: 0.104993 Dec 14 13:06:24.547567 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: [pid: 116064|app: 0|req: 500/1021] 10.222.0.49 () {60 vars in 1277 bytes} [Tue Dec 14 13:06:24 2021] POST /compute/v2.1/servers/bcb32a16-9097-40bc-9cd9-eee14f505d1d/action => generated 36825 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 14 13:06:25.559274 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.api.openstack.wsgi [None req-e043ac81-fdc4-4cc4-8168-a4ad24c897d1 tempest-AttachVolumeTestJSON-709357402 tempest-AttachVolumeTestJSON-709357402-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116063) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 14 13:06:25.560650 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.compute.api [None req-e043ac81-fdc4-4cc4-8168-a4ad24c897d1 tempest-AttachVolumeTestJSON-709357402 tempest-AttachVolumeTestJSON-709357402-project] [instance: bcb32a16-9097-40bc-9cd9-eee14f505d1d] Fetching instance by UUID {{(pid=116063) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 13:06:25.578113 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-e043ac81-fdc4-4cc4-8168-a4ad24c897d1 tempest-AttachVolumeTestJSON-709357402 tempest-AttachVolumeTestJSON-709357402-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 13:06:25.578989 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-e043ac81-fdc4-4cc4-8168-a4ad24c897d1 tempest-AttachVolumeTestJSON-709357402 tempest-AttachVolumeTestJSON-709357402-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 13:06:25.580054 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-e043ac81-fdc4-4cc4-8168-a4ad24c897d1 tempest-AttachVolumeTestJSON-709357402 tempest-AttachVolumeTestJSON-709357402-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 13:06:25.581057 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-e043ac81-fdc4-4cc4-8168-a4ad24c897d1 tempest-AttachVolumeTestJSON-709357402 tempest-AttachVolumeTestJSON-709357402-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 13:06:25.677363 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: INFO nova.api.openstack.requestlog [None req-e043ac81-fdc4-4cc4-8168-a4ad24c897d1 tempest-AttachVolumeTestJSON-709357402 tempest-AttachVolumeTestJSON-709357402-project] 10.222.0.49 "POST /compute/v2.1/servers/bcb32a16-9097-40bc-9cd9-eee14f505d1d/action" status: 200 len: 38194 microversion: 2.1 time: 0.122796 Dec 14 13:06:25.678228 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: [pid: 116063|app: 0|req: 522/1022] 10.222.0.49 () {60 vars in 1277 bytes} [Tue Dec 14 13:06:25 2021] POST /compute/v2.1/servers/bcb32a16-9097-40bc-9cd9-eee14f505d1d/action => generated 38194 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 14 13:06:26.533061 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.api.openstack.wsgi [None req-26887dde-18c2-4664-b50b-9212d11db057 tempest-TestShelveInstance-1515730970 tempest-TestShelveInstance-1515730970-project] Action: 'create', calling method: .version_select at 0x7f2ace4fc820>, body: {"keypair": {"name": "tempest-TestShelveInstance-1808417179"}} {{(pid=116064) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 14 13:06:26.547952 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.quota [None req-26887dde-18c2-4664-b50b-9212d11db057 tempest-TestShelveInstance-1515730970 tempest-TestShelveInstance-1515730970-project] Getting quotas for project fe2a769f6b7645cbb7ec24ba01e13a4a. Resources: {'key_pairs'} {{(pid=116064) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 14 13:06:26.551916 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.quota [None req-26887dde-18c2-4664-b50b-9212d11db057 tempest-TestShelveInstance-1515730970 tempest-TestShelveInstance-1515730970-project] Getting quotas for user 818488ec88264dcdb3a7bac93352b56b and project fe2a769f6b7645cbb7ec24ba01e13a4a. Resources: {'key_pairs'} {{(pid=116064) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 14 13:06:26.690733 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.api.openstack.wsgi [None req-fadc2faa-c53e-4757-93ea-0f2eb9c23ae8 tempest-AttachVolumeTestJSON-709357402 tempest-AttachVolumeTestJSON-709357402-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116063) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 14 13:06:26.691734 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.compute.api [None req-fadc2faa-c53e-4757-93ea-0f2eb9c23ae8 tempest-AttachVolumeTestJSON-709357402 tempest-AttachVolumeTestJSON-709357402-project] [instance: bcb32a16-9097-40bc-9cd9-eee14f505d1d] Fetching instance by UUID {{(pid=116063) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 13:06:26.705631 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-fadc2faa-c53e-4757-93ea-0f2eb9c23ae8 tempest-AttachVolumeTestJSON-709357402 tempest-AttachVolumeTestJSON-709357402-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 13:06:26.706328 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-fadc2faa-c53e-4757-93ea-0f2eb9c23ae8 tempest-AttachVolumeTestJSON-709357402 tempest-AttachVolumeTestJSON-709357402-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 13:06:26.707339 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-fadc2faa-c53e-4757-93ea-0f2eb9c23ae8 tempest-AttachVolumeTestJSON-709357402 tempest-AttachVolumeTestJSON-709357402-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 13:06:26.707762 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-fadc2faa-c53e-4757-93ea-0f2eb9c23ae8 tempest-AttachVolumeTestJSON-709357402 tempest-AttachVolumeTestJSON-709357402-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 13:06:26.725395 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.quota [None req-26887dde-18c2-4664-b50b-9212d11db057 tempest-TestShelveInstance-1515730970 tempest-TestShelveInstance-1515730970-project] Getting quotas for project fe2a769f6b7645cbb7ec24ba01e13a4a. Resources: {'key_pairs'} {{(pid=116064) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 14 13:06:26.729310 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.quota [None req-26887dde-18c2-4664-b50b-9212d11db057 tempest-TestShelveInstance-1515730970 tempest-TestShelveInstance-1515730970-project] Getting quotas for user 818488ec88264dcdb3a7bac93352b56b and project fe2a769f6b7645cbb7ec24ba01e13a4a. Resources: {'key_pairs'} {{(pid=116064) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 14 13:06:26.742990 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: INFO nova.api.openstack.requestlog [None req-26887dde-18c2-4664-b50b-9212d11db057 tempest-TestShelveInstance-1515730970 tempest-TestShelveInstance-1515730970-project] 10.222.0.49 "POST /compute/v2.1/os-keypairs" status: 200 len: 2316 microversion: 2.1 time: 0.408078 Dec 14 13:06:26.743603 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: [pid: 116064|app: 0|req: 501/1023] 10.222.0.49 () {60 vars in 1157 bytes} [Tue Dec 14 13:06:26 2021] POST /compute/v2.1/os-keypairs => generated 2316 bytes in 410 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 14 13:06:26.773805 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: INFO nova.api.openstack.requestlog [None req-fadc2faa-c53e-4757-93ea-0f2eb9c23ae8 tempest-AttachVolumeTestJSON-709357402 tempest-AttachVolumeTestJSON-709357402-project] 10.222.0.49 "POST /compute/v2.1/servers/bcb32a16-9097-40bc-9cd9-eee14f505d1d/action" status: 200 len: 38194 microversion: 2.1 time: 0.087074 Dec 14 13:06:26.774470 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: [pid: 116063|app: 0|req: 523/1024] 10.222.0.49 () {60 vars in 1277 bytes} [Tue Dec 14 13:06:26 2021] POST /compute/v2.1/servers/bcb32a16-9097-40bc-9cd9-eee14f505d1d/action => generated 38194 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 14 13:06:26.966093 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Dec 14 13:06:26.966332 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: Tue Dec 14 13:06:26 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Dec 14 13:06:27.786819 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.api.openstack.wsgi [None req-96db3a1b-c46b-4675-b667-0a2eee7275e3 tempest-AttachVolumeTestJSON-709357402 tempest-AttachVolumeTestJSON-709357402-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116064) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 14 13:06:27.787953 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.compute.api [None req-96db3a1b-c46b-4675-b667-0a2eee7275e3 tempest-AttachVolumeTestJSON-709357402 tempest-AttachVolumeTestJSON-709357402-project] [instance: bcb32a16-9097-40bc-9cd9-eee14f505d1d] Fetching instance by UUID {{(pid=116064) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 13:06:27.794787 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-96db3a1b-c46b-4675-b667-0a2eee7275e3 tempest-AttachVolumeTestJSON-709357402 tempest-AttachVolumeTestJSON-709357402-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 13:06:27.795238 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-96db3a1b-c46b-4675-b667-0a2eee7275e3 tempest-AttachVolumeTestJSON-709357402 tempest-AttachVolumeTestJSON-709357402-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 13:06:27.796035 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-96db3a1b-c46b-4675-b667-0a2eee7275e3 tempest-AttachVolumeTestJSON-709357402 tempest-AttachVolumeTestJSON-709357402-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 13:06:27.796472 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-96db3a1b-c46b-4675-b667-0a2eee7275e3 tempest-AttachVolumeTestJSON-709357402 tempest-AttachVolumeTestJSON-709357402-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 13:06:27.858394 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: INFO nova.api.openstack.requestlog [None req-96db3a1b-c46b-4675-b667-0a2eee7275e3 tempest-AttachVolumeTestJSON-709357402 tempest-AttachVolumeTestJSON-709357402-project] 10.222.0.49 "POST /compute/v2.1/servers/bcb32a16-9097-40bc-9cd9-eee14f505d1d/action" status: 200 len: 38194 microversion: 2.1 time: 0.075543 Dec 14 13:06:27.859960 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: [pid: 116064|app: 0|req: 502/1025] 10.222.0.49 () {60 vars in 1277 bytes} [Tue Dec 14 13:06:27 2021] POST /compute/v2.1/servers/bcb32a16-9097-40bc-9cd9-eee14f505d1d/action => generated 38194 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 14 13:06:28.871904 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.api.openstack.wsgi [None req-2f6a31f9-5206-407f-8694-a2e842c7fe57 tempest-AttachVolumeTestJSON-709357402 tempest-AttachVolumeTestJSON-709357402-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116063) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 14 13:06:28.872907 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.compute.api [None req-2f6a31f9-5206-407f-8694-a2e842c7fe57 tempest-AttachVolumeTestJSON-709357402 tempest-AttachVolumeTestJSON-709357402-project] [instance: bcb32a16-9097-40bc-9cd9-eee14f505d1d] Fetching instance by UUID {{(pid=116063) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 13:06:28.879784 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-2f6a31f9-5206-407f-8694-a2e842c7fe57 tempest-AttachVolumeTestJSON-709357402 tempest-AttachVolumeTestJSON-709357402-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 13:06:28.880224 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-2f6a31f9-5206-407f-8694-a2e842c7fe57 tempest-AttachVolumeTestJSON-709357402 tempest-AttachVolumeTestJSON-709357402-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 13:06:28.881044 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-2f6a31f9-5206-407f-8694-a2e842c7fe57 tempest-AttachVolumeTestJSON-709357402 tempest-AttachVolumeTestJSON-709357402-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 13:06:28.881471 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-2f6a31f9-5206-407f-8694-a2e842c7fe57 tempest-AttachVolumeTestJSON-709357402 tempest-AttachVolumeTestJSON-709357402-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 13:06:28.941275 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: INFO nova.api.openstack.requestlog [None req-2f6a31f9-5206-407f-8694-a2e842c7fe57 tempest-AttachVolumeTestJSON-709357402 tempest-AttachVolumeTestJSON-709357402-project] 10.222.0.49 "POST /compute/v2.1/servers/bcb32a16-9097-40bc-9cd9-eee14f505d1d/action" status: 200 len: 38194 microversion: 2.1 time: 0.073276 Dec 14 13:06:28.941893 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: [pid: 116063|app: 0|req: 524/1026] 10.222.0.49 () {60 vars in 1277 bytes} [Tue Dec 14 13:06:28 2021] POST /compute/v2.1/servers/bcb32a16-9097-40bc-9cd9-eee14f505d1d/action => generated 38194 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Dec 14 13:06:29.959357 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.api.openstack.wsgi [None req-ad03dcdc-c9d0-470f-960f-7f4be22a280c tempest-AttachVolumeTestJSON-709357402 tempest-AttachVolumeTestJSON-709357402-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116064) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 14 13:06:29.962602 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.compute.api [None req-ad03dcdc-c9d0-470f-960f-7f4be22a280c tempest-AttachVolumeTestJSON-709357402 tempest-AttachVolumeTestJSON-709357402-project] [instance: bcb32a16-9097-40bc-9cd9-eee14f505d1d] Fetching instance by UUID {{(pid=116064) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 13:06:29.985413 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-ad03dcdc-c9d0-470f-960f-7f4be22a280c tempest-AttachVolumeTestJSON-709357402 tempest-AttachVolumeTestJSON-709357402-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 13:06:29.985843 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-ad03dcdc-c9d0-470f-960f-7f4be22a280c tempest-AttachVolumeTestJSON-709357402 tempest-AttachVolumeTestJSON-709357402-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 13:06:29.986683 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-ad03dcdc-c9d0-470f-960f-7f4be22a280c tempest-AttachVolumeTestJSON-709357402 tempest-AttachVolumeTestJSON-709357402-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 13:06:29.987121 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-ad03dcdc-c9d0-470f-960f-7f4be22a280c tempest-AttachVolumeTestJSON-709357402 tempest-AttachVolumeTestJSON-709357402-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 13:06:30.064597 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: INFO nova.api.openstack.requestlog [None req-ad03dcdc-c9d0-470f-960f-7f4be22a280c tempest-AttachVolumeTestJSON-709357402 tempest-AttachVolumeTestJSON-709357402-project] 10.222.0.49 "POST /compute/v2.1/servers/bcb32a16-9097-40bc-9cd9-eee14f505d1d/action" status: 200 len: 38323 microversion: 2.1 time: 0.109241 Dec 14 13:06:30.065293 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: [pid: 116064|app: 0|req: 503/1027] 10.222.0.49 () {60 vars in 1277 bytes} [Tue Dec 14 13:06:29 2021] POST /compute/v2.1/servers/bcb32a16-9097-40bc-9cd9-eee14f505d1d/action => generated 38323 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 14 13:06:30.075881 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.api.openstack.wsgi [None req-6596f758-3873-4a2e-9b30-1e8849502d0c tempest-AttachVolumeTestJSON-709357402 tempest-AttachVolumeTestJSON-709357402-project] Calling method '>' {{(pid=116063) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 13:06:30.076498 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.compute.api [None req-6596f758-3873-4a2e-9b30-1e8849502d0c tempest-AttachVolumeTestJSON-709357402 tempest-AttachVolumeTestJSON-709357402-project] [instance: bcb32a16-9097-40bc-9cd9-eee14f505d1d] Fetching instance by UUID {{(pid=116063) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 13:06:30.085028 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-6596f758-3873-4a2e-9b30-1e8849502d0c tempest-AttachVolumeTestJSON-709357402 tempest-AttachVolumeTestJSON-709357402-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 13:06:30.088566 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-6596f758-3873-4a2e-9b30-1e8849502d0c tempest-AttachVolumeTestJSON-709357402 tempest-AttachVolumeTestJSON-709357402-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 13:06:30.089645 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-6596f758-3873-4a2e-9b30-1e8849502d0c tempest-AttachVolumeTestJSON-709357402 tempest-AttachVolumeTestJSON-709357402-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 13:06:30.090011 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-6596f758-3873-4a2e-9b30-1e8849502d0c tempest-AttachVolumeTestJSON-709357402 tempest-AttachVolumeTestJSON-709357402-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 13:06:30.115660 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: INFO nova.api.openstack.requestlog [None req-6596f758-3873-4a2e-9b30-1e8849502d0c tempest-AttachVolumeTestJSON-709357402 tempest-AttachVolumeTestJSON-709357402-project] 10.222.0.49 "GET /compute/v2.1/servers/bcb32a16-9097-40bc-9cd9-eee14f505d1d/ips" status: 200 len: 144 microversion: 2.1 time: 0.043818 Dec 14 13:06:30.117338 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: [pid: 116063|app: 0|req: 525/1028] 10.222.0.49 () {58 vars in 1247 bytes} [Tue Dec 14 13:06:30 2021] GET /compute/v2.1/servers/bcb32a16-9097-40bc-9cd9-eee14f505d1d/ips => generated 144 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 14 13:06:31.457026 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.api.openstack.wsgi [None req-e1dfa46c-c247-4864-bb85-72dc0e7c5c4f tempest-AttachVolumeTestJSON-709357402 tempest-AttachVolumeTestJSON-709357402-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "e3be64f6-f94e-4dff-919b-87bcc76feb43"}} {{(pid=116064) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 14 13:06:31.458189 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.compute.api [None req-e1dfa46c-c247-4864-bb85-72dc0e7c5c4f tempest-AttachVolumeTestJSON-709357402 tempest-AttachVolumeTestJSON-709357402-project] [instance: bcb32a16-9097-40bc-9cd9-eee14f505d1d] Fetching instance by UUID {{(pid=116064) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 13:06:31.465497 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-e1dfa46c-c247-4864-bb85-72dc0e7c5c4f tempest-AttachVolumeTestJSON-709357402 tempest-AttachVolumeTestJSON-709357402-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 13:06:31.465922 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-e1dfa46c-c247-4864-bb85-72dc0e7c5c4f tempest-AttachVolumeTestJSON-709357402 tempest-AttachVolumeTestJSON-709357402-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 13:06:31.466805 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-e1dfa46c-c247-4864-bb85-72dc0e7c5c4f tempest-AttachVolumeTestJSON-709357402 tempest-AttachVolumeTestJSON-709357402-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 13:06:31.467178 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-e1dfa46c-c247-4864-bb85-72dc0e7c5c4f tempest-AttachVolumeTestJSON-709357402 tempest-AttachVolumeTestJSON-709357402-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 13:06:31.719327 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: INFO nova.api.openstack.requestlog [None req-e1dfa46c-c247-4864-bb85-72dc0e7c5c4f tempest-AttachVolumeTestJSON-709357402 tempest-AttachVolumeTestJSON-709357402-project] 10.222.0.49 "POST /compute/v2.1/servers/bcb32a16-9097-40bc-9cd9-eee14f505d1d/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.266409 Dec 14 13:06:31.720557 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: [pid: 116064|app: 0|req: 504/1029] 10.222.0.49 () {60 vars in 1322 bytes} [Tue Dec 14 13:06:31 2021] POST /compute/v2.1/servers/bcb32a16-9097-40bc-9cd9-eee14f505d1d/os-volume_attachments => generated 194 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 14 13:06:38.157820 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.api.openstack.wsgi [None req-21a5c7cc-00cc-412a-a2cd-d04a90448c56 tempest-AttachVolumeTestJSON-709357402 tempest-AttachVolumeTestJSON-709357402-project] Calling method '>' {{(pid=116063) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 13:06:38.158727 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.compute.api [None req-21a5c7cc-00cc-412a-a2cd-d04a90448c56 tempest-AttachVolumeTestJSON-709357402 tempest-AttachVolumeTestJSON-709357402-project] [instance: bcb32a16-9097-40bc-9cd9-eee14f505d1d] Fetching instance by UUID {{(pid=116063) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 13:06:38.165550 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-21a5c7cc-00cc-412a-a2cd-d04a90448c56 tempest-AttachVolumeTestJSON-709357402 tempest-AttachVolumeTestJSON-709357402-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 13:06:38.165985 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-21a5c7cc-00cc-412a-a2cd-d04a90448c56 tempest-AttachVolumeTestJSON-709357402 tempest-AttachVolumeTestJSON-709357402-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 13:06:38.166747 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-21a5c7cc-00cc-412a-a2cd-d04a90448c56 tempest-AttachVolumeTestJSON-709357402 tempest-AttachVolumeTestJSON-709357402-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 13:06:38.167169 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-21a5c7cc-00cc-412a-a2cd-d04a90448c56 tempest-AttachVolumeTestJSON-709357402 tempest-AttachVolumeTestJSON-709357402-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 13:06:38.198097 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: INFO nova.api.openstack.requestlog [None req-21a5c7cc-00cc-412a-a2cd-d04a90448c56 tempest-AttachVolumeTestJSON-709357402 tempest-AttachVolumeTestJSON-709357402-project] 10.222.0.49 "GET /compute/v2.1/servers/bcb32a16-9097-40bc-9cd9-eee14f505d1d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044030 Dec 14 13:06:38.198659 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: [pid: 116063|app: 0|req: 526/1030] 10.222.0.49 () {58 vars in 1301 bytes} [Tue Dec 14 13:06:38 2021] GET /compute/v2.1/servers/bcb32a16-9097-40bc-9cd9-eee14f505d1d/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Dec 14 13:06:38.209211 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.api.openstack.wsgi [None req-e070bfc9-d1ce-4971-9461-1b9787572a0e tempest-AttachVolumeTestJSON-709357402 tempest-AttachVolumeTestJSON-709357402-project] Calling method '>' {{(pid=116064) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 13:06:38.209815 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.compute.api [None req-e070bfc9-d1ce-4971-9461-1b9787572a0e tempest-AttachVolumeTestJSON-709357402 tempest-AttachVolumeTestJSON-709357402-project] [instance: bcb32a16-9097-40bc-9cd9-eee14f505d1d] Fetching instance by UUID {{(pid=116064) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 13:06:38.216593 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-e070bfc9-d1ce-4971-9461-1b9787572a0e tempest-AttachVolumeTestJSON-709357402 tempest-AttachVolumeTestJSON-709357402-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 13:06:38.217079 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-e070bfc9-d1ce-4971-9461-1b9787572a0e tempest-AttachVolumeTestJSON-709357402 tempest-AttachVolumeTestJSON-709357402-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 13:06:38.217861 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-e070bfc9-d1ce-4971-9461-1b9787572a0e tempest-AttachVolumeTestJSON-709357402 tempest-AttachVolumeTestJSON-709357402-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 13:06:38.218293 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-e070bfc9-d1ce-4971-9461-1b9787572a0e tempest-AttachVolumeTestJSON-709357402 tempest-AttachVolumeTestJSON-709357402-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 13:06:38.247794 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: INFO nova.api.openstack.requestlog [None req-e070bfc9-d1ce-4971-9461-1b9787572a0e tempest-AttachVolumeTestJSON-709357402 tempest-AttachVolumeTestJSON-709357402-project] 10.222.0.49 "GET /compute/v2.1/servers/bcb32a16-9097-40bc-9cd9-eee14f505d1d/os-volume_attachments/e3be64f6-f94e-4dff-919b-87bcc76feb43" status: 200 len: 194 microversion: 2.1 time: 0.042703 Dec 14 13:06:38.248390 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: [pid: 116064|app: 0|req: 505/1031] 10.222.0.49 () {58 vars in 1412 bytes} [Tue Dec 14 13:06:38 2021] GET /compute/v2.1/servers/bcb32a16-9097-40bc-9cd9-eee14f505d1d/os-volume_attachments/e3be64f6-f94e-4dff-919b-87bcc76feb43 => generated 194 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 14 13:06:39.574940 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.api.openstack.wsgi [None req-5dbc0b2d-72d1-4fad-b81c-395437e75c66 tempest-AttachVolumeTestJSON-709357402 tempest-AttachVolumeTestJSON-709357402-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "82414176-52d2-44aa-9427-dcf0ff8233ca"}} {{(pid=116063) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 14 13:06:39.575997 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.compute.api [None req-5dbc0b2d-72d1-4fad-b81c-395437e75c66 tempest-AttachVolumeTestJSON-709357402 tempest-AttachVolumeTestJSON-709357402-project] [instance: bcb32a16-9097-40bc-9cd9-eee14f505d1d] Fetching instance by UUID {{(pid=116063) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 13:06:39.582482 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-5dbc0b2d-72d1-4fad-b81c-395437e75c66 tempest-AttachVolumeTestJSON-709357402 tempest-AttachVolumeTestJSON-709357402-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 13:06:39.582941 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-5dbc0b2d-72d1-4fad-b81c-395437e75c66 tempest-AttachVolumeTestJSON-709357402 tempest-AttachVolumeTestJSON-709357402-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 13:06:39.583737 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-5dbc0b2d-72d1-4fad-b81c-395437e75c66 tempest-AttachVolumeTestJSON-709357402 tempest-AttachVolumeTestJSON-709357402-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 13:06:39.584169 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-5dbc0b2d-72d1-4fad-b81c-395437e75c66 tempest-AttachVolumeTestJSON-709357402 tempest-AttachVolumeTestJSON-709357402-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 13:06:39.821973 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: INFO nova.api.openstack.requestlog [None req-5dbc0b2d-72d1-4fad-b81c-395437e75c66 tempest-AttachVolumeTestJSON-709357402 tempest-AttachVolumeTestJSON-709357402-project] 10.222.0.49 "POST /compute/v2.1/servers/bcb32a16-9097-40bc-9cd9-eee14f505d1d/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.250756 Dec 14 13:06:39.822682 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: [pid: 116063|app: 0|req: 527/1032] 10.222.0.49 () {60 vars in 1322 bytes} [Tue Dec 14 13:06:39 2021] POST /compute/v2.1/servers/bcb32a16-9097-40bc-9cd9-eee14f505d1d/os-volume_attachments => generated 194 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 14 13:06:44.924889 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.api.openstack.wsgi [None req-606c937e-5dae-40f5-b297-a7322e905b06 tempest-TestShelveInstance-1515730970 tempest-TestShelveInstance-1515730970-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestShelveInstance-server-850490765", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestShelveInstance-1808417179", "security_groups": [{"name": "tempest-secgroup-smoke-1472346795"}], "networks": [{"uuid": "0fe76859-0b1b-4fef-a154-9100fd562663"}], "block_device_mapping_v2": [{"uuid": "56c48242-3e96-450a-bd07-6ad3064e5896", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=116064) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 14 13:06:45.041935 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.network.neutron [None req-606c937e-5dae-40f5-b297-a7322e905b06 tempest-TestShelveInstance-1515730970 tempest-TestShelveInstance-1515730970-project] validate_networks() for [('0fe76859-0b1b-4fef-a154-9100fd562663', None, None, None, None, None)] {{(pid=116064) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Dec 14 13:06:45.444161 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.virt.hardware [None req-606c937e-5dae-40f5-b297-a7322e905b06 tempest-TestShelveInstance-1515730970 tempest-TestShelveInstance-1515730970-project] Flavor limits 0:0:0 {{(pid=116064) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Dec 14 13:06:45.444778 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.virt.hardware [None req-606c937e-5dae-40f5-b297-a7322e905b06 tempest-TestShelveInstance-1515730970 tempest-TestShelveInstance-1515730970-project] Image limits 0:0:0 {{(pid=116064) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Dec 14 13:06:45.445495 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.virt.hardware [None req-606c937e-5dae-40f5-b297-a7322e905b06 tempest-TestShelveInstance-1515730970 tempest-TestShelveInstance-1515730970-project] Flavor pref 0:0:0 {{(pid=116064) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Dec 14 13:06:45.446121 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.virt.hardware [None req-606c937e-5dae-40f5-b297-a7322e905b06 tempest-TestShelveInstance-1515730970 tempest-TestShelveInstance-1515730970-project] Image pref 0:0:0 {{(pid=116064) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Dec 14 13:06:45.446718 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.virt.hardware [None req-606c937e-5dae-40f5-b297-a7322e905b06 tempest-TestShelveInstance-1515730970 tempest-TestShelveInstance-1515730970-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=116064) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Dec 14 13:06:45.457668 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-606c937e-5dae-40f5-b297-a7322e905b06 tempest-TestShelveInstance-1515730970 tempest-TestShelveInstance-1515730970-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 13:06:45.458122 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-606c937e-5dae-40f5-b297-a7322e905b06 tempest-TestShelveInstance-1515730970 tempest-TestShelveInstance-1515730970-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 13:06:45.458943 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-606c937e-5dae-40f5-b297-a7322e905b06 tempest-TestShelveInstance-1515730970 tempest-TestShelveInstance-1515730970-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 13:06:45.459381 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-606c937e-5dae-40f5-b297-a7322e905b06 tempest-TestShelveInstance-1515730970 tempest-TestShelveInstance-1515730970-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 13:06:45.475846 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.quota [None req-606c937e-5dae-40f5-b297-a7322e905b06 tempest-TestShelveInstance-1515730970 tempest-TestShelveInstance-1515730970-project] Getting quotas for project fe2a769f6b7645cbb7ec24ba01e13a4a. Resources: {'cores', 'instances', 'ram'} {{(pid=116064) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 14 13:06:45.479991 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.quota [None req-606c937e-5dae-40f5-b297-a7322e905b06 tempest-TestShelveInstance-1515730970 tempest-TestShelveInstance-1515730970-project] Getting quotas for user 818488ec88264dcdb3a7bac93352b56b and project fe2a769f6b7645cbb7ec24ba01e13a4a. Resources: {'cores', 'instances', 'ram'} {{(pid=116064) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 14 13:06:45.535908 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.compute.api [None req-606c937e-5dae-40f5-b297-a7322e905b06 tempest-TestShelveInstance-1515730970 tempest-TestShelveInstance-1515730970-project] Going to run 1 instances... {{(pid=116064) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Dec 14 13:06:45.538118 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.compute.api [None req-606c937e-5dae-40f5-b297-a7322e905b06 tempest-TestShelveInstance-1515730970 tempest-TestShelveInstance-1515730970-project] [instance: 0c5fe6a3-7904-4ee6-9f04-90633ff50db2] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='56c48242-3e96-450a-bd07-6ad3064e5896',volume_size=None,volume_type=None)] {{(pid=116064) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Dec 14 13:06:45.669253 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: INFO nova.api.openstack.requestlog [None req-606c937e-5dae-40f5-b297-a7322e905b06 tempest-TestShelveInstance-1515730970 tempest-TestShelveInstance-1515730970-project] 10.222.0.49 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.748084 Dec 14 13:06:45.669916 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: [pid: 116064|app: 0|req: 506/1033] 10.222.0.49 () {60 vars in 1146 bytes} [Tue Dec 14 13:06:44 2021] POST /compute/v2.1/servers => generated 406 bytes in 749 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Dec 14 13:06:45.681078 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.api.openstack.wsgi [None req-c1117171-e7f4-43eb-a677-e299027c79fb tempest-TestShelveInstance-1515730970 tempest-TestShelveInstance-1515730970-project] Calling method '>' {{(pid=116063) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 13:06:45.681776 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.compute.api [None req-c1117171-e7f4-43eb-a677-e299027c79fb tempest-TestShelveInstance-1515730970 tempest-TestShelveInstance-1515730970-project] [instance: 0c5fe6a3-7904-4ee6-9f04-90633ff50db2] Fetching instance by UUID {{(pid=116063) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 13:06:45.736646 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.policy [None req-c1117171-e7f4-43eb-a677-e299027c79fb tempest-TestShelveInstance-1515730970 tempest-TestShelveInstance-1515730970-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '818488ec88264dcdb3a7bac93352b56b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe2a769f6b7645cbb7ec24ba01e13a4a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116063) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 13:06:45.743484 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: INFO nova.api.openstack.requestlog [None req-c1117171-e7f4-43eb-a677-e299027c79fb tempest-TestShelveInstance-1515730970 tempest-TestShelveInstance-1515730970-project] 10.222.0.49 "GET /compute/v2.1/servers/0c5fe6a3-7904-4ee6-9f04-90633ff50db2" status: 200 len: 1088 microversion: 2.1 time: 0.067012 Dec 14 13:06:45.744105 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: [pid: 116063|app: 0|req: 528/1034] 10.222.0.49 () {58 vars in 1235 bytes} [Tue Dec 14 13:06:45 2021] GET /compute/v2.1/servers/0c5fe6a3-7904-4ee6-9f04-90633ff50db2 => generated 1088 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 14 13:06:46.760617 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.api.openstack.wsgi [None req-98846e8d-fa8a-43c5-ac68-3c1a7bd90deb tempest-TestShelveInstance-1515730970 tempest-TestShelveInstance-1515730970-project] Calling method '>' {{(pid=116064) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 13:06:46.761263 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.compute.api [None req-98846e8d-fa8a-43c5-ac68-3c1a7bd90deb tempest-TestShelveInstance-1515730970 tempest-TestShelveInstance-1515730970-project] [instance: 0c5fe6a3-7904-4ee6-9f04-90633ff50db2] Fetching instance by UUID {{(pid=116064) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 13:06:46.768178 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-98846e8d-fa8a-43c5-ac68-3c1a7bd90deb tempest-TestShelveInstance-1515730970 tempest-TestShelveInstance-1515730970-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 13:06:46.768525 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-98846e8d-fa8a-43c5-ac68-3c1a7bd90deb tempest-TestShelveInstance-1515730970 tempest-TestShelveInstance-1515730970-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 13:06:46.769349 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-98846e8d-fa8a-43c5-ac68-3c1a7bd90deb tempest-TestShelveInstance-1515730970 tempest-TestShelveInstance-1515730970-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 13:06:46.769787 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-98846e8d-fa8a-43c5-ac68-3c1a7bd90deb tempest-TestShelveInstance-1515730970 tempest-TestShelveInstance-1515730970-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 13:06:46.831565 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.policy [None req-98846e8d-fa8a-43c5-ac68-3c1a7bd90deb tempest-TestShelveInstance-1515730970 tempest-TestShelveInstance-1515730970-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '818488ec88264dcdb3a7bac93352b56b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe2a769f6b7645cbb7ec24ba01e13a4a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116064) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 13:06:46.839006 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: INFO nova.api.openstack.requestlog [None req-98846e8d-fa8a-43c5-ac68-3c1a7bd90deb tempest-TestShelveInstance-1515730970 tempest-TestShelveInstance-1515730970-project] 10.222.0.49 "GET /compute/v2.1/servers/0c5fe6a3-7904-4ee6-9f04-90633ff50db2" status: 200 len: 1204 microversion: 2.1 time: 0.082754 Dec 14 13:06:46.839578 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: [pid: 116064|app: 0|req: 507/1035] 10.222.0.49 () {58 vars in 1235 bytes} [Tue Dec 14 13:06:46 2021] GET /compute/v2.1/servers/0c5fe6a3-7904-4ee6-9f04-90633ff50db2 => generated 1204 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 14 13:06:47.341596 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.api.openstack.wsgi [None req-7aa7f988-b21e-4145-b716-79522ac7daef tempest-AttachVolumeTestJSON-709357402 tempest-AttachVolumeTestJSON-709357402-project] Calling method '>' {{(pid=116063) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 13:06:47.343450 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.compute.api [None req-7aa7f988-b21e-4145-b716-79522ac7daef tempest-AttachVolumeTestJSON-709357402 tempest-AttachVolumeTestJSON-709357402-project] [instance: bcb32a16-9097-40bc-9cd9-eee14f505d1d] Fetching instance by UUID {{(pid=116063) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 13:06:47.351070 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-7aa7f988-b21e-4145-b716-79522ac7daef tempest-AttachVolumeTestJSON-709357402 tempest-AttachVolumeTestJSON-709357402-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 13:06:47.351533 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-7aa7f988-b21e-4145-b716-79522ac7daef tempest-AttachVolumeTestJSON-709357402 tempest-AttachVolumeTestJSON-709357402-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 13:06:47.352446 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-7aa7f988-b21e-4145-b716-79522ac7daef tempest-AttachVolumeTestJSON-709357402 tempest-AttachVolumeTestJSON-709357402-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 13:06:47.352894 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-7aa7f988-b21e-4145-b716-79522ac7daef tempest-AttachVolumeTestJSON-709357402 tempest-AttachVolumeTestJSON-709357402-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 13:06:47.387941 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: INFO nova.api.openstack.requestlog [None req-7aa7f988-b21e-4145-b716-79522ac7daef tempest-AttachVolumeTestJSON-709357402 tempest-AttachVolumeTestJSON-709357402-project] 10.222.0.49 "GET /compute/v2.1/servers/bcb32a16-9097-40bc-9cd9-eee14f505d1d/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.050179 Dec 14 13:06:47.388560 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: [pid: 116063|app: 0|req: 529/1036] 10.222.0.49 () {58 vars in 1301 bytes} [Tue Dec 14 13:06:47 2021] GET /compute/v2.1/servers/bcb32a16-9097-40bc-9cd9-eee14f505d1d/os-volume_attachments => generated 371 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 14 13:06:47.621668 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.api.openstack.wsgi [None req-bc04a6dc-a505-4247-8b91-ce4f42a9d900 tempest-AttachVolumeTestJSON-709357402 tempest-AttachVolumeTestJSON-709357402-project] Calling method '>' {{(pid=116064) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 13:06:47.622166 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.compute.api [None req-bc04a6dc-a505-4247-8b91-ce4f42a9d900 tempest-AttachVolumeTestJSON-709357402 tempest-AttachVolumeTestJSON-709357402-project] [instance: bcb32a16-9097-40bc-9cd9-eee14f505d1d] Fetching instance by UUID {{(pid=116064) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 13:06:47.628543 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-bc04a6dc-a505-4247-8b91-ce4f42a9d900 tempest-AttachVolumeTestJSON-709357402 tempest-AttachVolumeTestJSON-709357402-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 13:06:47.629026 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-bc04a6dc-a505-4247-8b91-ce4f42a9d900 tempest-AttachVolumeTestJSON-709357402 tempest-AttachVolumeTestJSON-709357402-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 13:06:47.629821 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-bc04a6dc-a505-4247-8b91-ce4f42a9d900 tempest-AttachVolumeTestJSON-709357402 tempest-AttachVolumeTestJSON-709357402-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 13:06:47.630260 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-bc04a6dc-a505-4247-8b91-ce4f42a9d900 tempest-AttachVolumeTestJSON-709357402 tempest-AttachVolumeTestJSON-709357402-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 13:06:47.659151 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: INFO nova.api.openstack.requestlog [None req-bc04a6dc-a505-4247-8b91-ce4f42a9d900 tempest-AttachVolumeTestJSON-709357402 tempest-AttachVolumeTestJSON-709357402-project] 10.222.0.49 "GET /compute/v2.1/servers/bcb32a16-9097-40bc-9cd9-eee14f505d1d/os-volume_attachments/e3be64f6-f94e-4dff-919b-87bcc76feb43" status: 200 len: 194 microversion: 2.1 time: 0.041339 Dec 14 13:06:47.660021 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: [pid: 116064|app: 0|req: 508/1037] 10.222.0.49 () {58 vars in 1412 bytes} [Tue Dec 14 13:06:47 2021] GET /compute/v2.1/servers/bcb32a16-9097-40bc-9cd9-eee14f505d1d/os-volume_attachments/e3be64f6-f94e-4dff-919b-87bcc76feb43 => generated 194 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 14 13:06:47.672302 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.api.openstack.wsgi [None req-95adc330-44ce-4585-b308-97978001e526 tempest-AttachVolumeTestJSON-709357402 tempest-AttachVolumeTestJSON-709357402-project] Calling method '>' {{(pid=116063) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 13:06:47.673080 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.compute.api [None req-95adc330-44ce-4585-b308-97978001e526 tempest-AttachVolumeTestJSON-709357402 tempest-AttachVolumeTestJSON-709357402-project] [instance: bcb32a16-9097-40bc-9cd9-eee14f505d1d] Fetching instance by UUID {{(pid=116063) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 13:06:47.681906 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-95adc330-44ce-4585-b308-97978001e526 tempest-AttachVolumeTestJSON-709357402 tempest-AttachVolumeTestJSON-709357402-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 13:06:47.682584 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-95adc330-44ce-4585-b308-97978001e526 tempest-AttachVolumeTestJSON-709357402 tempest-AttachVolumeTestJSON-709357402-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 13:06:47.683793 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-95adc330-44ce-4585-b308-97978001e526 tempest-AttachVolumeTestJSON-709357402 tempest-AttachVolumeTestJSON-709357402-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 13:06:47.684436 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-95adc330-44ce-4585-b308-97978001e526 tempest-AttachVolumeTestJSON-709357402 tempest-AttachVolumeTestJSON-709357402-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 13:06:47.863586 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.api.openstack.wsgi [None req-d2a18c39-9dc1-451c-b710-7fbf7c6db66c tempest-TestShelveInstance-1515730970 tempest-TestShelveInstance-1515730970-project] Calling method '>' {{(pid=116064) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 13:06:47.864725 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.compute.api [None req-d2a18c39-9dc1-451c-b710-7fbf7c6db66c tempest-TestShelveInstance-1515730970 tempest-TestShelveInstance-1515730970-project] [instance: 0c5fe6a3-7904-4ee6-9f04-90633ff50db2] Fetching instance by UUID {{(pid=116064) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 13:06:47.875356 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-d2a18c39-9dc1-451c-b710-7fbf7c6db66c tempest-TestShelveInstance-1515730970 tempest-TestShelveInstance-1515730970-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 13:06:47.876070 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-d2a18c39-9dc1-451c-b710-7fbf7c6db66c tempest-TestShelveInstance-1515730970 tempest-TestShelveInstance-1515730970-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 13:06:47.877075 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-d2a18c39-9dc1-451c-b710-7fbf7c6db66c tempest-TestShelveInstance-1515730970 tempest-TestShelveInstance-1515730970-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 13:06:47.877667 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-d2a18c39-9dc1-451c-b710-7fbf7c6db66c tempest-TestShelveInstance-1515730970 tempest-TestShelveInstance-1515730970-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 13:06:47.937447 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.objects.instance [None req-95adc330-44ce-4585-b308-97978001e526 tempest-AttachVolumeTestJSON-709357402 tempest-AttachVolumeTestJSON-709357402-project] Lazy-loading 'services' on Instance uuid bcb32a16-9097-40bc-9cd9-eee14f505d1d {{(pid=116063) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Dec 14 13:06:48.033079 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: INFO nova.api.openstack.requestlog [None req-95adc330-44ce-4585-b308-97978001e526 tempest-AttachVolumeTestJSON-709357402 tempest-AttachVolumeTestJSON-709357402-project] 10.222.0.49 "DELETE /compute/v2.1/servers/bcb32a16-9097-40bc-9cd9-eee14f505d1d/os-volume_attachments/e3be64f6-f94e-4dff-919b-87bcc76feb43" status: 202 len: 0 microversion: 2.1 time: 0.366760 Dec 14 13:06:48.034436 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: [pid: 116063|app: 0|req: 530/1038] 10.222.0.49 () {58 vars in 1415 bytes} [Tue Dec 14 13:06:47 2021] DELETE /compute/v2.1/servers/bcb32a16-9097-40bc-9cd9-eee14f505d1d/os-volume_attachments/e3be64f6-f94e-4dff-919b-87bcc76feb43 => generated 0 bytes in 369 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Dec 14 13:06:48.041801 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.api.openstack.wsgi [req-eba8f4be-2e1d-4ed6-9047-a453bd4f871d req-90728f71-d364-4a63-9305-4080e1c74413 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0c5fe6a3-7904-4ee6-9f04-90633ff50db2", "tag": "6b399ecc-9d61-4402-b72e-7daa479ee08d"}]} {{(pid=116063) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 14 13:06:48.043975 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 14 13:06:48.043975 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: warnings.warn(msg) Dec 14 13:06:48.052198 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [req-eba8f4be-2e1d-4ed6-9047-a453bd4f871d req-90728f71-d364-4a63-9305-4080e1c74413 service nova] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 13:06:48.053077 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [req-eba8f4be-2e1d-4ed6-9047-a453bd4f871d req-90728f71-d364-4a63-9305-4080e1c74413 service nova] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 13:06:48.065637 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: INFO nova.api.openstack.compute.server_external_events [req-eba8f4be-2e1d-4ed6-9047-a453bd4f871d req-90728f71-d364-4a63-9305-4080e1c74413 service nova] Creating event network-changed:6b399ecc-9d61-4402-b72e-7daa479ee08d for instance 0c5fe6a3-7904-4ee6-9f04-90633ff50db2 on hv-cinder-78447 Dec 14 13:06:48.071445 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: INFO nova.api.openstack.requestlog [req-eba8f4be-2e1d-4ed6-9047-a453bd4f871d req-90728f71-d364-4a63-9305-4080e1c74413 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034256 Dec 14 13:06:48.072330 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: [pid: 116063|app: 0|req: 531/1039] 10.222.0.49 () {64 vars in 1317 bytes} [Tue Dec 14 13:06:48 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 14 13:06:48.111358 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.policy [None req-d2a18c39-9dc1-451c-b710-7fbf7c6db66c tempest-TestShelveInstance-1515730970 tempest-TestShelveInstance-1515730970-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '818488ec88264dcdb3a7bac93352b56b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe2a769f6b7645cbb7ec24ba01e13a4a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116064) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 13:06:48.120084 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: INFO nova.api.openstack.requestlog [None req-d2a18c39-9dc1-451c-b710-7fbf7c6db66c tempest-TestShelveInstance-1515730970 tempest-TestShelveInstance-1515730970-project] 10.222.0.49 "GET /compute/v2.1/servers/0c5fe6a3-7904-4ee6-9f04-90633ff50db2" status: 200 len: 1260 microversion: 2.1 time: 0.263088 Dec 14 13:06:48.120978 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: [pid: 116064|app: 0|req: 509/1040] 10.222.0.49 () {58 vars in 1235 bytes} [Tue Dec 14 13:06:47 2021] GET /compute/v2.1/servers/0c5fe6a3-7904-4ee6-9f04-90633ff50db2 => generated 1260 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 14 13:06:49.138634 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.api.openstack.wsgi [None req-278f39ca-0696-43d5-97bf-65ed90c43e0e tempest-TestShelveInstance-1515730970 tempest-TestShelveInstance-1515730970-project] Calling method '>' {{(pid=116063) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 13:06:49.139338 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.compute.api [None req-278f39ca-0696-43d5-97bf-65ed90c43e0e tempest-TestShelveInstance-1515730970 tempest-TestShelveInstance-1515730970-project] [instance: 0c5fe6a3-7904-4ee6-9f04-90633ff50db2] Fetching instance by UUID {{(pid=116063) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 13:06:49.146447 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-278f39ca-0696-43d5-97bf-65ed90c43e0e tempest-TestShelveInstance-1515730970 tempest-TestShelveInstance-1515730970-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 13:06:49.146969 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-278f39ca-0696-43d5-97bf-65ed90c43e0e tempest-TestShelveInstance-1515730970 tempest-TestShelveInstance-1515730970-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 13:06:49.147697 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-278f39ca-0696-43d5-97bf-65ed90c43e0e tempest-TestShelveInstance-1515730970 tempest-TestShelveInstance-1515730970-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 13:06:49.148136 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-278f39ca-0696-43d5-97bf-65ed90c43e0e tempest-TestShelveInstance-1515730970 tempest-TestShelveInstance-1515730970-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 13:06:49.202201 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.api.openstack.wsgi [None req-25b4d0a9-c0ac-4562-8f05-c7b550f00602 tempest-AttachVolumeTestJSON-709357402 tempest-AttachVolumeTestJSON-709357402-project] Calling method '>' {{(pid=116064) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 13:06:49.202745 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.compute.api [None req-25b4d0a9-c0ac-4562-8f05-c7b550f00602 tempest-AttachVolumeTestJSON-709357402 tempest-AttachVolumeTestJSON-709357402-project] [instance: bcb32a16-9097-40bc-9cd9-eee14f505d1d] Fetching instance by UUID {{(pid=116064) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 13:06:49.209652 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-25b4d0a9-c0ac-4562-8f05-c7b550f00602 tempest-AttachVolumeTestJSON-709357402 tempest-AttachVolumeTestJSON-709357402-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 13:06:49.210101 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-25b4d0a9-c0ac-4562-8f05-c7b550f00602 tempest-AttachVolumeTestJSON-709357402 tempest-AttachVolumeTestJSON-709357402-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 13:06:49.210931 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-25b4d0a9-c0ac-4562-8f05-c7b550f00602 tempest-AttachVolumeTestJSON-709357402 tempest-AttachVolumeTestJSON-709357402-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 13:06:49.211390 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-25b4d0a9-c0ac-4562-8f05-c7b550f00602 tempest-AttachVolumeTestJSON-709357402 tempest-AttachVolumeTestJSON-709357402-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 13:06:49.241258 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: INFO nova.api.openstack.requestlog [None req-25b4d0a9-c0ac-4562-8f05-c7b550f00602 tempest-AttachVolumeTestJSON-709357402 tempest-AttachVolumeTestJSON-709357402-project] 10.222.0.49 "GET /compute/v2.1/servers/bcb32a16-9097-40bc-9cd9-eee14f505d1d/os-volume_attachments/82414176-52d2-44aa-9427-dcf0ff8233ca" status: 200 len: 194 microversion: 2.1 time: 0.042806 Dec 14 13:06:49.241834 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: [pid: 116064|app: 0|req: 510/1041] 10.222.0.49 () {58 vars in 1412 bytes} [Tue Dec 14 13:06:49 2021] GET /compute/v2.1/servers/bcb32a16-9097-40bc-9cd9-eee14f505d1d/os-volume_attachments/82414176-52d2-44aa-9427-dcf0ff8233ca => generated 194 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Dec 14 13:06:49.251029 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.api.openstack.wsgi [None req-65c06e3f-ba07-4d98-a3c5-74cf23d2c0aa tempest-AttachVolumeTestJSON-709357402 tempest-AttachVolumeTestJSON-709357402-project] Calling method '>' {{(pid=116064) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 13:06:49.251533 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.compute.api [None req-65c06e3f-ba07-4d98-a3c5-74cf23d2c0aa tempest-AttachVolumeTestJSON-709357402 tempest-AttachVolumeTestJSON-709357402-project] [instance: bcb32a16-9097-40bc-9cd9-eee14f505d1d] Fetching instance by UUID {{(pid=116064) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 13:06:49.257404 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-65c06e3f-ba07-4d98-a3c5-74cf23d2c0aa tempest-AttachVolumeTestJSON-709357402 tempest-AttachVolumeTestJSON-709357402-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 13:06:49.257848 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-65c06e3f-ba07-4d98-a3c5-74cf23d2c0aa tempest-AttachVolumeTestJSON-709357402 tempest-AttachVolumeTestJSON-709357402-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 13:06:49.258623 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-65c06e3f-ba07-4d98-a3c5-74cf23d2c0aa tempest-AttachVolumeTestJSON-709357402 tempest-AttachVolumeTestJSON-709357402-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 13:06:49.259051 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-65c06e3f-ba07-4d98-a3c5-74cf23d2c0aa tempest-AttachVolumeTestJSON-709357402 tempest-AttachVolumeTestJSON-709357402-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 13:06:49.282489 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.policy [None req-278f39ca-0696-43d5-97bf-65ed90c43e0e tempest-TestShelveInstance-1515730970 tempest-TestShelveInstance-1515730970-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '818488ec88264dcdb3a7bac93352b56b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe2a769f6b7645cbb7ec24ba01e13a4a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116063) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 13:06:49.290631 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: INFO nova.api.openstack.requestlog [None req-278f39ca-0696-43d5-97bf-65ed90c43e0e tempest-TestShelveInstance-1515730970 tempest-TestShelveInstance-1515730970-project] 10.222.0.49 "GET /compute/v2.1/servers/0c5fe6a3-7904-4ee6-9f04-90633ff50db2" status: 200 len: 1260 microversion: 2.1 time: 0.156571 Dec 14 13:06:49.291190 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: [pid: 116063|app: 0|req: 532/1042] 10.222.0.49 () {58 vars in 1235 bytes} [Tue Dec 14 13:06:49 2021] GET /compute/v2.1/servers/0c5fe6a3-7904-4ee6-9f04-90633ff50db2 => generated 1260 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 14 13:06:49.335010 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.objects.instance [None req-65c06e3f-ba07-4d98-a3c5-74cf23d2c0aa tempest-AttachVolumeTestJSON-709357402 tempest-AttachVolumeTestJSON-709357402-project] Lazy-loading 'services' on Instance uuid bcb32a16-9097-40bc-9cd9-eee14f505d1d {{(pid=116064) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Dec 14 13:06:49.416182 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: INFO nova.api.openstack.requestlog [None req-65c06e3f-ba07-4d98-a3c5-74cf23d2c0aa tempest-AttachVolumeTestJSON-709357402 tempest-AttachVolumeTestJSON-709357402-project] 10.222.0.49 "DELETE /compute/v2.1/servers/bcb32a16-9097-40bc-9cd9-eee14f505d1d/os-volume_attachments/82414176-52d2-44aa-9427-dcf0ff8233ca" status: 202 len: 0 microversion: 2.1 time: 0.168385 Dec 14 13:06:49.417015 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: [pid: 116064|app: 0|req: 511/1043] 10.222.0.49 () {58 vars in 1415 bytes} [Tue Dec 14 13:06:49 2021] DELETE /compute/v2.1/servers/bcb32a16-9097-40bc-9cd9-eee14f505d1d/os-volume_attachments/82414176-52d2-44aa-9427-dcf0ff8233ca => generated 0 bytes in 170 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Dec 14 13:06:50.311398 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.api.openstack.wsgi [None req-61b34228-0a8c-402e-b7ef-4c51bc24bd2e tempest-TestShelveInstance-1515730970 tempest-TestShelveInstance-1515730970-project] Calling method '>' {{(pid=116063) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 13:06:50.312369 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.compute.api [None req-61b34228-0a8c-402e-b7ef-4c51bc24bd2e tempest-TestShelveInstance-1515730970 tempest-TestShelveInstance-1515730970-project] [instance: 0c5fe6a3-7904-4ee6-9f04-90633ff50db2] Fetching instance by UUID {{(pid=116063) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 13:06:50.319538 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-61b34228-0a8c-402e-b7ef-4c51bc24bd2e tempest-TestShelveInstance-1515730970 tempest-TestShelveInstance-1515730970-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 13:06:50.319993 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-61b34228-0a8c-402e-b7ef-4c51bc24bd2e tempest-TestShelveInstance-1515730970 tempest-TestShelveInstance-1515730970-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 13:06:50.320764 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-61b34228-0a8c-402e-b7ef-4c51bc24bd2e tempest-TestShelveInstance-1515730970 tempest-TestShelveInstance-1515730970-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 13:06:50.321225 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-61b34228-0a8c-402e-b7ef-4c51bc24bd2e tempest-TestShelveInstance-1515730970 tempest-TestShelveInstance-1515730970-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 13:06:50.477287 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.policy [None req-61b34228-0a8c-402e-b7ef-4c51bc24bd2e tempest-TestShelveInstance-1515730970 tempest-TestShelveInstance-1515730970-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '818488ec88264dcdb3a7bac93352b56b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe2a769f6b7645cbb7ec24ba01e13a4a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116063) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 13:06:50.488189 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: INFO nova.api.openstack.requestlog [None req-61b34228-0a8c-402e-b7ef-4c51bc24bd2e tempest-TestShelveInstance-1515730970 tempest-TestShelveInstance-1515730970-project] 10.222.0.49 "GET /compute/v2.1/servers/0c5fe6a3-7904-4ee6-9f04-90633ff50db2" status: 200 len: 1260 microversion: 2.1 time: 0.183047 Dec 14 13:06:50.488768 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: [pid: 116063|app: 0|req: 533/1044] 10.222.0.49 () {58 vars in 1235 bytes} [Tue Dec 14 13:06:50 2021] GET /compute/v2.1/servers/0c5fe6a3-7904-4ee6-9f04-90633ff50db2 => generated 1260 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 14 13:06:50.576214 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.api.openstack.wsgi [None req-cffa4f5a-4f90-46fb-a8f4-f8f31b0dd447 tempest-AttachVolumeTestJSON-709357402 tempest-AttachVolumeTestJSON-709357402-project] Calling method '>' {{(pid=116064) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 13:06:50.577229 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.compute.api [None req-cffa4f5a-4f90-46fb-a8f4-f8f31b0dd447 tempest-AttachVolumeTestJSON-709357402 tempest-AttachVolumeTestJSON-709357402-project] [instance: bcb32a16-9097-40bc-9cd9-eee14f505d1d] Fetching instance by UUID {{(pid=116064) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 13:06:50.584116 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-cffa4f5a-4f90-46fb-a8f4-f8f31b0dd447 tempest-AttachVolumeTestJSON-709357402 tempest-AttachVolumeTestJSON-709357402-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 13:06:50.584562 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-cffa4f5a-4f90-46fb-a8f4-f8f31b0dd447 tempest-AttachVolumeTestJSON-709357402 tempest-AttachVolumeTestJSON-709357402-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 13:06:50.585385 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-cffa4f5a-4f90-46fb-a8f4-f8f31b0dd447 tempest-AttachVolumeTestJSON-709357402 tempest-AttachVolumeTestJSON-709357402-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 13:06:50.585816 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-cffa4f5a-4f90-46fb-a8f4-f8f31b0dd447 tempest-AttachVolumeTestJSON-709357402 tempest-AttachVolumeTestJSON-709357402-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 13:06:50.613765 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: INFO nova.api.openstack.requestlog [None req-cffa4f5a-4f90-46fb-a8f4-f8f31b0dd447 tempest-AttachVolumeTestJSON-709357402 tempest-AttachVolumeTestJSON-709357402-project] 10.222.0.49 "GET /compute/v2.1/servers/bcb32a16-9097-40bc-9cd9-eee14f505d1d/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.041694 Dec 14 13:06:50.614320 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: [pid: 116064|app: 0|req: 512/1045] 10.222.0.49 () {58 vars in 1301 bytes} [Tue Dec 14 13:06:50 2021] GET /compute/v2.1/servers/bcb32a16-9097-40bc-9cd9-eee14f505d1d/os-volume_attachments => generated 25 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Dec 14 13:06:50.715600 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.api.openstack.wsgi [None req-f429084f-fa34-4398-8a98-59d733267f2e tempest-AttachVolumeTestJSON-709357402 tempest-AttachVolumeTestJSON-709357402-project] Calling method '>' {{(pid=116063) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 13:06:50.716523 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.compute.api [None req-f429084f-fa34-4398-8a98-59d733267f2e tempest-AttachVolumeTestJSON-709357402 tempest-AttachVolumeTestJSON-709357402-project] [instance: bcb32a16-9097-40bc-9cd9-eee14f505d1d] Fetching instance by UUID {{(pid=116063) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 13:06:50.722888 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-f429084f-fa34-4398-8a98-59d733267f2e tempest-AttachVolumeTestJSON-709357402 tempest-AttachVolumeTestJSON-709357402-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 13:06:50.723343 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-f429084f-fa34-4398-8a98-59d733267f2e tempest-AttachVolumeTestJSON-709357402 tempest-AttachVolumeTestJSON-709357402-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 13:06:50.724129 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-f429084f-fa34-4398-8a98-59d733267f2e tempest-AttachVolumeTestJSON-709357402 tempest-AttachVolumeTestJSON-709357402-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 13:06:50.724548 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-f429084f-fa34-4398-8a98-59d733267f2e tempest-AttachVolumeTestJSON-709357402 tempest-AttachVolumeTestJSON-709357402-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 13:06:50.753579 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: INFO nova.api.openstack.requestlog [None req-f429084f-fa34-4398-8a98-59d733267f2e tempest-AttachVolumeTestJSON-709357402 tempest-AttachVolumeTestJSON-709357402-project] 10.222.0.49 "GET /compute/v2.1/servers/bcb32a16-9097-40bc-9cd9-eee14f505d1d/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.041773 Dec 14 13:06:50.754134 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: [pid: 116063|app: 0|req: 534/1046] 10.222.0.49 () {58 vars in 1301 bytes} [Tue Dec 14 13:06:50 2021] GET /compute/v2.1/servers/bcb32a16-9097-40bc-9cd9-eee14f505d1d/os-volume_attachments => generated 25 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Dec 14 13:06:50.811627 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.api.openstack.wsgi [None req-f3ccf3a1-94bd-473d-96c1-0aa0548edf81 tempest-AttachVolumeTestJSON-709357402 tempest-AttachVolumeTestJSON-709357402-project] Calling method '>' {{(pid=116064) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 13:06:50.812128 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.compute.api [None req-f3ccf3a1-94bd-473d-96c1-0aa0548edf81 tempest-AttachVolumeTestJSON-709357402 tempest-AttachVolumeTestJSON-709357402-project] [instance: bcb32a16-9097-40bc-9cd9-eee14f505d1d] Fetching instance by UUID {{(pid=116064) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 13:06:50.818204 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-f3ccf3a1-94bd-473d-96c1-0aa0548edf81 tempest-AttachVolumeTestJSON-709357402 tempest-AttachVolumeTestJSON-709357402-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 13:06:50.818655 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-f3ccf3a1-94bd-473d-96c1-0aa0548edf81 tempest-AttachVolumeTestJSON-709357402 tempest-AttachVolumeTestJSON-709357402-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 13:06:50.819423 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-f3ccf3a1-94bd-473d-96c1-0aa0548edf81 tempest-AttachVolumeTestJSON-709357402 tempest-AttachVolumeTestJSON-709357402-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 13:06:50.819856 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-f3ccf3a1-94bd-473d-96c1-0aa0548edf81 tempest-AttachVolumeTestJSON-709357402 tempest-AttachVolumeTestJSON-709357402-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 13:06:50.844248 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.compute.api [None req-f3ccf3a1-94bd-473d-96c1-0aa0548edf81 tempest-AttachVolumeTestJSON-709357402 tempest-AttachVolumeTestJSON-709357402-project] [instance: bcb32a16-9097-40bc-9cd9-eee14f505d1d] Going to try to terminate instance {{(pid=116064) delete /opt/stack/nova/nova/compute/api.py:2614}} Dec 14 13:06:50.923586 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: INFO nova.api.openstack.requestlog [None req-f3ccf3a1-94bd-473d-96c1-0aa0548edf81 tempest-AttachVolumeTestJSON-709357402 tempest-AttachVolumeTestJSON-709357402-project] 10.222.0.49 "DELETE /compute/v2.1/servers/bcb32a16-9097-40bc-9cd9-eee14f505d1d" status: 204 len: 0 microversion: 2.1 time: 0.115361 Dec 14 13:06:50.924187 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: [pid: 116064|app: 0|req: 513/1047] 10.222.0.49 () {58 vars in 1238 bytes} [Tue Dec 14 13:06:50 2021] DELETE /compute/v2.1/servers/bcb32a16-9097-40bc-9cd9-eee14f505d1d => generated 0 bytes in 117 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Dec 14 13:06:50.933875 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.api.openstack.wsgi [None req-8dd2ae2c-8f60-431c-b395-6fd922786a3b tempest-AttachVolumeTestJSON-709357402 tempest-AttachVolumeTestJSON-709357402-project] Calling method '>' {{(pid=116063) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 13:06:50.934901 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.compute.api [None req-8dd2ae2c-8f60-431c-b395-6fd922786a3b tempest-AttachVolumeTestJSON-709357402 tempest-AttachVolumeTestJSON-709357402-project] [instance: bcb32a16-9097-40bc-9cd9-eee14f505d1d] Fetching instance by UUID {{(pid=116063) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 13:06:50.941080 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-8dd2ae2c-8f60-431c-b395-6fd922786a3b tempest-AttachVolumeTestJSON-709357402 tempest-AttachVolumeTestJSON-709357402-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 13:06:50.941538 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-8dd2ae2c-8f60-431c-b395-6fd922786a3b tempest-AttachVolumeTestJSON-709357402 tempest-AttachVolumeTestJSON-709357402-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 13:06:50.942327 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-8dd2ae2c-8f60-431c-b395-6fd922786a3b tempest-AttachVolumeTestJSON-709357402 tempest-AttachVolumeTestJSON-709357402-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 13:06:50.942765 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-8dd2ae2c-8f60-431c-b395-6fd922786a3b tempest-AttachVolumeTestJSON-709357402 tempest-AttachVolumeTestJSON-709357402-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 13:06:51.076815 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.policy [None req-8dd2ae2c-8f60-431c-b395-6fd922786a3b tempest-AttachVolumeTestJSON-709357402 tempest-AttachVolumeTestJSON-709357402-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '083128ec42474a3e82a2b0fc8c278f4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b1a390d20a54f4d9529d286ab7764a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116063) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 13:06:51.084877 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: INFO nova.api.openstack.requestlog [None req-8dd2ae2c-8f60-431c-b395-6fd922786a3b tempest-AttachVolumeTestJSON-709357402 tempest-AttachVolumeTestJSON-709357402-project] 10.222.0.49 "GET /compute/v2.1/servers/bcb32a16-9097-40bc-9cd9-eee14f505d1d" status: 200 len: 1672 microversion: 2.1 time: 0.156101 Dec 14 13:06:51.085484 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: [pid: 116063|app: 0|req: 535/1048] 10.222.0.49 () {58 vars in 1235 bytes} [Tue Dec 14 13:06:50 2021] GET /compute/v2.1/servers/bcb32a16-9097-40bc-9cd9-eee14f505d1d => generated 1672 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 14 13:06:51.509750 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.api.openstack.wsgi [None req-9dd1996a-b57f-4aa6-9117-8815251b578d tempest-TestShelveInstance-1515730970 tempest-TestShelveInstance-1515730970-project] Calling method '>' {{(pid=116064) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 13:06:51.510883 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.compute.api [None req-9dd1996a-b57f-4aa6-9117-8815251b578d tempest-TestShelveInstance-1515730970 tempest-TestShelveInstance-1515730970-project] [instance: 0c5fe6a3-7904-4ee6-9f04-90633ff50db2] Fetching instance by UUID {{(pid=116064) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 13:06:51.519591 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-9dd1996a-b57f-4aa6-9117-8815251b578d tempest-TestShelveInstance-1515730970 tempest-TestShelveInstance-1515730970-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 13:06:51.520041 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-9dd1996a-b57f-4aa6-9117-8815251b578d tempest-TestShelveInstance-1515730970 tempest-TestShelveInstance-1515730970-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 13:06:51.520841 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-9dd1996a-b57f-4aa6-9117-8815251b578d tempest-TestShelveInstance-1515730970 tempest-TestShelveInstance-1515730970-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 13:06:51.521302 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-9dd1996a-b57f-4aa6-9117-8815251b578d tempest-TestShelveInstance-1515730970 tempest-TestShelveInstance-1515730970-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 13:06:51.658559 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.policy [None req-9dd1996a-b57f-4aa6-9117-8815251b578d tempest-TestShelveInstance-1515730970 tempest-TestShelveInstance-1515730970-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '818488ec88264dcdb3a7bac93352b56b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe2a769f6b7645cbb7ec24ba01e13a4a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116064) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 13:06:51.666424 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: INFO nova.api.openstack.requestlog [None req-9dd1996a-b57f-4aa6-9117-8815251b578d tempest-TestShelveInstance-1515730970 tempest-TestShelveInstance-1515730970-project] 10.222.0.49 "GET /compute/v2.1/servers/0c5fe6a3-7904-4ee6-9f04-90633ff50db2" status: 200 len: 1260 microversion: 2.1 time: 0.163415 Dec 14 13:06:51.666989 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: [pid: 116064|app: 0|req: 514/1049] 10.222.0.49 () {58 vars in 1235 bytes} [Tue Dec 14 13:06:51 2021] GET /compute/v2.1/servers/0c5fe6a3-7904-4ee6-9f04-90633ff50db2 => generated 1260 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 14 13:06:52.109157 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.api.openstack.wsgi [None req-6f347d74-3251-4b29-9893-177857bc6061 tempest-AttachVolumeTestJSON-709357402 tempest-AttachVolumeTestJSON-709357402-project] Calling method '>' {{(pid=116063) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 13:06:52.110029 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.compute.api [None req-6f347d74-3251-4b29-9893-177857bc6061 tempest-AttachVolumeTestJSON-709357402 tempest-AttachVolumeTestJSON-709357402-project] [instance: bcb32a16-9097-40bc-9cd9-eee14f505d1d] Fetching instance by UUID {{(pid=116063) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 13:06:52.118181 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-6f347d74-3251-4b29-9893-177857bc6061 tempest-AttachVolumeTestJSON-709357402 tempest-AttachVolumeTestJSON-709357402-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 13:06:52.118728 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-6f347d74-3251-4b29-9893-177857bc6061 tempest-AttachVolumeTestJSON-709357402 tempest-AttachVolumeTestJSON-709357402-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 13:06:52.119623 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-6f347d74-3251-4b29-9893-177857bc6061 tempest-AttachVolumeTestJSON-709357402 tempest-AttachVolumeTestJSON-709357402-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 13:06:52.120123 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-6f347d74-3251-4b29-9893-177857bc6061 tempest-AttachVolumeTestJSON-709357402 tempest-AttachVolumeTestJSON-709357402-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 13:06:52.294093 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.policy [None req-6f347d74-3251-4b29-9893-177857bc6061 tempest-AttachVolumeTestJSON-709357402 tempest-AttachVolumeTestJSON-709357402-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '083128ec42474a3e82a2b0fc8c278f4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b1a390d20a54f4d9529d286ab7764a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116063) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 13:06:52.302263 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: INFO nova.api.openstack.requestlog [None req-6f347d74-3251-4b29-9893-177857bc6061 tempest-AttachVolumeTestJSON-709357402 tempest-AttachVolumeTestJSON-709357402-project] 10.222.0.49 "GET /compute/v2.1/servers/bcb32a16-9097-40bc-9cd9-eee14f505d1d" status: 200 len: 1672 microversion: 2.1 time: 0.199428 Dec 14 13:06:52.302827 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: [pid: 116063|app: 0|req: 536/1050] 10.222.0.49 () {58 vars in 1235 bytes} [Tue Dec 14 13:06:52 2021] GET /compute/v2.1/servers/bcb32a16-9097-40bc-9cd9-eee14f505d1d => generated 1672 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 14 13:06:52.683296 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.api.openstack.wsgi [None req-1ec3f862-2269-4cce-ae21-68e0388116bd tempest-TestShelveInstance-1515730970 tempest-TestShelveInstance-1515730970-project] Calling method '>' {{(pid=116064) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 13:06:52.683910 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.compute.api [None req-1ec3f862-2269-4cce-ae21-68e0388116bd tempest-TestShelveInstance-1515730970 tempest-TestShelveInstance-1515730970-project] [instance: 0c5fe6a3-7904-4ee6-9f04-90633ff50db2] Fetching instance by UUID {{(pid=116064) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 13:06:52.690721 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-1ec3f862-2269-4cce-ae21-68e0388116bd tempest-TestShelveInstance-1515730970 tempest-TestShelveInstance-1515730970-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 13:06:52.691372 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-1ec3f862-2269-4cce-ae21-68e0388116bd tempest-TestShelveInstance-1515730970 tempest-TestShelveInstance-1515730970-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 13:06:52.692166 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-1ec3f862-2269-4cce-ae21-68e0388116bd tempest-TestShelveInstance-1515730970 tempest-TestShelveInstance-1515730970-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 13:06:52.692586 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-1ec3f862-2269-4cce-ae21-68e0388116bd tempest-TestShelveInstance-1515730970 tempest-TestShelveInstance-1515730970-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 13:06:52.826155 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.policy [None req-1ec3f862-2269-4cce-ae21-68e0388116bd tempest-TestShelveInstance-1515730970 tempest-TestShelveInstance-1515730970-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '818488ec88264dcdb3a7bac93352b56b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe2a769f6b7645cbb7ec24ba01e13a4a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116064) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 13:06:52.833716 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: INFO nova.api.openstack.requestlog [None req-1ec3f862-2269-4cce-ae21-68e0388116bd tempest-TestShelveInstance-1515730970 tempest-TestShelveInstance-1515730970-project] 10.222.0.49 "GET /compute/v2.1/servers/0c5fe6a3-7904-4ee6-9f04-90633ff50db2" status: 200 len: 1260 microversion: 2.1 time: 0.154185 Dec 14 13:06:52.834297 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: [pid: 116064|app: 0|req: 515/1051] 10.222.0.49 () {58 vars in 1235 bytes} [Tue Dec 14 13:06:52 2021] GET /compute/v2.1/servers/0c5fe6a3-7904-4ee6-9f04-90633ff50db2 => generated 1260 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 14 13:06:53.320037 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.api.openstack.wsgi [None req-fe0452f2-173c-49c1-bc05-a4bc3128d12e tempest-AttachVolumeTestJSON-709357402 tempest-AttachVolumeTestJSON-709357402-project] Calling method '>' {{(pid=116063) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 13:06:53.320761 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.compute.api [None req-fe0452f2-173c-49c1-bc05-a4bc3128d12e tempest-AttachVolumeTestJSON-709357402 tempest-AttachVolumeTestJSON-709357402-project] [instance: bcb32a16-9097-40bc-9cd9-eee14f505d1d] Fetching instance by UUID {{(pid=116063) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 13:06:53.327429 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-fe0452f2-173c-49c1-bc05-a4bc3128d12e tempest-AttachVolumeTestJSON-709357402 tempest-AttachVolumeTestJSON-709357402-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 13:06:53.327879 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-fe0452f2-173c-49c1-bc05-a4bc3128d12e tempest-AttachVolumeTestJSON-709357402 tempest-AttachVolumeTestJSON-709357402-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 13:06:53.328693 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-fe0452f2-173c-49c1-bc05-a4bc3128d12e tempest-AttachVolumeTestJSON-709357402 tempest-AttachVolumeTestJSON-709357402-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 13:06:53.329160 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-fe0452f2-173c-49c1-bc05-a4bc3128d12e tempest-AttachVolumeTestJSON-709357402 tempest-AttachVolumeTestJSON-709357402-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 13:06:53.388397 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.policy [None req-fe0452f2-173c-49c1-bc05-a4bc3128d12e tempest-AttachVolumeTestJSON-709357402 tempest-AttachVolumeTestJSON-709357402-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '083128ec42474a3e82a2b0fc8c278f4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b1a390d20a54f4d9529d286ab7764a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116063) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 13:06:53.396046 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: INFO nova.api.openstack.requestlog [None req-fe0452f2-173c-49c1-bc05-a4bc3128d12e tempest-AttachVolumeTestJSON-709357402 tempest-AttachVolumeTestJSON-709357402-project] 10.222.0.49 "GET /compute/v2.1/servers/bcb32a16-9097-40bc-9cd9-eee14f505d1d" status: 200 len: 1604 microversion: 2.1 time: 0.079807 Dec 14 13:06:53.396613 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: [pid: 116063|app: 0|req: 537/1052] 10.222.0.49 () {58 vars in 1235 bytes} [Tue Dec 14 13:06:53 2021] GET /compute/v2.1/servers/bcb32a16-9097-40bc-9cd9-eee14f505d1d => generated 1604 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 14 13:06:53.453456 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.api.openstack.wsgi [req-354190c4-77f2-4f10-af8f-c60fef1308c6 req-a79ad074-2347-4106-9212-0d7bd76ed9eb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bcb32a16-9097-40bc-9cd9-eee14f505d1d", "name": "network-vif-deleted", "tag": "f2dc7c1b-e719-44e8-b9aa-992821506ebe"}]} {{(pid=116064) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 14 13:06:53.455106 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 14 13:06:53.455106 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: warnings.warn(msg) Dec 14 13:06:53.465735 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [req-354190c4-77f2-4f10-af8f-c60fef1308c6 req-a79ad074-2347-4106-9212-0d7bd76ed9eb service nova] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 13:06:53.466182 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [req-354190c4-77f2-4f10-af8f-c60fef1308c6 req-a79ad074-2347-4106-9212-0d7bd76ed9eb service nova] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 13:06:53.478605 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: INFO nova.api.openstack.compute.server_external_events [req-354190c4-77f2-4f10-af8f-c60fef1308c6 req-a79ad074-2347-4106-9212-0d7bd76ed9eb service nova] Creating event network-vif-deleted:f2dc7c1b-e719-44e8-b9aa-992821506ebe for instance bcb32a16-9097-40bc-9cd9-eee14f505d1d on hv-cinder-78447 Dec 14 13:06:53.485164 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: INFO nova.api.openstack.requestlog [req-354190c4-77f2-4f10-af8f-c60fef1308c6 req-a79ad074-2347-4106-9212-0d7bd76ed9eb service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035538 Dec 14 13:06:53.485827 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: [pid: 116064|app: 0|req: 516/1053] 10.222.0.49 () {64 vars in 1317 bytes} [Tue Dec 14 13:06:53 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 14 13:06:53.851921 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.api.openstack.wsgi [None req-ef8e2712-9dc6-44bc-8bb8-c990678f5f20 tempest-TestShelveInstance-1515730970 tempest-TestShelveInstance-1515730970-project] Calling method '>' {{(pid=116063) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 13:06:53.852554 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.compute.api [None req-ef8e2712-9dc6-44bc-8bb8-c990678f5f20 tempest-TestShelveInstance-1515730970 tempest-TestShelveInstance-1515730970-project] [instance: 0c5fe6a3-7904-4ee6-9f04-90633ff50db2] Fetching instance by UUID {{(pid=116063) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 13:06:53.861659 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-ef8e2712-9dc6-44bc-8bb8-c990678f5f20 tempest-TestShelveInstance-1515730970 tempest-TestShelveInstance-1515730970-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 13:06:53.862136 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-ef8e2712-9dc6-44bc-8bb8-c990678f5f20 tempest-TestShelveInstance-1515730970 tempest-TestShelveInstance-1515730970-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 13:06:53.863003 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-ef8e2712-9dc6-44bc-8bb8-c990678f5f20 tempest-TestShelveInstance-1515730970 tempest-TestShelveInstance-1515730970-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 13:06:53.863427 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-ef8e2712-9dc6-44bc-8bb8-c990678f5f20 tempest-TestShelveInstance-1515730970 tempest-TestShelveInstance-1515730970-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 13:06:54.025742 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.policy [None req-ef8e2712-9dc6-44bc-8bb8-c990678f5f20 tempest-TestShelveInstance-1515730970 tempest-TestShelveInstance-1515730970-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '818488ec88264dcdb3a7bac93352b56b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe2a769f6b7645cbb7ec24ba01e13a4a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116063) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 13:06:54.033304 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: INFO nova.api.openstack.requestlog [None req-ef8e2712-9dc6-44bc-8bb8-c990678f5f20 tempest-TestShelveInstance-1515730970 tempest-TestShelveInstance-1515730970-project] 10.222.0.49 "GET /compute/v2.1/servers/0c5fe6a3-7904-4ee6-9f04-90633ff50db2" status: 200 len: 1260 microversion: 2.1 time: 0.186229 Dec 14 13:06:54.033867 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: [pid: 116063|app: 0|req: 538/1054] 10.222.0.49 () {58 vars in 1235 bytes} [Tue Dec 14 13:06:53 2021] GET /compute/v2.1/servers/0c5fe6a3-7904-4ee6-9f04-90633ff50db2 => generated 1260 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 14 13:06:54.414268 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.api.openstack.wsgi [None req-19f9a231-79e9-4bba-8b01-1181a9cf9259 tempest-AttachVolumeTestJSON-709357402 tempest-AttachVolumeTestJSON-709357402-project] Calling method '>' {{(pid=116064) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 13:06:54.415030 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.compute.api [None req-19f9a231-79e9-4bba-8b01-1181a9cf9259 tempest-AttachVolumeTestJSON-709357402 tempest-AttachVolumeTestJSON-709357402-project] [instance: bcb32a16-9097-40bc-9cd9-eee14f505d1d] Fetching instance by UUID {{(pid=116064) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 13:06:54.422073 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-19f9a231-79e9-4bba-8b01-1181a9cf9259 tempest-AttachVolumeTestJSON-709357402 tempest-AttachVolumeTestJSON-709357402-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 13:06:54.422535 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-19f9a231-79e9-4bba-8b01-1181a9cf9259 tempest-AttachVolumeTestJSON-709357402 tempest-AttachVolumeTestJSON-709357402-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 13:06:54.423339 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-19f9a231-79e9-4bba-8b01-1181a9cf9259 tempest-AttachVolumeTestJSON-709357402 tempest-AttachVolumeTestJSON-709357402-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 13:06:54.423783 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-19f9a231-79e9-4bba-8b01-1181a9cf9259 tempest-AttachVolumeTestJSON-709357402 tempest-AttachVolumeTestJSON-709357402-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 13:06:54.438085 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: INFO nova.api.openstack.wsgi [None req-19f9a231-79e9-4bba-8b01-1181a9cf9259 tempest-AttachVolumeTestJSON-709357402 tempest-AttachVolumeTestJSON-709357402-project] HTTP exception thrown: Instance bcb32a16-9097-40bc-9cd9-eee14f505d1d could not be found. Dec 14 13:06:54.438791 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.api.openstack.wsgi [None req-19f9a231-79e9-4bba-8b01-1181a9cf9259 tempest-AttachVolumeTestJSON-709357402 tempest-AttachVolumeTestJSON-709357402-project] Returning 404 to user: Instance bcb32a16-9097-40bc-9cd9-eee14f505d1d could not be found. {{(pid=116064) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 14 13:06:54.439739 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: INFO nova.api.openstack.requestlog [None req-19f9a231-79e9-4bba-8b01-1181a9cf9259 tempest-AttachVolumeTestJSON-709357402 tempest-AttachVolumeTestJSON-709357402-project] 10.222.0.49 "GET /compute/v2.1/servers/bcb32a16-9097-40bc-9cd9-eee14f505d1d" status: 404 len: 111 microversion: 2.1 time: 0.029860 Dec 14 13:06:54.440329 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: [pid: 116064|app: 0|req: 517/1055] 10.222.0.49 () {58 vars in 1235 bytes} [Tue Dec 14 13:06:54 2021] GET /compute/v2.1/servers/bcb32a16-9097-40bc-9cd9-eee14f505d1d => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Dec 14 13:06:54.449131 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.api.openstack.wsgi [None req-2f4ba282-084a-4d4d-b075-afcb98407243 tempest-AttachVolumeTestJSON-709357402 tempest-AttachVolumeTestJSON-709357402-project] Calling method '.version_select at 0x7f2acda96af0>' {{(pid=116063) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 13:06:54.468804 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: INFO nova.api.openstack.requestlog [None req-2f4ba282-084a-4d4d-b075-afcb98407243 tempest-AttachVolumeTestJSON-709357402 tempest-AttachVolumeTestJSON-709357402-project] 10.222.0.49 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1344262871" status: 202 len: 0 microversion: 2.1 time: 0.023490 Dec 14 13:06:54.469522 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: [pid: 116063|app: 0|req: 539/1056] 10.222.0.49 () {58 vars in 1220 bytes} [Tue Dec 14 13:06:54 2021] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1344262871 => generated 0 bytes in 25 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Dec 14 13:06:55.050786 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.api.openstack.wsgi [None req-a3971d8b-f458-4110-a6ee-0d14f197bbd5 tempest-TestShelveInstance-1515730970 tempest-TestShelveInstance-1515730970-project] Calling method '>' {{(pid=116064) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 13:06:55.051830 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.compute.api [None req-a3971d8b-f458-4110-a6ee-0d14f197bbd5 tempest-TestShelveInstance-1515730970 tempest-TestShelveInstance-1515730970-project] [instance: 0c5fe6a3-7904-4ee6-9f04-90633ff50db2] Fetching instance by UUID {{(pid=116064) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 13:06:55.058077 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-a3971d8b-f458-4110-a6ee-0d14f197bbd5 tempest-TestShelveInstance-1515730970 tempest-TestShelveInstance-1515730970-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 13:06:55.058541 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-a3971d8b-f458-4110-a6ee-0d14f197bbd5 tempest-TestShelveInstance-1515730970 tempest-TestShelveInstance-1515730970-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 13:06:55.059309 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-a3971d8b-f458-4110-a6ee-0d14f197bbd5 tempest-TestShelveInstance-1515730970 tempest-TestShelveInstance-1515730970-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 13:06:55.059743 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-a3971d8b-f458-4110-a6ee-0d14f197bbd5 tempest-TestShelveInstance-1515730970 tempest-TestShelveInstance-1515730970-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 13:06:55.198784 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.policy [None req-a3971d8b-f458-4110-a6ee-0d14f197bbd5 tempest-TestShelveInstance-1515730970 tempest-TestShelveInstance-1515730970-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '818488ec88264dcdb3a7bac93352b56b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe2a769f6b7645cbb7ec24ba01e13a4a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116064) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 13:06:55.206489 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: INFO nova.api.openstack.requestlog [None req-a3971d8b-f458-4110-a6ee-0d14f197bbd5 tempest-TestShelveInstance-1515730970 tempest-TestShelveInstance-1515730970-project] 10.222.0.49 "GET /compute/v2.1/servers/0c5fe6a3-7904-4ee6-9f04-90633ff50db2" status: 200 len: 1260 microversion: 2.1 time: 0.159599 Dec 14 13:06:55.207115 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: [pid: 116064|app: 0|req: 518/1057] 10.222.0.49 () {58 vars in 1235 bytes} [Tue Dec 14 13:06:55 2021] GET /compute/v2.1/servers/0c5fe6a3-7904-4ee6-9f04-90633ff50db2 => generated 1260 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 14 13:06:56.228123 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.api.openstack.wsgi [None req-1dd66ef8-027a-4961-90b8-6b67ee18faca tempest-TestShelveInstance-1515730970 tempest-TestShelveInstance-1515730970-project] Calling method '>' {{(pid=116063) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 13:06:56.229080 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.compute.api [None req-1dd66ef8-027a-4961-90b8-6b67ee18faca tempest-TestShelveInstance-1515730970 tempest-TestShelveInstance-1515730970-project] [instance: 0c5fe6a3-7904-4ee6-9f04-90633ff50db2] Fetching instance by UUID {{(pid=116063) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 13:06:56.240735 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-1dd66ef8-027a-4961-90b8-6b67ee18faca tempest-TestShelveInstance-1515730970 tempest-TestShelveInstance-1515730970-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 13:06:56.241538 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-1dd66ef8-027a-4961-90b8-6b67ee18faca tempest-TestShelveInstance-1515730970 tempest-TestShelveInstance-1515730970-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 13:06:56.242828 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-1dd66ef8-027a-4961-90b8-6b67ee18faca tempest-TestShelveInstance-1515730970 tempest-TestShelveInstance-1515730970-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 13:06:56.243549 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-1dd66ef8-027a-4961-90b8-6b67ee18faca tempest-TestShelveInstance-1515730970 tempest-TestShelveInstance-1515730970-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 13:06:56.385903 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.policy [None req-1dd66ef8-027a-4961-90b8-6b67ee18faca tempest-TestShelveInstance-1515730970 tempest-TestShelveInstance-1515730970-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '818488ec88264dcdb3a7bac93352b56b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe2a769f6b7645cbb7ec24ba01e13a4a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116063) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 13:06:56.394007 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: INFO nova.api.openstack.requestlog [None req-1dd66ef8-027a-4961-90b8-6b67ee18faca tempest-TestShelveInstance-1515730970 tempest-TestShelveInstance-1515730970-project] 10.222.0.49 "GET /compute/v2.1/servers/0c5fe6a3-7904-4ee6-9f04-90633ff50db2" status: 200 len: 1260 microversion: 2.1 time: 0.173327 Dec 14 13:06:56.394578 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: [pid: 116063|app: 0|req: 540/1058] 10.222.0.49 () {58 vars in 1235 bytes} [Tue Dec 14 13:06:56 2021] GET /compute/v2.1/servers/0c5fe6a3-7904-4ee6-9f04-90633ff50db2 => generated 1260 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 14 13:06:57.190475 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.api.openstack.wsgi [req-1d8171f2-3914-49cf-b0b9-1826120d6163 req-8ded0924-3c18-4a5c-bfff-d4cc33bc0563 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0c5fe6a3-7904-4ee6-9f04-90633ff50db2", "name": "network-vif-plugged", "status": "completed", "tag": "6b399ecc-9d61-4402-b72e-7daa479ee08d"}]} {{(pid=116064) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 14 13:06:57.192209 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 14 13:06:57.192209 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: warnings.warn(msg) Dec 14 13:06:57.200735 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [req-1d8171f2-3914-49cf-b0b9-1826120d6163 req-8ded0924-3c18-4a5c-bfff-d4cc33bc0563 service nova] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 13:06:57.201463 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [req-1d8171f2-3914-49cf-b0b9-1826120d6163 req-8ded0924-3c18-4a5c-bfff-d4cc33bc0563 service nova] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 13:06:57.213544 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: INFO nova.api.openstack.compute.server_external_events [req-1d8171f2-3914-49cf-b0b9-1826120d6163 req-8ded0924-3c18-4a5c-bfff-d4cc33bc0563 service nova] Creating event network-vif-plugged:6b399ecc-9d61-4402-b72e-7daa479ee08d for instance 0c5fe6a3-7904-4ee6-9f04-90633ff50db2 on hv-cinder-78447 Dec 14 13:06:57.218521 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: INFO nova.api.openstack.requestlog [req-1d8171f2-3914-49cf-b0b9-1826120d6163 req-8ded0924-3c18-4a5c-bfff-d4cc33bc0563 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032115 Dec 14 13:06:57.219315 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: [pid: 116064|app: 0|req: 519/1059] 10.222.0.49 () {64 vars in 1317 bytes} [Tue Dec 14 13:06:57 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 14 13:06:57.411455 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.api.openstack.wsgi [None req-1831d5e4-18c0-4cb5-a8e8-741f8ed2d362 tempest-TestShelveInstance-1515730970 tempest-TestShelveInstance-1515730970-project] Calling method '>' {{(pid=116063) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 13:06:57.412068 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.compute.api [None req-1831d5e4-18c0-4cb5-a8e8-741f8ed2d362 tempest-TestShelveInstance-1515730970 tempest-TestShelveInstance-1515730970-project] [instance: 0c5fe6a3-7904-4ee6-9f04-90633ff50db2] Fetching instance by UUID {{(pid=116063) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 13:06:57.419376 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-1831d5e4-18c0-4cb5-a8e8-741f8ed2d362 tempest-TestShelveInstance-1515730970 tempest-TestShelveInstance-1515730970-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 13:06:57.419818 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-1831d5e4-18c0-4cb5-a8e8-741f8ed2d362 tempest-TestShelveInstance-1515730970 tempest-TestShelveInstance-1515730970-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 13:06:57.420596 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-1831d5e4-18c0-4cb5-a8e8-741f8ed2d362 tempest-TestShelveInstance-1515730970 tempest-TestShelveInstance-1515730970-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 13:06:57.421066 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-1831d5e4-18c0-4cb5-a8e8-741f8ed2d362 tempest-TestShelveInstance-1515730970 tempest-TestShelveInstance-1515730970-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 13:06:57.551792 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.policy [None req-1831d5e4-18c0-4cb5-a8e8-741f8ed2d362 tempest-TestShelveInstance-1515730970 tempest-TestShelveInstance-1515730970-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '818488ec88264dcdb3a7bac93352b56b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe2a769f6b7645cbb7ec24ba01e13a4a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116063) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 13:06:57.559476 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: INFO nova.api.openstack.requestlog [None req-1831d5e4-18c0-4cb5-a8e8-741f8ed2d362 tempest-TestShelveInstance-1515730970 tempest-TestShelveInstance-1515730970-project] 10.222.0.49 "GET /compute/v2.1/servers/0c5fe6a3-7904-4ee6-9f04-90633ff50db2" status: 200 len: 1260 microversion: 2.1 time: 0.151680 Dec 14 13:06:57.560047 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: [pid: 116063|app: 0|req: 541/1060] 10.222.0.49 () {58 vars in 1235 bytes} [Tue Dec 14 13:06:57 2021] GET /compute/v2.1/servers/0c5fe6a3-7904-4ee6-9f04-90633ff50db2 => generated 1260 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 14 13:06:57.627810 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.api.openstack.wsgi [None req-af12813a-dc53-4e52-9dfa-1429f6e67a07 tempest-AttachVolumeTestJSON-709357402 tempest-AttachVolumeTestJSON-709357402-project] Calling method '>' {{(pid=116064) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 13:06:57.628391 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.compute.api [None req-af12813a-dc53-4e52-9dfa-1429f6e67a07 tempest-AttachVolumeTestJSON-709357402 tempest-AttachVolumeTestJSON-709357402-project] [instance: bcb32a16-9097-40bc-9cd9-eee14f505d1d] Fetching instance by UUID {{(pid=116064) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 13:06:57.635129 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-af12813a-dc53-4e52-9dfa-1429f6e67a07 tempest-AttachVolumeTestJSON-709357402 tempest-AttachVolumeTestJSON-709357402-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 13:06:57.635575 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-af12813a-dc53-4e52-9dfa-1429f6e67a07 tempest-AttachVolumeTestJSON-709357402 tempest-AttachVolumeTestJSON-709357402-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 13:06:57.636348 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-af12813a-dc53-4e52-9dfa-1429f6e67a07 tempest-AttachVolumeTestJSON-709357402 tempest-AttachVolumeTestJSON-709357402-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 13:06:57.636776 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-af12813a-dc53-4e52-9dfa-1429f6e67a07 tempest-AttachVolumeTestJSON-709357402 tempest-AttachVolumeTestJSON-709357402-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 13:06:57.649965 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: INFO nova.api.openstack.wsgi [None req-af12813a-dc53-4e52-9dfa-1429f6e67a07 tempest-AttachVolumeTestJSON-709357402 tempest-AttachVolumeTestJSON-709357402-project] HTTP exception thrown: Instance bcb32a16-9097-40bc-9cd9-eee14f505d1d could not be found. Dec 14 13:06:57.650553 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.api.openstack.wsgi [None req-af12813a-dc53-4e52-9dfa-1429f6e67a07 tempest-AttachVolumeTestJSON-709357402 tempest-AttachVolumeTestJSON-709357402-project] Returning 404 to user: Instance bcb32a16-9097-40bc-9cd9-eee14f505d1d could not be found. {{(pid=116064) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 14 13:06:57.651369 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: INFO nova.api.openstack.requestlog [None req-af12813a-dc53-4e52-9dfa-1429f6e67a07 tempest-AttachVolumeTestJSON-709357402 tempest-AttachVolumeTestJSON-709357402-project] 10.222.0.49 "DELETE /compute/v2.1/servers/bcb32a16-9097-40bc-9cd9-eee14f505d1d" status: 404 len: 111 microversion: 2.1 time: 0.027725 Dec 14 13:06:57.651897 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: [pid: 116064|app: 0|req: 520/1061] 10.222.0.49 () {58 vars in 1238 bytes} [Tue Dec 14 13:06:57 2021] DELETE /compute/v2.1/servers/bcb32a16-9097-40bc-9cd9-eee14f505d1d => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Dec 14 13:06:57.660407 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.api.openstack.wsgi [None req-c2f0f131-2cf7-48ac-8fb6-86096e8f3214 tempest-AttachVolumeTestJSON-709357402 tempest-AttachVolumeTestJSON-709357402-project] Calling method '>' {{(pid=116063) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 13:06:57.661088 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.compute.api [None req-c2f0f131-2cf7-48ac-8fb6-86096e8f3214 tempest-AttachVolumeTestJSON-709357402 tempest-AttachVolumeTestJSON-709357402-project] [instance: bcb32a16-9097-40bc-9cd9-eee14f505d1d] Fetching instance by UUID {{(pid=116063) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 13:06:57.667440 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-c2f0f131-2cf7-48ac-8fb6-86096e8f3214 tempest-AttachVolumeTestJSON-709357402 tempest-AttachVolumeTestJSON-709357402-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 13:06:57.667938 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-c2f0f131-2cf7-48ac-8fb6-86096e8f3214 tempest-AttachVolumeTestJSON-709357402 tempest-AttachVolumeTestJSON-709357402-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 13:06:57.668705 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-c2f0f131-2cf7-48ac-8fb6-86096e8f3214 tempest-AttachVolumeTestJSON-709357402 tempest-AttachVolumeTestJSON-709357402-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 13:06:57.669162 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-c2f0f131-2cf7-48ac-8fb6-86096e8f3214 tempest-AttachVolumeTestJSON-709357402 tempest-AttachVolumeTestJSON-709357402-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 13:06:57.682332 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: INFO nova.api.openstack.wsgi [None req-c2f0f131-2cf7-48ac-8fb6-86096e8f3214 tempest-AttachVolumeTestJSON-709357402 tempest-AttachVolumeTestJSON-709357402-project] HTTP exception thrown: Instance bcb32a16-9097-40bc-9cd9-eee14f505d1d could not be found. Dec 14 13:06:57.682908 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.api.openstack.wsgi [None req-c2f0f131-2cf7-48ac-8fb6-86096e8f3214 tempest-AttachVolumeTestJSON-709357402 tempest-AttachVolumeTestJSON-709357402-project] Returning 404 to user: Instance bcb32a16-9097-40bc-9cd9-eee14f505d1d could not be found. {{(pid=116063) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 14 13:06:57.683717 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: INFO nova.api.openstack.requestlog [None req-c2f0f131-2cf7-48ac-8fb6-86096e8f3214 tempest-AttachVolumeTestJSON-709357402 tempest-AttachVolumeTestJSON-709357402-project] 10.222.0.49 "GET /compute/v2.1/servers/bcb32a16-9097-40bc-9cd9-eee14f505d1d" status: 404 len: 111 microversion: 2.1 time: 0.027540 Dec 14 13:06:57.684233 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: [pid: 116063|app: 0|req: 542/1062] 10.222.0.49 () {58 vars in 1235 bytes} [Tue Dec 14 13:06:57 2021] GET /compute/v2.1/servers/bcb32a16-9097-40bc-9cd9-eee14f505d1d => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Dec 14 13:06:58.576535 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.api.openstack.wsgi [None req-35e7bae6-207f-47a2-9cd4-edba53b5ccea tempest-TestShelveInstance-1515730970 tempest-TestShelveInstance-1515730970-project] Calling method '>' {{(pid=116064) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 13:06:58.577887 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.compute.api [None req-35e7bae6-207f-47a2-9cd4-edba53b5ccea tempest-TestShelveInstance-1515730970 tempest-TestShelveInstance-1515730970-project] [instance: 0c5fe6a3-7904-4ee6-9f04-90633ff50db2] Fetching instance by UUID {{(pid=116064) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 13:06:58.584653 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-35e7bae6-207f-47a2-9cd4-edba53b5ccea tempest-TestShelveInstance-1515730970 tempest-TestShelveInstance-1515730970-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 13:06:58.585153 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-35e7bae6-207f-47a2-9cd4-edba53b5ccea tempest-TestShelveInstance-1515730970 tempest-TestShelveInstance-1515730970-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 13:06:58.585946 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-35e7bae6-207f-47a2-9cd4-edba53b5ccea tempest-TestShelveInstance-1515730970 tempest-TestShelveInstance-1515730970-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 13:06:58.586963 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-35e7bae6-207f-47a2-9cd4-edba53b5ccea tempest-TestShelveInstance-1515730970 tempest-TestShelveInstance-1515730970-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 13:06:58.725690 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.policy [None req-35e7bae6-207f-47a2-9cd4-edba53b5ccea tempest-TestShelveInstance-1515730970 tempest-TestShelveInstance-1515730970-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '818488ec88264dcdb3a7bac93352b56b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe2a769f6b7645cbb7ec24ba01e13a4a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116064) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 13:06:58.736218 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: INFO nova.api.openstack.requestlog [None req-35e7bae6-207f-47a2-9cd4-edba53b5ccea tempest-TestShelveInstance-1515730970 tempest-TestShelveInstance-1515730970-project] 10.222.0.49 "GET /compute/v2.1/servers/0c5fe6a3-7904-4ee6-9f04-90633ff50db2" status: 200 len: 1444 microversion: 2.1 time: 0.163244 Dec 14 13:06:58.736997 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: [pid: 116064|app: 0|req: 521/1063] 10.222.0.49 () {58 vars in 1235 bytes} [Tue Dec 14 13:06:58 2021] GET /compute/v2.1/servers/0c5fe6a3-7904-4ee6-9f04-90633ff50db2 => generated 1444 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 14 13:06:58.752500 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.api.openstack.wsgi [None req-2ce44d71-73f6-4a62-9eb9-ff638cbddb7a tempest-TestShelveInstance-1515730970 tempest-TestShelveInstance-1515730970-project] Calling method '>' {{(pid=116063) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 13:06:58.753159 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.compute.api [None req-2ce44d71-73f6-4a62-9eb9-ff638cbddb7a tempest-TestShelveInstance-1515730970 tempest-TestShelveInstance-1515730970-project] [instance: 0c5fe6a3-7904-4ee6-9f04-90633ff50db2] Fetching instance by UUID {{(pid=116063) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 13:06:58.759762 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-2ce44d71-73f6-4a62-9eb9-ff638cbddb7a tempest-TestShelveInstance-1515730970 tempest-TestShelveInstance-1515730970-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 13:06:58.760216 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-2ce44d71-73f6-4a62-9eb9-ff638cbddb7a tempest-TestShelveInstance-1515730970 tempest-TestShelveInstance-1515730970-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 13:06:58.761044 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-2ce44d71-73f6-4a62-9eb9-ff638cbddb7a tempest-TestShelveInstance-1515730970 tempest-TestShelveInstance-1515730970-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 13:06:58.761483 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-2ce44d71-73f6-4a62-9eb9-ff638cbddb7a tempest-TestShelveInstance-1515730970 tempest-TestShelveInstance-1515730970-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 13:06:58.813654 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.api.openstack.wsgi [None req-6d1e14f1-c410-4e92-b002-8290e8e969d2 tempest-AttachVolumeTestJSON-709357402 tempest-AttachVolumeTestJSON-709357402-project] Calling method '>' {{(pid=116064) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 13:06:58.814148 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.compute.api [None req-6d1e14f1-c410-4e92-b002-8290e8e969d2 tempest-AttachVolumeTestJSON-709357402 tempest-AttachVolumeTestJSON-709357402-project] [instance: 1b8e1f2f-c109-4413-9d56-33ef0b651f85] Fetching instance by UUID {{(pid=116064) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 13:06:58.820120 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-6d1e14f1-c410-4e92-b002-8290e8e969d2 tempest-AttachVolumeTestJSON-709357402 tempest-AttachVolumeTestJSON-709357402-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 13:06:58.820572 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-6d1e14f1-c410-4e92-b002-8290e8e969d2 tempest-AttachVolumeTestJSON-709357402 tempest-AttachVolumeTestJSON-709357402-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 13:06:58.821377 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-6d1e14f1-c410-4e92-b002-8290e8e969d2 tempest-AttachVolumeTestJSON-709357402 tempest-AttachVolumeTestJSON-709357402-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 13:06:58.821813 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-6d1e14f1-c410-4e92-b002-8290e8e969d2 tempest-AttachVolumeTestJSON-709357402 tempest-AttachVolumeTestJSON-709357402-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 13:06:58.835001 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: INFO nova.api.openstack.wsgi [None req-6d1e14f1-c410-4e92-b002-8290e8e969d2 tempest-AttachVolumeTestJSON-709357402 tempest-AttachVolumeTestJSON-709357402-project] HTTP exception thrown: Instance 1b8e1f2f-c109-4413-9d56-33ef0b651f85 could not be found. Dec 14 13:06:58.835505 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.api.openstack.wsgi [None req-6d1e14f1-c410-4e92-b002-8290e8e969d2 tempest-AttachVolumeTestJSON-709357402 tempest-AttachVolumeTestJSON-709357402-project] Returning 404 to user: Instance 1b8e1f2f-c109-4413-9d56-33ef0b651f85 could not be found. {{(pid=116064) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 14 13:06:58.836384 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: INFO nova.api.openstack.requestlog [None req-6d1e14f1-c410-4e92-b002-8290e8e969d2 tempest-AttachVolumeTestJSON-709357402 tempest-AttachVolumeTestJSON-709357402-project] 10.222.0.49 "DELETE /compute/v2.1/servers/1b8e1f2f-c109-4413-9d56-33ef0b651f85" status: 404 len: 111 microversion: 2.1 time: 0.026447 Dec 14 13:06:58.836923 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: [pid: 116064|app: 0|req: 522/1064] 10.222.0.49 () {58 vars in 1238 bytes} [Tue Dec 14 13:06:58 2021] DELETE /compute/v2.1/servers/1b8e1f2f-c109-4413-9d56-33ef0b651f85 => generated 111 bytes in 28 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Dec 14 13:06:58.844236 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.api.openstack.wsgi [None req-2d7c2a91-3371-4bd1-86ff-bb79c43a4092 tempest-AttachVolumeTestJSON-709357402 tempest-AttachVolumeTestJSON-709357402-project] Calling method '>' {{(pid=116064) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 13:06:58.844835 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.compute.api [None req-2d7c2a91-3371-4bd1-86ff-bb79c43a4092 tempest-AttachVolumeTestJSON-709357402 tempest-AttachVolumeTestJSON-709357402-project] [instance: 1b8e1f2f-c109-4413-9d56-33ef0b651f85] Fetching instance by UUID {{(pid=116064) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 13:06:58.851247 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-2d7c2a91-3371-4bd1-86ff-bb79c43a4092 tempest-AttachVolumeTestJSON-709357402 tempest-AttachVolumeTestJSON-709357402-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 13:06:58.851771 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-2d7c2a91-3371-4bd1-86ff-bb79c43a4092 tempest-AttachVolumeTestJSON-709357402 tempest-AttachVolumeTestJSON-709357402-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 13:06:58.852606 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-2d7c2a91-3371-4bd1-86ff-bb79c43a4092 tempest-AttachVolumeTestJSON-709357402 tempest-AttachVolumeTestJSON-709357402-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 13:06:58.853123 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-2d7c2a91-3371-4bd1-86ff-bb79c43a4092 tempest-AttachVolumeTestJSON-709357402 tempest-AttachVolumeTestJSON-709357402-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 13:06:58.868400 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: INFO nova.api.openstack.wsgi [None req-2d7c2a91-3371-4bd1-86ff-bb79c43a4092 tempest-AttachVolumeTestJSON-709357402 tempest-AttachVolumeTestJSON-709357402-project] HTTP exception thrown: Instance 1b8e1f2f-c109-4413-9d56-33ef0b651f85 could not be found. Dec 14 13:06:58.869024 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.api.openstack.wsgi [None req-2d7c2a91-3371-4bd1-86ff-bb79c43a4092 tempest-AttachVolumeTestJSON-709357402 tempest-AttachVolumeTestJSON-709357402-project] Returning 404 to user: Instance 1b8e1f2f-c109-4413-9d56-33ef0b651f85 could not be found. {{(pid=116064) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 14 13:06:58.869854 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: INFO nova.api.openstack.requestlog [None req-2d7c2a91-3371-4bd1-86ff-bb79c43a4092 tempest-AttachVolumeTestJSON-709357402 tempest-AttachVolumeTestJSON-709357402-project] 10.222.0.49 "GET /compute/v2.1/servers/1b8e1f2f-c109-4413-9d56-33ef0b651f85" status: 404 len: 111 microversion: 2.1 time: 0.028993 Dec 14 13:06:58.870404 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: [pid: 116064|app: 0|req: 523/1065] 10.222.0.49 () {58 vars in 1235 bytes} [Tue Dec 14 13:06:58 2021] GET /compute/v2.1/servers/1b8e1f2f-c109-4413-9d56-33ef0b651f85 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Dec 14 13:06:58.895909 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.policy [None req-2ce44d71-73f6-4a62-9eb9-ff638cbddb7a tempest-TestShelveInstance-1515730970 tempest-TestShelveInstance-1515730970-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '818488ec88264dcdb3a7bac93352b56b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe2a769f6b7645cbb7ec24ba01e13a4a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116063) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 13:06:58.903442 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: INFO nova.api.openstack.requestlog [None req-2ce44d71-73f6-4a62-9eb9-ff638cbddb7a tempest-TestShelveInstance-1515730970 tempest-TestShelveInstance-1515730970-project] 10.222.0.49 "GET /compute/v2.1/servers/0c5fe6a3-7904-4ee6-9f04-90633ff50db2" status: 200 len: 1444 microversion: 2.1 time: 0.154621 Dec 14 13:06:58.904004 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: [pid: 116063|app: 0|req: 543/1066] 10.222.0.49 () {58 vars in 1235 bytes} [Tue Dec 14 13:06:58 2021] GET /compute/v2.1/servers/0c5fe6a3-7904-4ee6-9f04-90633ff50db2 => generated 1444 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 14 13:07:00.948268 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.api.openstack.wsgi [req-d4a9b137-a686-400c-9e53-a211888aa7b0 req-83592623-3019-459a-8c9c-bde213020668 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0c5fe6a3-7904-4ee6-9f04-90633ff50db2", "tag": "6b399ecc-9d61-4402-b72e-7daa479ee08d"}]} {{(pid=116064) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 14 13:07:00.951938 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 14 13:07:00.951938 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: warnings.warn(msg) Dec 14 13:07:00.961849 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [req-d4a9b137-a686-400c-9e53-a211888aa7b0 req-83592623-3019-459a-8c9c-bde213020668 service nova] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 13:07:00.962444 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [req-d4a9b137-a686-400c-9e53-a211888aa7b0 req-83592623-3019-459a-8c9c-bde213020668 service nova] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 13:07:00.975557 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: INFO nova.api.openstack.compute.server_external_events [req-d4a9b137-a686-400c-9e53-a211888aa7b0 req-83592623-3019-459a-8c9c-bde213020668 service nova] Creating event network-changed:6b399ecc-9d61-4402-b72e-7daa479ee08d for instance 0c5fe6a3-7904-4ee6-9f04-90633ff50db2 on hv-cinder-78447 Dec 14 13:07:00.980986 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: INFO nova.api.openstack.requestlog [req-d4a9b137-a686-400c-9e53-a211888aa7b0 req-83592623-3019-459a-8c9c-bde213020668 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.048211 Dec 14 13:07:00.981585 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: [pid: 116064|app: 0|req: 524/1067] 10.222.0.49 () {64 vars in 1317 bytes} [Tue Dec 14 13:07:00 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 14 13:08:11.886047 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.api.openstack.wsgi [None req-39253656-0942-4856-aadb-8decf662cbfc tempest-TestVolumeBootPattern-232608497 tempest-TestVolumeBootPattern-232608497-project] Action: 'create', calling method: .version_select at 0x7f2acd9f6820>, body: {"keypair": {"name": "tempest-TestVolumeBootPattern-878167248"}} {{(pid=116063) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 14 13:08:11.900019 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.quota [None req-39253656-0942-4856-aadb-8decf662cbfc tempest-TestVolumeBootPattern-232608497 tempest-TestVolumeBootPattern-232608497-project] Getting quotas for project b854de8019ad4a598587133ba362564b. Resources: {'key_pairs'} {{(pid=116063) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 14 13:08:11.904010 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.quota [None req-39253656-0942-4856-aadb-8decf662cbfc tempest-TestVolumeBootPattern-232608497 tempest-TestVolumeBootPattern-232608497-project] Getting quotas for user 94008a0d97204aff87f20bdeadbdd783 and project b854de8019ad4a598587133ba362564b. Resources: {'key_pairs'} {{(pid=116063) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 14 13:08:12.066605 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.quota [None req-39253656-0942-4856-aadb-8decf662cbfc tempest-TestVolumeBootPattern-232608497 tempest-TestVolumeBootPattern-232608497-project] Getting quotas for project b854de8019ad4a598587133ba362564b. Resources: {'key_pairs'} {{(pid=116063) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 14 13:08:12.068582 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.quota [None req-39253656-0942-4856-aadb-8decf662cbfc tempest-TestVolumeBootPattern-232608497 tempest-TestVolumeBootPattern-232608497-project] Getting quotas for user 94008a0d97204aff87f20bdeadbdd783 and project b854de8019ad4a598587133ba362564b. Resources: {'key_pairs'} {{(pid=116063) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 14 13:08:12.084337 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: INFO nova.api.openstack.requestlog [None req-39253656-0942-4856-aadb-8decf662cbfc tempest-TestVolumeBootPattern-232608497 tempest-TestVolumeBootPattern-232608497-project] 10.222.0.49 "POST /compute/v2.1/os-keypairs" status: 200 len: 2318 microversion: 2.1 time: 0.393533 Dec 14 13:08:12.085660 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: [pid: 116063|app: 0|req: 544/1068] 10.222.0.49 () {60 vars in 1157 bytes} [Tue Dec 14 13:08:11 2021] POST /compute/v2.1/os-keypairs => generated 2318 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 14 13:08:29.381556 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.api.openstack.wsgi [None req-266def47-a235-4e8b-b0d4-0f5199b536a2 tempest-TestVolumeBootPattern-232608497 tempest-TestVolumeBootPattern-232608497-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-770002600", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-878167248", "security_groups": [{"name": "tempest-secgroup-smoke-1999256453"}], "block_device_mapping_v2": [{"uuid": "86dd4156-36b1-48e5-95d8-21c722b51907", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "7f5ca66d-8559-4e12-9014-f81fba56fd65"}]}} {{(pid=116064) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 14 13:08:29.611391 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.network.neutron [None req-266def47-a235-4e8b-b0d4-0f5199b536a2 tempest-TestVolumeBootPattern-232608497 tempest-TestVolumeBootPattern-232608497-project] validate_networks() for [('7f5ca66d-8559-4e12-9014-f81fba56fd65', None, None, None, None, None)] {{(pid=116064) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Dec 14 13:08:29.987084 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.virt.hardware [None req-266def47-a235-4e8b-b0d4-0f5199b536a2 tempest-TestVolumeBootPattern-232608497 tempest-TestVolumeBootPattern-232608497-project] Flavor limits 0:0:0 {{(pid=116064) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Dec 14 13:08:29.987695 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.virt.hardware [None req-266def47-a235-4e8b-b0d4-0f5199b536a2 tempest-TestVolumeBootPattern-232608497 tempest-TestVolumeBootPattern-232608497-project] Image limits 0:0:0 {{(pid=116064) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Dec 14 13:08:29.988386 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.virt.hardware [None req-266def47-a235-4e8b-b0d4-0f5199b536a2 tempest-TestVolumeBootPattern-232608497 tempest-TestVolumeBootPattern-232608497-project] Flavor pref 0:0:0 {{(pid=116064) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Dec 14 13:08:29.989003 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.virt.hardware [None req-266def47-a235-4e8b-b0d4-0f5199b536a2 tempest-TestVolumeBootPattern-232608497 tempest-TestVolumeBootPattern-232608497-project] Image pref 0:0:0 {{(pid=116064) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Dec 14 13:08:29.989587 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.virt.hardware [None req-266def47-a235-4e8b-b0d4-0f5199b536a2 tempest-TestVolumeBootPattern-232608497 tempest-TestVolumeBootPattern-232608497-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=116064) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Dec 14 13:08:30.008537 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-266def47-a235-4e8b-b0d4-0f5199b536a2 tempest-TestVolumeBootPattern-232608497 tempest-TestVolumeBootPattern-232608497-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 13:08:30.009028 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-266def47-a235-4e8b-b0d4-0f5199b536a2 tempest-TestVolumeBootPattern-232608497 tempest-TestVolumeBootPattern-232608497-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 13:08:30.009845 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-266def47-a235-4e8b-b0d4-0f5199b536a2 tempest-TestVolumeBootPattern-232608497 tempest-TestVolumeBootPattern-232608497-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 13:08:30.010283 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-266def47-a235-4e8b-b0d4-0f5199b536a2 tempest-TestVolumeBootPattern-232608497 tempest-TestVolumeBootPattern-232608497-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 13:08:30.027344 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.quota [None req-266def47-a235-4e8b-b0d4-0f5199b536a2 tempest-TestVolumeBootPattern-232608497 tempest-TestVolumeBootPattern-232608497-project] Getting quotas for project b854de8019ad4a598587133ba362564b. Resources: {'cores', 'instances', 'ram'} {{(pid=116064) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 14 13:08:30.031722 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.quota [None req-266def47-a235-4e8b-b0d4-0f5199b536a2 tempest-TestVolumeBootPattern-232608497 tempest-TestVolumeBootPattern-232608497-project] Getting quotas for user 94008a0d97204aff87f20bdeadbdd783 and project b854de8019ad4a598587133ba362564b. Resources: {'cores', 'instances', 'ram'} {{(pid=116064) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 14 13:08:30.089106 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.compute.api [None req-266def47-a235-4e8b-b0d4-0f5199b536a2 tempest-TestVolumeBootPattern-232608497 tempest-TestVolumeBootPattern-232608497-project] Going to run 1 instances... {{(pid=116064) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Dec 14 13:08:30.091453 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.compute.api [None req-266def47-a235-4e8b-b0d4-0f5199b536a2 tempest-TestVolumeBootPattern-232608497 tempest-TestVolumeBootPattern-232608497-project] [instance: 0ae818b3-6456-4c1f-8ad2-0509dce1e575] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='86dd4156-36b1-48e5-95d8-21c722b51907',volume_size=None,volume_type=None)] {{(pid=116064) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Dec 14 13:08:30.219758 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: INFO nova.api.openstack.requestlog [None req-266def47-a235-4e8b-b0d4-0f5199b536a2 tempest-TestVolumeBootPattern-232608497 tempest-TestVolumeBootPattern-232608497-project] 10.222.0.49 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.846230 Dec 14 13:08:30.220392 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: [pid: 116064|app: 0|req: 525/1069] 10.222.0.49 () {60 vars in 1146 bytes} [Tue Dec 14 13:08:29 2021] POST /compute/v2.1/servers => generated 406 bytes in 848 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Dec 14 13:08:30.231160 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.api.openstack.wsgi [None req-a0c70859-9afd-4f20-b0c2-a0554789ba1b tempest-TestVolumeBootPattern-232608497 tempest-TestVolumeBootPattern-232608497-project] Calling method '>' {{(pid=116063) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 13:08:30.231763 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.compute.api [None req-a0c70859-9afd-4f20-b0c2-a0554789ba1b tempest-TestVolumeBootPattern-232608497 tempest-TestVolumeBootPattern-232608497-project] [instance: 0ae818b3-6456-4c1f-8ad2-0509dce1e575] Fetching instance by UUID {{(pid=116063) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 13:08:30.379740 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.policy [None req-a0c70859-9afd-4f20-b0c2-a0554789ba1b tempest-TestVolumeBootPattern-232608497 tempest-TestVolumeBootPattern-232608497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94008a0d97204aff87f20bdeadbdd783', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b854de8019ad4a598587133ba362564b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116063) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 13:08:30.387242 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: INFO nova.api.openstack.requestlog [None req-a0c70859-9afd-4f20-b0c2-a0554789ba1b tempest-TestVolumeBootPattern-232608497 tempest-TestVolumeBootPattern-232608497-project] 10.222.0.49 "GET /compute/v2.1/servers/0ae818b3-6456-4c1f-8ad2-0509dce1e575" status: 200 len: 1093 microversion: 2.1 time: 0.160540 Dec 14 13:08:30.388902 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: [pid: 116063|app: 0|req: 545/1070] 10.222.0.49 () {58 vars in 1235 bytes} [Tue Dec 14 13:08:30 2021] GET /compute/v2.1/servers/0ae818b3-6456-4c1f-8ad2-0509dce1e575 => generated 1093 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 14 13:08:31.407220 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.api.openstack.wsgi [None req-64e323ae-59ee-4ffa-a101-6aeca50ff030 tempest-TestVolumeBootPattern-232608497 tempest-TestVolumeBootPattern-232608497-project] Calling method '>' {{(pid=116064) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 13:08:31.407827 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.compute.api [None req-64e323ae-59ee-4ffa-a101-6aeca50ff030 tempest-TestVolumeBootPattern-232608497 tempest-TestVolumeBootPattern-232608497-project] [instance: 0ae818b3-6456-4c1f-8ad2-0509dce1e575] Fetching instance by UUID {{(pid=116064) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 13:08:31.416159 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-64e323ae-59ee-4ffa-a101-6aeca50ff030 tempest-TestVolumeBootPattern-232608497 tempest-TestVolumeBootPattern-232608497-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 13:08:31.416681 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-64e323ae-59ee-4ffa-a101-6aeca50ff030 tempest-TestVolumeBootPattern-232608497 tempest-TestVolumeBootPattern-232608497-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 13:08:31.417539 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-64e323ae-59ee-4ffa-a101-6aeca50ff030 tempest-TestVolumeBootPattern-232608497 tempest-TestVolumeBootPattern-232608497-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 13:08:31.417977 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-64e323ae-59ee-4ffa-a101-6aeca50ff030 tempest-TestVolumeBootPattern-232608497 tempest-TestVolumeBootPattern-232608497-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 13:08:31.477680 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.policy [None req-64e323ae-59ee-4ffa-a101-6aeca50ff030 tempest-TestVolumeBootPattern-232608497 tempest-TestVolumeBootPattern-232608497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94008a0d97204aff87f20bdeadbdd783', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b854de8019ad4a598587133ba362564b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116064) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 13:08:31.485670 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: INFO nova.api.openstack.requestlog [None req-64e323ae-59ee-4ffa-a101-6aeca50ff030 tempest-TestVolumeBootPattern-232608497 tempest-TestVolumeBootPattern-232608497-project] 10.222.0.49 "GET /compute/v2.1/servers/0ae818b3-6456-4c1f-8ad2-0509dce1e575" status: 200 len: 1209 microversion: 2.1 time: 0.083640 Dec 14 13:08:31.486149 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: [pid: 116064|app: 0|req: 526/1071] 10.222.0.49 () {58 vars in 1235 bytes} [Tue Dec 14 13:08:31 2021] GET /compute/v2.1/servers/0ae818b3-6456-4c1f-8ad2-0509dce1e575 => generated 1209 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 14 13:08:32.502681 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.api.openstack.wsgi [None req-0e5c4f8f-7ab2-4534-a2c2-4f46b00e2738 tempest-TestVolumeBootPattern-232608497 tempest-TestVolumeBootPattern-232608497-project] Calling method '>' {{(pid=116063) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 13:08:32.503256 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.compute.api [None req-0e5c4f8f-7ab2-4534-a2c2-4f46b00e2738 tempest-TestVolumeBootPattern-232608497 tempest-TestVolumeBootPattern-232608497-project] [instance: 0ae818b3-6456-4c1f-8ad2-0509dce1e575] Fetching instance by UUID {{(pid=116063) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 13:08:32.509715 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-0e5c4f8f-7ab2-4534-a2c2-4f46b00e2738 tempest-TestVolumeBootPattern-232608497 tempest-TestVolumeBootPattern-232608497-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 13:08:32.510159 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-0e5c4f8f-7ab2-4534-a2c2-4f46b00e2738 tempest-TestVolumeBootPattern-232608497 tempest-TestVolumeBootPattern-232608497-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 13:08:32.510948 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-0e5c4f8f-7ab2-4534-a2c2-4f46b00e2738 tempest-TestVolumeBootPattern-232608497 tempest-TestVolumeBootPattern-232608497-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 13:08:32.511370 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-0e5c4f8f-7ab2-4534-a2c2-4f46b00e2738 tempest-TestVolumeBootPattern-232608497 tempest-TestVolumeBootPattern-232608497-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 13:08:32.646143 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.policy [None req-0e5c4f8f-7ab2-4534-a2c2-4f46b00e2738 tempest-TestVolumeBootPattern-232608497 tempest-TestVolumeBootPattern-232608497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94008a0d97204aff87f20bdeadbdd783', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b854de8019ad4a598587133ba362564b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116063) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 13:08:32.653927 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: INFO nova.api.openstack.requestlog [None req-0e5c4f8f-7ab2-4534-a2c2-4f46b00e2738 tempest-TestVolumeBootPattern-232608497 tempest-TestVolumeBootPattern-232608497-project] 10.222.0.49 "GET /compute/v2.1/servers/0ae818b3-6456-4c1f-8ad2-0509dce1e575" status: 200 len: 1265 microversion: 2.1 time: 0.155007 Dec 14 13:08:32.654503 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: [pid: 116063|app: 0|req: 546/1072] 10.222.0.49 () {58 vars in 1235 bytes} [Tue Dec 14 13:08:32 2021] GET /compute/v2.1/servers/0ae818b3-6456-4c1f-8ad2-0509dce1e575 => generated 1265 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 14 13:08:32.918631 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.api.openstack.wsgi [req-958aa2a7-6953-4f33-a83f-5f82ffe4f30b req-5aef0000-828d-4534-b9b9-0f4e9eef860b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0ae818b3-6456-4c1f-8ad2-0509dce1e575", "tag": "0b8646d5-2a96-4065-b8d7-d8717ba061ca"}]} {{(pid=116064) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 14 13:08:32.921034 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 14 13:08:32.921034 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: warnings.warn(msg) Dec 14 13:08:32.929955 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [req-958aa2a7-6953-4f33-a83f-5f82ffe4f30b req-5aef0000-828d-4534-b9b9-0f4e9eef860b service nova] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 13:08:32.930398 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [req-958aa2a7-6953-4f33-a83f-5f82ffe4f30b req-5aef0000-828d-4534-b9b9-0f4e9eef860b service nova] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 13:08:32.941661 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: INFO nova.api.openstack.compute.server_external_events [req-958aa2a7-6953-4f33-a83f-5f82ffe4f30b req-5aef0000-828d-4534-b9b9-0f4e9eef860b service nova] Creating event network-changed:0b8646d5-2a96-4065-b8d7-d8717ba061ca for instance 0ae818b3-6456-4c1f-8ad2-0509dce1e575 on hv-cinder-78447 Dec 14 13:08:32.951401 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: INFO nova.api.openstack.requestlog [req-958aa2a7-6953-4f33-a83f-5f82ffe4f30b req-5aef0000-828d-4534-b9b9-0f4e9eef860b service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037130 Dec 14 13:08:32.952011 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: [pid: 116064|app: 0|req: 527/1073] 10.222.0.49 () {64 vars in 1317 bytes} [Tue Dec 14 13:08:32 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 14 13:08:33.673673 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.api.openstack.wsgi [None req-720e2f26-8eb5-420c-83f5-11c2179755f4 tempest-TestVolumeBootPattern-232608497 tempest-TestVolumeBootPattern-232608497-project] Calling method '>' {{(pid=116063) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 13:08:33.674346 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.compute.api [None req-720e2f26-8eb5-420c-83f5-11c2179755f4 tempest-TestVolumeBootPattern-232608497 tempest-TestVolumeBootPattern-232608497-project] [instance: 0ae818b3-6456-4c1f-8ad2-0509dce1e575] Fetching instance by UUID {{(pid=116063) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 13:08:33.681075 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-720e2f26-8eb5-420c-83f5-11c2179755f4 tempest-TestVolumeBootPattern-232608497 tempest-TestVolumeBootPattern-232608497-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 13:08:33.681518 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-720e2f26-8eb5-420c-83f5-11c2179755f4 tempest-TestVolumeBootPattern-232608497 tempest-TestVolumeBootPattern-232608497-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 13:08:33.682282 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-720e2f26-8eb5-420c-83f5-11c2179755f4 tempest-TestVolumeBootPattern-232608497 tempest-TestVolumeBootPattern-232608497-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 13:08:33.682767 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-720e2f26-8eb5-420c-83f5-11c2179755f4 tempest-TestVolumeBootPattern-232608497 tempest-TestVolumeBootPattern-232608497-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 13:08:33.814803 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.policy [None req-720e2f26-8eb5-420c-83f5-11c2179755f4 tempest-TestVolumeBootPattern-232608497 tempest-TestVolumeBootPattern-232608497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94008a0d97204aff87f20bdeadbdd783', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b854de8019ad4a598587133ba362564b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116063) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 13:08:33.822262 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: INFO nova.api.openstack.requestlog [None req-720e2f26-8eb5-420c-83f5-11c2179755f4 tempest-TestVolumeBootPattern-232608497 tempest-TestVolumeBootPattern-232608497-project] 10.222.0.49 "GET /compute/v2.1/servers/0ae818b3-6456-4c1f-8ad2-0509dce1e575" status: 200 len: 1265 microversion: 2.1 time: 0.154315 Dec 14 13:08:33.822821 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: [pid: 116063|app: 0|req: 547/1074] 10.222.0.49 () {58 vars in 1235 bytes} [Tue Dec 14 13:08:33 2021] GET /compute/v2.1/servers/0ae818b3-6456-4c1f-8ad2-0509dce1e575 => generated 1265 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 14 13:08:34.844634 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.api.openstack.wsgi [None req-7950abee-dc97-4da9-8a2a-4328965ad4f0 tempest-TestVolumeBootPattern-232608497 tempest-TestVolumeBootPattern-232608497-project] Calling method '>' {{(pid=116064) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 13:08:34.845833 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.compute.api [None req-7950abee-dc97-4da9-8a2a-4328965ad4f0 tempest-TestVolumeBootPattern-232608497 tempest-TestVolumeBootPattern-232608497-project] [instance: 0ae818b3-6456-4c1f-8ad2-0509dce1e575] Fetching instance by UUID {{(pid=116064) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 13:08:34.856056 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-7950abee-dc97-4da9-8a2a-4328965ad4f0 tempest-TestVolumeBootPattern-232608497 tempest-TestVolumeBootPattern-232608497-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 13:08:34.856514 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-7950abee-dc97-4da9-8a2a-4328965ad4f0 tempest-TestVolumeBootPattern-232608497 tempest-TestVolumeBootPattern-232608497-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 13:08:34.857333 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-7950abee-dc97-4da9-8a2a-4328965ad4f0 tempest-TestVolumeBootPattern-232608497 tempest-TestVolumeBootPattern-232608497-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 13:08:34.858289 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-7950abee-dc97-4da9-8a2a-4328965ad4f0 tempest-TestVolumeBootPattern-232608497 tempest-TestVolumeBootPattern-232608497-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 13:08:34.998662 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.policy [None req-7950abee-dc97-4da9-8a2a-4328965ad4f0 tempest-TestVolumeBootPattern-232608497 tempest-TestVolumeBootPattern-232608497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94008a0d97204aff87f20bdeadbdd783', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b854de8019ad4a598587133ba362564b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116064) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 13:08:35.006534 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: INFO nova.api.openstack.requestlog [None req-7950abee-dc97-4da9-8a2a-4328965ad4f0 tempest-TestVolumeBootPattern-232608497 tempest-TestVolumeBootPattern-232608497-project] 10.222.0.49 "GET /compute/v2.1/servers/0ae818b3-6456-4c1f-8ad2-0509dce1e575" status: 200 len: 1265 microversion: 2.1 time: 0.169524 Dec 14 13:08:35.007128 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: [pid: 116064|app: 0|req: 528/1075] 10.222.0.49 () {58 vars in 1235 bytes} [Tue Dec 14 13:08:34 2021] GET /compute/v2.1/servers/0ae818b3-6456-4c1f-8ad2-0509dce1e575 => generated 1265 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 14 13:08:36.026599 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.api.openstack.wsgi [None req-67555beb-3453-4748-af83-5af1f24c8372 tempest-TestVolumeBootPattern-232608497 tempest-TestVolumeBootPattern-232608497-project] Calling method '>' {{(pid=116063) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 13:08:36.027263 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.compute.api [None req-67555beb-3453-4748-af83-5af1f24c8372 tempest-TestVolumeBootPattern-232608497 tempest-TestVolumeBootPattern-232608497-project] [instance: 0ae818b3-6456-4c1f-8ad2-0509dce1e575] Fetching instance by UUID {{(pid=116063) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 13:08:36.034084 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-67555beb-3453-4748-af83-5af1f24c8372 tempest-TestVolumeBootPattern-232608497 tempest-TestVolumeBootPattern-232608497-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 13:08:36.034524 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-67555beb-3453-4748-af83-5af1f24c8372 tempest-TestVolumeBootPattern-232608497 tempest-TestVolumeBootPattern-232608497-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 13:08:36.035288 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-67555beb-3453-4748-af83-5af1f24c8372 tempest-TestVolumeBootPattern-232608497 tempest-TestVolumeBootPattern-232608497-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 13:08:36.035713 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-67555beb-3453-4748-af83-5af1f24c8372 tempest-TestVolumeBootPattern-232608497 tempest-TestVolumeBootPattern-232608497-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 13:08:36.193793 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.policy [None req-67555beb-3453-4748-af83-5af1f24c8372 tempest-TestVolumeBootPattern-232608497 tempest-TestVolumeBootPattern-232608497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94008a0d97204aff87f20bdeadbdd783', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b854de8019ad4a598587133ba362564b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116063) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 13:08:36.206185 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: INFO nova.api.openstack.requestlog [None req-67555beb-3453-4748-af83-5af1f24c8372 tempest-TestVolumeBootPattern-232608497 tempest-TestVolumeBootPattern-232608497-project] 10.222.0.49 "GET /compute/v2.1/servers/0ae818b3-6456-4c1f-8ad2-0509dce1e575" status: 200 len: 1265 microversion: 2.1 time: 0.184964 Dec 14 13:08:36.207115 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: [pid: 116063|app: 0|req: 548/1076] 10.222.0.49 () {58 vars in 1235 bytes} [Tue Dec 14 13:08:36 2021] GET /compute/v2.1/servers/0ae818b3-6456-4c1f-8ad2-0509dce1e575 => generated 1265 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 14 13:08:37.230760 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.api.openstack.wsgi [None req-75f6f955-223d-4105-b040-310ce3b8b79e tempest-TestVolumeBootPattern-232608497 tempest-TestVolumeBootPattern-232608497-project] Calling method '>' {{(pid=116064) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 13:08:37.231371 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.compute.api [None req-75f6f955-223d-4105-b040-310ce3b8b79e tempest-TestVolumeBootPattern-232608497 tempest-TestVolumeBootPattern-232608497-project] [instance: 0ae818b3-6456-4c1f-8ad2-0509dce1e575] Fetching instance by UUID {{(pid=116064) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 13:08:37.238793 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-75f6f955-223d-4105-b040-310ce3b8b79e tempest-TestVolumeBootPattern-232608497 tempest-TestVolumeBootPattern-232608497-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 13:08:37.239300 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-75f6f955-223d-4105-b040-310ce3b8b79e tempest-TestVolumeBootPattern-232608497 tempest-TestVolumeBootPattern-232608497-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 13:08:37.240175 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-75f6f955-223d-4105-b040-310ce3b8b79e tempest-TestVolumeBootPattern-232608497 tempest-TestVolumeBootPattern-232608497-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 13:08:37.240655 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-75f6f955-223d-4105-b040-310ce3b8b79e tempest-TestVolumeBootPattern-232608497 tempest-TestVolumeBootPattern-232608497-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 13:08:37.382492 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.policy [None req-75f6f955-223d-4105-b040-310ce3b8b79e tempest-TestVolumeBootPattern-232608497 tempest-TestVolumeBootPattern-232608497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94008a0d97204aff87f20bdeadbdd783', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b854de8019ad4a598587133ba362564b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116064) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 13:08:37.393963 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: INFO nova.api.openstack.requestlog [None req-75f6f955-223d-4105-b040-310ce3b8b79e tempest-TestVolumeBootPattern-232608497 tempest-TestVolumeBootPattern-232608497-project] 10.222.0.49 "GET /compute/v2.1/servers/0ae818b3-6456-4c1f-8ad2-0509dce1e575" status: 200 len: 1265 microversion: 2.1 time: 0.169352 Dec 14 13:08:37.394750 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: [pid: 116064|app: 0|req: 529/1077] 10.222.0.49 () {58 vars in 1235 bytes} [Tue Dec 14 13:08:37 2021] GET /compute/v2.1/servers/0ae818b3-6456-4c1f-8ad2-0509dce1e575 => generated 1265 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 14 13:08:38.417304 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.api.openstack.wsgi [None req-9b191463-ec8e-4bbf-8339-89d23d81ffb0 tempest-TestVolumeBootPattern-232608497 tempest-TestVolumeBootPattern-232608497-project] Calling method '>' {{(pid=116063) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 13:08:38.418241 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.compute.api [None req-9b191463-ec8e-4bbf-8339-89d23d81ffb0 tempest-TestVolumeBootPattern-232608497 tempest-TestVolumeBootPattern-232608497-project] [instance: 0ae818b3-6456-4c1f-8ad2-0509dce1e575] Fetching instance by UUID {{(pid=116063) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 13:08:38.429101 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-9b191463-ec8e-4bbf-8339-89d23d81ffb0 tempest-TestVolumeBootPattern-232608497 tempest-TestVolumeBootPattern-232608497-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 13:08:38.429899 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-9b191463-ec8e-4bbf-8339-89d23d81ffb0 tempest-TestVolumeBootPattern-232608497 tempest-TestVolumeBootPattern-232608497-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 13:08:38.431180 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-9b191463-ec8e-4bbf-8339-89d23d81ffb0 tempest-TestVolumeBootPattern-232608497 tempest-TestVolumeBootPattern-232608497-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 13:08:38.431900 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-9b191463-ec8e-4bbf-8339-89d23d81ffb0 tempest-TestVolumeBootPattern-232608497 tempest-TestVolumeBootPattern-232608497-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 13:08:38.574841 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.policy [None req-9b191463-ec8e-4bbf-8339-89d23d81ffb0 tempest-TestVolumeBootPattern-232608497 tempest-TestVolumeBootPattern-232608497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94008a0d97204aff87f20bdeadbdd783', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b854de8019ad4a598587133ba362564b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116063) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 13:08:38.582488 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: INFO nova.api.openstack.requestlog [None req-9b191463-ec8e-4bbf-8339-89d23d81ffb0 tempest-TestVolumeBootPattern-232608497 tempest-TestVolumeBootPattern-232608497-project] 10.222.0.49 "GET /compute/v2.1/servers/0ae818b3-6456-4c1f-8ad2-0509dce1e575" status: 200 len: 1265 microversion: 2.1 time: 0.171732 Dec 14 13:08:38.583060 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: [pid: 116063|app: 0|req: 549/1078] 10.222.0.49 () {58 vars in 1235 bytes} [Tue Dec 14 13:08:38 2021] GET /compute/v2.1/servers/0ae818b3-6456-4c1f-8ad2-0509dce1e575 => generated 1265 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 14 13:08:39.603372 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.api.openstack.wsgi [None req-9cdc9ea0-4478-4d90-952a-291244b34ec3 tempest-TestVolumeBootPattern-232608497 tempest-TestVolumeBootPattern-232608497-project] Calling method '>' {{(pid=116064) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 13:08:39.604374 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.compute.api [None req-9cdc9ea0-4478-4d90-952a-291244b34ec3 tempest-TestVolumeBootPattern-232608497 tempest-TestVolumeBootPattern-232608497-project] [instance: 0ae818b3-6456-4c1f-8ad2-0509dce1e575] Fetching instance by UUID {{(pid=116064) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 13:08:39.611288 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-9cdc9ea0-4478-4d90-952a-291244b34ec3 tempest-TestVolumeBootPattern-232608497 tempest-TestVolumeBootPattern-232608497-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 13:08:39.611733 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-9cdc9ea0-4478-4d90-952a-291244b34ec3 tempest-TestVolumeBootPattern-232608497 tempest-TestVolumeBootPattern-232608497-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 13:08:39.612515 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-9cdc9ea0-4478-4d90-952a-291244b34ec3 tempest-TestVolumeBootPattern-232608497 tempest-TestVolumeBootPattern-232608497-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 13:08:39.612980 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-9cdc9ea0-4478-4d90-952a-291244b34ec3 tempest-TestVolumeBootPattern-232608497 tempest-TestVolumeBootPattern-232608497-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 13:08:39.750578 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.policy [None req-9cdc9ea0-4478-4d90-952a-291244b34ec3 tempest-TestVolumeBootPattern-232608497 tempest-TestVolumeBootPattern-232608497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94008a0d97204aff87f20bdeadbdd783', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b854de8019ad4a598587133ba362564b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116064) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 13:08:39.758557 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: INFO nova.api.openstack.requestlog [None req-9cdc9ea0-4478-4d90-952a-291244b34ec3 tempest-TestVolumeBootPattern-232608497 tempest-TestVolumeBootPattern-232608497-project] 10.222.0.49 "GET /compute/v2.1/servers/0ae818b3-6456-4c1f-8ad2-0509dce1e575" status: 200 len: 1265 microversion: 2.1 time: 0.161520 Dec 14 13:08:39.759159 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: [pid: 116064|app: 0|req: 530/1079] 10.222.0.49 () {58 vars in 1235 bytes} [Tue Dec 14 13:08:39 2021] GET /compute/v2.1/servers/0ae818b3-6456-4c1f-8ad2-0509dce1e575 => generated 1265 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 14 13:08:40.778917 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.api.openstack.wsgi [None req-c7895b9c-7711-4a60-b762-cf6ad390df85 tempest-TestVolumeBootPattern-232608497 tempest-TestVolumeBootPattern-232608497-project] Calling method '>' {{(pid=116063) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 13:08:40.781018 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.compute.api [None req-c7895b9c-7711-4a60-b762-cf6ad390df85 tempest-TestVolumeBootPattern-232608497 tempest-TestVolumeBootPattern-232608497-project] [instance: 0ae818b3-6456-4c1f-8ad2-0509dce1e575] Fetching instance by UUID {{(pid=116063) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 13:08:40.794081 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-c7895b9c-7711-4a60-b762-cf6ad390df85 tempest-TestVolumeBootPattern-232608497 tempest-TestVolumeBootPattern-232608497-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 13:08:40.794536 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-c7895b9c-7711-4a60-b762-cf6ad390df85 tempest-TestVolumeBootPattern-232608497 tempest-TestVolumeBootPattern-232608497-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 13:08:40.795348 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-c7895b9c-7711-4a60-b762-cf6ad390df85 tempest-TestVolumeBootPattern-232608497 tempest-TestVolumeBootPattern-232608497-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 13:08:40.795779 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-c7895b9c-7711-4a60-b762-cf6ad390df85 tempest-TestVolumeBootPattern-232608497 tempest-TestVolumeBootPattern-232608497-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 13:08:40.935232 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.policy [None req-c7895b9c-7711-4a60-b762-cf6ad390df85 tempest-TestVolumeBootPattern-232608497 tempest-TestVolumeBootPattern-232608497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94008a0d97204aff87f20bdeadbdd783', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b854de8019ad4a598587133ba362564b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116063) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 13:08:40.946005 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: INFO nova.api.openstack.requestlog [None req-c7895b9c-7711-4a60-b762-cf6ad390df85 tempest-TestVolumeBootPattern-232608497 tempest-TestVolumeBootPattern-232608497-project] 10.222.0.49 "GET /compute/v2.1/servers/0ae818b3-6456-4c1f-8ad2-0509dce1e575" status: 200 len: 1265 microversion: 2.1 time: 0.172933 Dec 14 13:08:40.946737 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: [pid: 116063|app: 0|req: 550/1080] 10.222.0.49 () {58 vars in 1235 bytes} [Tue Dec 14 13:08:40 2021] GET /compute/v2.1/servers/0ae818b3-6456-4c1f-8ad2-0509dce1e575 => generated 1265 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 14 13:08:41.763983 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.api.openstack.wsgi [req-57ceff09-79a2-411c-bbf9-0dbc54f4dde6 req-b6172c3e-5f9e-4cf4-a27f-869bfb5454e5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0ae818b3-6456-4c1f-8ad2-0509dce1e575", "name": "network-vif-plugged", "status": "completed", "tag": "0b8646d5-2a96-4065-b8d7-d8717ba061ca"}]} {{(pid=116064) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 14 13:08:41.765536 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 14 13:08:41.765536 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: warnings.warn(msg) Dec 14 13:08:41.772865 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [req-57ceff09-79a2-411c-bbf9-0dbc54f4dde6 req-b6172c3e-5f9e-4cf4-a27f-869bfb5454e5 service nova] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 13:08:41.773351 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [req-57ceff09-79a2-411c-bbf9-0dbc54f4dde6 req-b6172c3e-5f9e-4cf4-a27f-869bfb5454e5 service nova] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 13:08:41.786358 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: INFO nova.api.openstack.compute.server_external_events [req-57ceff09-79a2-411c-bbf9-0dbc54f4dde6 req-b6172c3e-5f9e-4cf4-a27f-869bfb5454e5 service nova] Creating event network-vif-plugged:0b8646d5-2a96-4065-b8d7-d8717ba061ca for instance 0ae818b3-6456-4c1f-8ad2-0509dce1e575 on hv-cinder-78447 Dec 14 13:08:41.791247 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: INFO nova.api.openstack.requestlog [req-57ceff09-79a2-411c-bbf9-0dbc54f4dde6 req-b6172c3e-5f9e-4cf4-a27f-869bfb5454e5 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031039 Dec 14 13:08:41.791839 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: [pid: 116064|app: 0|req: 531/1081] 10.222.0.49 () {64 vars in 1317 bytes} [Tue Dec 14 13:08:41 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 14 13:08:41.963466 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.api.openstack.wsgi [None req-a5a34e70-a30a-415f-ae52-ef633698986e tempest-TestVolumeBootPattern-232608497 tempest-TestVolumeBootPattern-232608497-project] Calling method '>' {{(pid=116063) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 13:08:41.964067 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.compute.api [None req-a5a34e70-a30a-415f-ae52-ef633698986e tempest-TestVolumeBootPattern-232608497 tempest-TestVolumeBootPattern-232608497-project] [instance: 0ae818b3-6456-4c1f-8ad2-0509dce1e575] Fetching instance by UUID {{(pid=116063) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 13:08:41.971398 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-a5a34e70-a30a-415f-ae52-ef633698986e tempest-TestVolumeBootPattern-232608497 tempest-TestVolumeBootPattern-232608497-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 13:08:41.971855 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-a5a34e70-a30a-415f-ae52-ef633698986e tempest-TestVolumeBootPattern-232608497 tempest-TestVolumeBootPattern-232608497-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 13:08:41.972675 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-a5a34e70-a30a-415f-ae52-ef633698986e tempest-TestVolumeBootPattern-232608497 tempest-TestVolumeBootPattern-232608497-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 13:08:41.973139 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-a5a34e70-a30a-415f-ae52-ef633698986e tempest-TestVolumeBootPattern-232608497 tempest-TestVolumeBootPattern-232608497-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 13:08:42.104443 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.policy [None req-a5a34e70-a30a-415f-ae52-ef633698986e tempest-TestVolumeBootPattern-232608497 tempest-TestVolumeBootPattern-232608497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94008a0d97204aff87f20bdeadbdd783', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b854de8019ad4a598587133ba362564b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116063) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 13:08:42.112009 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: INFO nova.api.openstack.requestlog [None req-a5a34e70-a30a-415f-ae52-ef633698986e tempest-TestVolumeBootPattern-232608497 tempest-TestVolumeBootPattern-232608497-project] 10.222.0.49 "GET /compute/v2.1/servers/0ae818b3-6456-4c1f-8ad2-0509dce1e575" status: 200 len: 1265 microversion: 2.1 time: 0.152188 Dec 14 13:08:42.112499 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: [pid: 116063|app: 0|req: 551/1082] 10.222.0.49 () {58 vars in 1235 bytes} [Tue Dec 14 13:08:41 2021] GET /compute/v2.1/servers/0ae818b3-6456-4c1f-8ad2-0509dce1e575 => generated 1265 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 14 13:08:43.130046 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.api.openstack.wsgi [None req-3fb09829-3ccb-4130-bed7-7e6cff99c6a3 tempest-TestVolumeBootPattern-232608497 tempest-TestVolumeBootPattern-232608497-project] Calling method '>' {{(pid=116064) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 13:08:43.130629 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.compute.api [None req-3fb09829-3ccb-4130-bed7-7e6cff99c6a3 tempest-TestVolumeBootPattern-232608497 tempest-TestVolumeBootPattern-232608497-project] [instance: 0ae818b3-6456-4c1f-8ad2-0509dce1e575] Fetching instance by UUID {{(pid=116064) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 13:08:43.137130 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-3fb09829-3ccb-4130-bed7-7e6cff99c6a3 tempest-TestVolumeBootPattern-232608497 tempest-TestVolumeBootPattern-232608497-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 13:08:43.137586 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-3fb09829-3ccb-4130-bed7-7e6cff99c6a3 tempest-TestVolumeBootPattern-232608497 tempest-TestVolumeBootPattern-232608497-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 13:08:43.138362 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-3fb09829-3ccb-4130-bed7-7e6cff99c6a3 tempest-TestVolumeBootPattern-232608497 tempest-TestVolumeBootPattern-232608497-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 13:08:43.138796 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-3fb09829-3ccb-4130-bed7-7e6cff99c6a3 tempest-TestVolumeBootPattern-232608497 tempest-TestVolumeBootPattern-232608497-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 13:08:43.274130 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.policy [None req-3fb09829-3ccb-4130-bed7-7e6cff99c6a3 tempest-TestVolumeBootPattern-232608497 tempest-TestVolumeBootPattern-232608497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94008a0d97204aff87f20bdeadbdd783', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b854de8019ad4a598587133ba362564b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116064) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 13:08:43.281637 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: INFO nova.api.openstack.requestlog [None req-3fb09829-3ccb-4130-bed7-7e6cff99c6a3 tempest-TestVolumeBootPattern-232608497 tempest-TestVolumeBootPattern-232608497-project] 10.222.0.49 "GET /compute/v2.1/servers/0ae818b3-6456-4c1f-8ad2-0509dce1e575" status: 200 len: 1453 microversion: 2.1 time: 0.156411 Dec 14 13:08:43.282184 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: [pid: 116064|app: 0|req: 532/1083] 10.222.0.49 () {58 vars in 1235 bytes} [Tue Dec 14 13:08:43 2021] GET /compute/v2.1/servers/0ae818b3-6456-4c1f-8ad2-0509dce1e575 => generated 1453 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 14 13:08:43.299115 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.api.openstack.wsgi [None req-afd7463e-d73d-4923-9755-7923a2975f5f tempest-TestVolumeBootPattern-232608497 tempest-TestVolumeBootPattern-232608497-project] Calling method '>' {{(pid=116063) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 13:08:43.299812 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.compute.api [None req-afd7463e-d73d-4923-9755-7923a2975f5f tempest-TestVolumeBootPattern-232608497 tempest-TestVolumeBootPattern-232608497-project] [instance: 0ae818b3-6456-4c1f-8ad2-0509dce1e575] Fetching instance by UUID {{(pid=116063) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 13:08:43.307088 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-afd7463e-d73d-4923-9755-7923a2975f5f tempest-TestVolumeBootPattern-232608497 tempest-TestVolumeBootPattern-232608497-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 13:08:43.307536 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-afd7463e-d73d-4923-9755-7923a2975f5f tempest-TestVolumeBootPattern-232608497 tempest-TestVolumeBootPattern-232608497-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 13:08:43.308289 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-afd7463e-d73d-4923-9755-7923a2975f5f tempest-TestVolumeBootPattern-232608497 tempest-TestVolumeBootPattern-232608497-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 13:08:43.308802 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-afd7463e-d73d-4923-9755-7923a2975f5f tempest-TestVolumeBootPattern-232608497 tempest-TestVolumeBootPattern-232608497-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 13:08:43.450728 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.policy [None req-afd7463e-d73d-4923-9755-7923a2975f5f tempest-TestVolumeBootPattern-232608497 tempest-TestVolumeBootPattern-232608497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94008a0d97204aff87f20bdeadbdd783', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b854de8019ad4a598587133ba362564b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116063) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 13:08:43.462447 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: INFO nova.api.openstack.requestlog [None req-afd7463e-d73d-4923-9755-7923a2975f5f tempest-TestVolumeBootPattern-232608497 tempest-TestVolumeBootPattern-232608497-project] 10.222.0.49 "GET /compute/v2.1/servers/0ae818b3-6456-4c1f-8ad2-0509dce1e575" status: 200 len: 1453 microversion: 2.1 time: 0.167229 Dec 14 13:08:43.463245 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: [pid: 116063|app: 0|req: 552/1084] 10.222.0.49 () {58 vars in 1235 bytes} [Tue Dec 14 13:08:43 2021] GET /compute/v2.1/servers/0ae818b3-6456-4c1f-8ad2-0509dce1e575 => generated 1453 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 14 13:08:45.405303 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.api.openstack.wsgi [req-70f57af0-32e6-4383-8658-e491f4e30057 req-3db7e20c-bae8-4050-b61f-13ef5705c529 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0ae818b3-6456-4c1f-8ad2-0509dce1e575", "tag": "0b8646d5-2a96-4065-b8d7-d8717ba061ca"}]} {{(pid=116064) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 14 13:08:45.406803 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 14 13:08:45.406803 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: warnings.warn(msg) Dec 14 13:08:45.413867 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [req-70f57af0-32e6-4383-8658-e491f4e30057 req-3db7e20c-bae8-4050-b61f-13ef5705c529 service nova] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 13:08:45.414309 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [req-70f57af0-32e6-4383-8658-e491f4e30057 req-3db7e20c-bae8-4050-b61f-13ef5705c529 service nova] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 13:08:45.425924 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: INFO nova.api.openstack.compute.server_external_events [req-70f57af0-32e6-4383-8658-e491f4e30057 req-3db7e20c-bae8-4050-b61f-13ef5705c529 service nova] Creating event network-changed:0b8646d5-2a96-4065-b8d7-d8717ba061ca for instance 0ae818b3-6456-4c1f-8ad2-0509dce1e575 on hv-cinder-78447 Dec 14 13:08:45.431089 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: INFO nova.api.openstack.requestlog [req-70f57af0-32e6-4383-8658-e491f4e30057 req-3db7e20c-bae8-4050-b61f-13ef5705c529 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.089358 Dec 14 13:08:45.431685 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: [pid: 116064|app: 0|req: 533/1085] 10.222.0.49 () {64 vars in 1317 bytes} [Tue Dec 14 13:08:45 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 14 13:08:56.251643 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.api.openstack.wsgi [None req-1d094e6e-6ea3-40f6-8012-dfe511dee41e tempest-TestShelveInstance-1515730970 tempest-TestShelveInstance-1515730970-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=116063) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 14 13:08:56.252585 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.compute.api [None req-1d094e6e-6ea3-40f6-8012-dfe511dee41e tempest-TestShelveInstance-1515730970 tempest-TestShelveInstance-1515730970-project] [instance: 0c5fe6a3-7904-4ee6-9f04-90633ff50db2] Fetching instance by UUID {{(pid=116063) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 13:08:56.259540 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-1d094e6e-6ea3-40f6-8012-dfe511dee41e tempest-TestShelveInstance-1515730970 tempest-TestShelveInstance-1515730970-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 13:08:56.260143 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-1d094e6e-6ea3-40f6-8012-dfe511dee41e tempest-TestShelveInstance-1515730970 tempest-TestShelveInstance-1515730970-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 13:08:56.261091 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-1d094e6e-6ea3-40f6-8012-dfe511dee41e tempest-TestShelveInstance-1515730970 tempest-TestShelveInstance-1515730970-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 13:08:56.261565 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-1d094e6e-6ea3-40f6-8012-dfe511dee41e tempest-TestShelveInstance-1515730970 tempest-TestShelveInstance-1515730970-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 13:08:56.286203 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.objects.instance [None req-1d094e6e-6ea3-40f6-8012-dfe511dee41e tempest-TestShelveInstance-1515730970 tempest-TestShelveInstance-1515730970-project] Lazy-loading 'flavor' on Instance uuid 0c5fe6a3-7904-4ee6-9f04-90633ff50db2 {{(pid=116063) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Dec 14 13:08:56.373793 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: INFO nova.api.openstack.requestlog [None req-1d094e6e-6ea3-40f6-8012-dfe511dee41e tempest-TestShelveInstance-1515730970 tempest-TestShelveInstance-1515730970-project] 10.222.0.49 "POST /compute/v2.1/servers/0c5fe6a3-7904-4ee6-9f04-90633ff50db2/action" status: 202 len: 0 microversion: 2.1 time: 0.126345 Dec 14 13:08:56.374356 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: [pid: 116063|app: 0|req: 553/1086] 10.222.0.49 () {60 vars in 1277 bytes} [Tue Dec 14 13:08:56 2021] POST /compute/v2.1/servers/0c5fe6a3-7904-4ee6-9f04-90633ff50db2/action => generated 0 bytes in 128 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Dec 14 13:08:56.383994 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.api.openstack.wsgi [None req-59b89ee9-4036-4726-8b8e-2d75ef472ca0 tempest-TestShelveInstance-1515730970 tempest-TestShelveInstance-1515730970-project] Calling method '>' {{(pid=116064) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 13:08:56.384700 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.compute.api [None req-59b89ee9-4036-4726-8b8e-2d75ef472ca0 tempest-TestShelveInstance-1515730970 tempest-TestShelveInstance-1515730970-project] [instance: 0c5fe6a3-7904-4ee6-9f04-90633ff50db2] Fetching instance by UUID {{(pid=116064) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 13:08:56.391633 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-59b89ee9-4036-4726-8b8e-2d75ef472ca0 tempest-TestShelveInstance-1515730970 tempest-TestShelveInstance-1515730970-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 13:08:56.392089 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-59b89ee9-4036-4726-8b8e-2d75ef472ca0 tempest-TestShelveInstance-1515730970 tempest-TestShelveInstance-1515730970-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 13:08:56.392937 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-59b89ee9-4036-4726-8b8e-2d75ef472ca0 tempest-TestShelveInstance-1515730970 tempest-TestShelveInstance-1515730970-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 13:08:56.393379 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-59b89ee9-4036-4726-8b8e-2d75ef472ca0 tempest-TestShelveInstance-1515730970 tempest-TestShelveInstance-1515730970-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 13:08:56.537284 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.policy [None req-59b89ee9-4036-4726-8b8e-2d75ef472ca0 tempest-TestShelveInstance-1515730970 tempest-TestShelveInstance-1515730970-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '818488ec88264dcdb3a7bac93352b56b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe2a769f6b7645cbb7ec24ba01e13a4a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116064) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 13:08:56.545094 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: INFO nova.api.openstack.requestlog [None req-59b89ee9-4036-4726-8b8e-2d75ef472ca0 tempest-TestShelveInstance-1515730970 tempest-TestShelveInstance-1515730970-project] 10.222.0.49 "GET /compute/v2.1/servers/0c5fe6a3-7904-4ee6-9f04-90633ff50db2" status: 200 len: 1569 microversion: 2.1 time: 0.165649 Dec 14 13:08:56.545695 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: [pid: 116064|app: 0|req: 534/1087] 10.222.0.49 () {58 vars in 1235 bytes} [Tue Dec 14 13:08:56 2021] GET /compute/v2.1/servers/0c5fe6a3-7904-4ee6-9f04-90633ff50db2 => generated 1569 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 14 13:08:57.566203 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.api.openstack.wsgi [None req-ae934fa9-a375-48fa-8b14-f04e2804e67d tempest-TestShelveInstance-1515730970 tempest-TestShelveInstance-1515730970-project] Calling method '>' {{(pid=116063) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 13:08:57.567018 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.compute.api [None req-ae934fa9-a375-48fa-8b14-f04e2804e67d tempest-TestShelveInstance-1515730970 tempest-TestShelveInstance-1515730970-project] [instance: 0c5fe6a3-7904-4ee6-9f04-90633ff50db2] Fetching instance by UUID {{(pid=116063) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 13:08:57.574665 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-ae934fa9-a375-48fa-8b14-f04e2804e67d tempest-TestShelveInstance-1515730970 tempest-TestShelveInstance-1515730970-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 13:08:57.575180 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-ae934fa9-a375-48fa-8b14-f04e2804e67d tempest-TestShelveInstance-1515730970 tempest-TestShelveInstance-1515730970-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 13:08:57.576084 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-ae934fa9-a375-48fa-8b14-f04e2804e67d tempest-TestShelveInstance-1515730970 tempest-TestShelveInstance-1515730970-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 13:08:57.576583 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-ae934fa9-a375-48fa-8b14-f04e2804e67d tempest-TestShelveInstance-1515730970 tempest-TestShelveInstance-1515730970-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 13:08:57.721909 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.policy [None req-ae934fa9-a375-48fa-8b14-f04e2804e67d tempest-TestShelveInstance-1515730970 tempest-TestShelveInstance-1515730970-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '818488ec88264dcdb3a7bac93352b56b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe2a769f6b7645cbb7ec24ba01e13a4a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116063) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 13:08:57.729733 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: INFO nova.api.openstack.requestlog [None req-ae934fa9-a375-48fa-8b14-f04e2804e67d tempest-TestShelveInstance-1515730970 tempest-TestShelveInstance-1515730970-project] 10.222.0.49 "GET /compute/v2.1/servers/0c5fe6a3-7904-4ee6-9f04-90633ff50db2" status: 200 len: 1569 microversion: 2.1 time: 0.169029 Dec 14 13:08:57.730294 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: [pid: 116063|app: 0|req: 554/1088] 10.222.0.49 () {58 vars in 1235 bytes} [Tue Dec 14 13:08:57 2021] GET /compute/v2.1/servers/0c5fe6a3-7904-4ee6-9f04-90633ff50db2 => generated 1569 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 14 13:08:58.756358 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.api.openstack.wsgi [None req-4a4d628d-6a1b-4cb3-81fc-04c640d8fc72 tempest-TestShelveInstance-1515730970 tempest-TestShelveInstance-1515730970-project] Calling method '>' {{(pid=116064) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 13:08:58.757370 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.compute.api [None req-4a4d628d-6a1b-4cb3-81fc-04c640d8fc72 tempest-TestShelveInstance-1515730970 tempest-TestShelveInstance-1515730970-project] [instance: 0c5fe6a3-7904-4ee6-9f04-90633ff50db2] Fetching instance by UUID {{(pid=116064) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 13:08:58.766541 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-4a4d628d-6a1b-4cb3-81fc-04c640d8fc72 tempest-TestShelveInstance-1515730970 tempest-TestShelveInstance-1515730970-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 13:08:58.766991 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-4a4d628d-6a1b-4cb3-81fc-04c640d8fc72 tempest-TestShelveInstance-1515730970 tempest-TestShelveInstance-1515730970-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 13:08:58.767776 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-4a4d628d-6a1b-4cb3-81fc-04c640d8fc72 tempest-TestShelveInstance-1515730970 tempest-TestShelveInstance-1515730970-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 13:08:58.768214 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-4a4d628d-6a1b-4cb3-81fc-04c640d8fc72 tempest-TestShelveInstance-1515730970 tempest-TestShelveInstance-1515730970-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 13:08:58.904431 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.policy [None req-4a4d628d-6a1b-4cb3-81fc-04c640d8fc72 tempest-TestShelveInstance-1515730970 tempest-TestShelveInstance-1515730970-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '818488ec88264dcdb3a7bac93352b56b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe2a769f6b7645cbb7ec24ba01e13a4a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116064) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 13:08:58.912356 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: INFO nova.api.openstack.requestlog [None req-4a4d628d-6a1b-4cb3-81fc-04c640d8fc72 tempest-TestShelveInstance-1515730970 tempest-TestShelveInstance-1515730970-project] 10.222.0.49 "GET /compute/v2.1/servers/0c5fe6a3-7904-4ee6-9f04-90633ff50db2" status: 200 len: 1569 microversion: 2.1 time: 0.162313 Dec 14 13:08:58.912981 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: [pid: 116064|app: 0|req: 535/1089] 10.222.0.49 () {58 vars in 1235 bytes} [Tue Dec 14 13:08:58 2021] GET /compute/v2.1/servers/0c5fe6a3-7904-4ee6-9f04-90633ff50db2 => generated 1569 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 14 13:08:59.933400 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.api.openstack.wsgi [None req-a0e7bc66-5833-44f3-b6ef-fc8823423ffe tempest-TestShelveInstance-1515730970 tempest-TestShelveInstance-1515730970-project] Calling method '>' {{(pid=116063) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 13:08:59.934449 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.compute.api [None req-a0e7bc66-5833-44f3-b6ef-fc8823423ffe tempest-TestShelveInstance-1515730970 tempest-TestShelveInstance-1515730970-project] [instance: 0c5fe6a3-7904-4ee6-9f04-90633ff50db2] Fetching instance by UUID {{(pid=116063) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 13:08:59.942266 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-a0e7bc66-5833-44f3-b6ef-fc8823423ffe tempest-TestShelveInstance-1515730970 tempest-TestShelveInstance-1515730970-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 13:08:59.942788 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-a0e7bc66-5833-44f3-b6ef-fc8823423ffe tempest-TestShelveInstance-1515730970 tempest-TestShelveInstance-1515730970-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 13:08:59.943639 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-a0e7bc66-5833-44f3-b6ef-fc8823423ffe tempest-TestShelveInstance-1515730970 tempest-TestShelveInstance-1515730970-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 13:08:59.944116 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-a0e7bc66-5833-44f3-b6ef-fc8823423ffe tempest-TestShelveInstance-1515730970 tempest-TestShelveInstance-1515730970-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 13:09:00.082276 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.policy [None req-a0e7bc66-5833-44f3-b6ef-fc8823423ffe tempest-TestShelveInstance-1515730970 tempest-TestShelveInstance-1515730970-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '818488ec88264dcdb3a7bac93352b56b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe2a769f6b7645cbb7ec24ba01e13a4a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116063) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 13:09:00.090226 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: INFO nova.api.openstack.requestlog [None req-a0e7bc66-5833-44f3-b6ef-fc8823423ffe tempest-TestShelveInstance-1515730970 tempest-TestShelveInstance-1515730970-project] 10.222.0.49 "GET /compute/v2.1/servers/0c5fe6a3-7904-4ee6-9f04-90633ff50db2" status: 200 len: 1569 microversion: 2.1 time: 0.163097 Dec 14 13:09:00.090788 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: [pid: 116063|app: 0|req: 555/1090] 10.222.0.49 () {58 vars in 1235 bytes} [Tue Dec 14 13:08:59 2021] GET /compute/v2.1/servers/0c5fe6a3-7904-4ee6-9f04-90633ff50db2 => generated 1569 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 14 13:09:01.111308 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.api.openstack.wsgi [None req-012df4f5-1c29-4f99-8c4e-9286692728e6 tempest-TestShelveInstance-1515730970 tempest-TestShelveInstance-1515730970-project] Calling method '>' {{(pid=116064) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 13:09:01.112319 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.compute.api [None req-012df4f5-1c29-4f99-8c4e-9286692728e6 tempest-TestShelveInstance-1515730970 tempest-TestShelveInstance-1515730970-project] [instance: 0c5fe6a3-7904-4ee6-9f04-90633ff50db2] Fetching instance by UUID {{(pid=116064) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 13:09:01.123008 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-012df4f5-1c29-4f99-8c4e-9286692728e6 tempest-TestShelveInstance-1515730970 tempest-TestShelveInstance-1515730970-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 13:09:01.123747 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-012df4f5-1c29-4f99-8c4e-9286692728e6 tempest-TestShelveInstance-1515730970 tempest-TestShelveInstance-1515730970-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 13:09:01.125089 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-012df4f5-1c29-4f99-8c4e-9286692728e6 tempest-TestShelveInstance-1515730970 tempest-TestShelveInstance-1515730970-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 13:09:01.125804 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-012df4f5-1c29-4f99-8c4e-9286692728e6 tempest-TestShelveInstance-1515730970 tempest-TestShelveInstance-1515730970-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 13:09:01.265605 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.policy [None req-012df4f5-1c29-4f99-8c4e-9286692728e6 tempest-TestShelveInstance-1515730970 tempest-TestShelveInstance-1515730970-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '818488ec88264dcdb3a7bac93352b56b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe2a769f6b7645cbb7ec24ba01e13a4a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116064) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 13:09:01.273094 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: INFO nova.api.openstack.requestlog [None req-012df4f5-1c29-4f99-8c4e-9286692728e6 tempest-TestShelveInstance-1515730970 tempest-TestShelveInstance-1515730970-project] 10.222.0.49 "GET /compute/v2.1/servers/0c5fe6a3-7904-4ee6-9f04-90633ff50db2" status: 200 len: 1569 microversion: 2.1 time: 0.168187 Dec 14 13:09:01.273666 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: [pid: 116064|app: 0|req: 536/1091] 10.222.0.49 () {58 vars in 1235 bytes} [Tue Dec 14 13:09:01 2021] GET /compute/v2.1/servers/0c5fe6a3-7904-4ee6-9f04-90633ff50db2 => generated 1569 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 14 13:09:02.296235 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.api.openstack.wsgi [None req-7d46cfcb-bf86-4bcc-95a7-4e21dc486a27 tempest-TestShelveInstance-1515730970 tempest-TestShelveInstance-1515730970-project] Calling method '>' {{(pid=116063) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 13:09:02.296881 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.compute.api [None req-7d46cfcb-bf86-4bcc-95a7-4e21dc486a27 tempest-TestShelveInstance-1515730970 tempest-TestShelveInstance-1515730970-project] [instance: 0c5fe6a3-7904-4ee6-9f04-90633ff50db2] Fetching instance by UUID {{(pid=116063) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 13:09:02.304180 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-7d46cfcb-bf86-4bcc-95a7-4e21dc486a27 tempest-TestShelveInstance-1515730970 tempest-TestShelveInstance-1515730970-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 13:09:02.304588 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-7d46cfcb-bf86-4bcc-95a7-4e21dc486a27 tempest-TestShelveInstance-1515730970 tempest-TestShelveInstance-1515730970-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 13:09:02.305404 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-7d46cfcb-bf86-4bcc-95a7-4e21dc486a27 tempest-TestShelveInstance-1515730970 tempest-TestShelveInstance-1515730970-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 13:09:02.305837 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-7d46cfcb-bf86-4bcc-95a7-4e21dc486a27 tempest-TestShelveInstance-1515730970 tempest-TestShelveInstance-1515730970-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 13:09:02.450384 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.policy [None req-7d46cfcb-bf86-4bcc-95a7-4e21dc486a27 tempest-TestShelveInstance-1515730970 tempest-TestShelveInstance-1515730970-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '818488ec88264dcdb3a7bac93352b56b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe2a769f6b7645cbb7ec24ba01e13a4a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116063) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 13:09:02.459253 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: INFO nova.api.openstack.requestlog [None req-7d46cfcb-bf86-4bcc-95a7-4e21dc486a27 tempest-TestShelveInstance-1515730970 tempest-TestShelveInstance-1515730970-project] 10.222.0.49 "GET /compute/v2.1/servers/0c5fe6a3-7904-4ee6-9f04-90633ff50db2" status: 200 len: 1569 microversion: 2.1 time: 0.167265 Dec 14 13:09:02.459792 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: [pid: 116063|app: 0|req: 556/1092] 10.222.0.49 () {58 vars in 1235 bytes} [Tue Dec 14 13:09:02 2021] GET /compute/v2.1/servers/0c5fe6a3-7904-4ee6-9f04-90633ff50db2 => generated 1569 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 14 13:09:03.480053 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.api.openstack.wsgi [None req-debdb598-e29f-49a6-8c3f-444242c40f8a tempest-TestShelveInstance-1515730970 tempest-TestShelveInstance-1515730970-project] Calling method '>' {{(pid=116064) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 13:09:03.481030 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.compute.api [None req-debdb598-e29f-49a6-8c3f-444242c40f8a tempest-TestShelveInstance-1515730970 tempest-TestShelveInstance-1515730970-project] [instance: 0c5fe6a3-7904-4ee6-9f04-90633ff50db2] Fetching instance by UUID {{(pid=116064) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 13:09:03.488364 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-debdb598-e29f-49a6-8c3f-444242c40f8a tempest-TestShelveInstance-1515730970 tempest-TestShelveInstance-1515730970-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 13:09:03.488808 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-debdb598-e29f-49a6-8c3f-444242c40f8a tempest-TestShelveInstance-1515730970 tempest-TestShelveInstance-1515730970-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 13:09:03.489623 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-debdb598-e29f-49a6-8c3f-444242c40f8a tempest-TestShelveInstance-1515730970 tempest-TestShelveInstance-1515730970-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 13:09:03.490053 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-debdb598-e29f-49a6-8c3f-444242c40f8a tempest-TestShelveInstance-1515730970 tempest-TestShelveInstance-1515730970-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 13:09:03.630690 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.policy [None req-debdb598-e29f-49a6-8c3f-444242c40f8a tempest-TestShelveInstance-1515730970 tempest-TestShelveInstance-1515730970-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '818488ec88264dcdb3a7bac93352b56b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe2a769f6b7645cbb7ec24ba01e13a4a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116064) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 13:09:03.641890 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: INFO nova.api.openstack.requestlog [None req-debdb598-e29f-49a6-8c3f-444242c40f8a tempest-TestShelveInstance-1515730970 tempest-TestShelveInstance-1515730970-project] 10.222.0.49 "GET /compute/v2.1/servers/0c5fe6a3-7904-4ee6-9f04-90633ff50db2" status: 200 len: 1569 microversion: 2.1 time: 0.167810 Dec 14 13:09:03.642650 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: [pid: 116064|app: 0|req: 537/1093] 10.222.0.49 () {58 vars in 1235 bytes} [Tue Dec 14 13:09:03 2021] GET /compute/v2.1/servers/0c5fe6a3-7904-4ee6-9f04-90633ff50db2 => generated 1569 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 14 13:09:04.665414 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.api.openstack.wsgi [None req-478a86cc-beba-4f7e-81de-6d49881ee36b tempest-TestShelveInstance-1515730970 tempest-TestShelveInstance-1515730970-project] Calling method '>' {{(pid=116063) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 13:09:04.666163 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.compute.api [None req-478a86cc-beba-4f7e-81de-6d49881ee36b tempest-TestShelveInstance-1515730970 tempest-TestShelveInstance-1515730970-project] [instance: 0c5fe6a3-7904-4ee6-9f04-90633ff50db2] Fetching instance by UUID {{(pid=116063) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 13:09:04.673879 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-478a86cc-beba-4f7e-81de-6d49881ee36b tempest-TestShelveInstance-1515730970 tempest-TestShelveInstance-1515730970-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 13:09:04.674317 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-478a86cc-beba-4f7e-81de-6d49881ee36b tempest-TestShelveInstance-1515730970 tempest-TestShelveInstance-1515730970-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 13:09:04.675084 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-478a86cc-beba-4f7e-81de-6d49881ee36b tempest-TestShelveInstance-1515730970 tempest-TestShelveInstance-1515730970-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 13:09:04.675506 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-478a86cc-beba-4f7e-81de-6d49881ee36b tempest-TestShelveInstance-1515730970 tempest-TestShelveInstance-1515730970-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 13:09:04.811623 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.policy [None req-478a86cc-beba-4f7e-81de-6d49881ee36b tempest-TestShelveInstance-1515730970 tempest-TestShelveInstance-1515730970-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '818488ec88264dcdb3a7bac93352b56b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe2a769f6b7645cbb7ec24ba01e13a4a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116063) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 13:09:04.819672 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: INFO nova.api.openstack.requestlog [None req-478a86cc-beba-4f7e-81de-6d49881ee36b tempest-TestShelveInstance-1515730970 tempest-TestShelveInstance-1515730970-project] 10.222.0.49 "GET /compute/v2.1/servers/0c5fe6a3-7904-4ee6-9f04-90633ff50db2" status: 200 len: 1569 microversion: 2.1 time: 0.159503 Dec 14 13:09:04.820238 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: [pid: 116063|app: 0|req: 557/1094] 10.222.0.49 () {58 vars in 1235 bytes} [Tue Dec 14 13:09:04 2021] GET /compute/v2.1/servers/0c5fe6a3-7904-4ee6-9f04-90633ff50db2 => generated 1569 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 14 13:09:05.840426 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.api.openstack.wsgi [None req-400d063e-284d-40fb-b707-d207d68dc34d tempest-TestShelveInstance-1515730970 tempest-TestShelveInstance-1515730970-project] Calling method '>' {{(pid=116064) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 13:09:05.841564 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.compute.api [None req-400d063e-284d-40fb-b707-d207d68dc34d tempest-TestShelveInstance-1515730970 tempest-TestShelveInstance-1515730970-project] [instance: 0c5fe6a3-7904-4ee6-9f04-90633ff50db2] Fetching instance by UUID {{(pid=116064) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 13:09:05.848884 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-400d063e-284d-40fb-b707-d207d68dc34d tempest-TestShelveInstance-1515730970 tempest-TestShelveInstance-1515730970-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 13:09:05.849398 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-400d063e-284d-40fb-b707-d207d68dc34d tempest-TestShelveInstance-1515730970 tempest-TestShelveInstance-1515730970-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 13:09:05.850253 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-400d063e-284d-40fb-b707-d207d68dc34d tempest-TestShelveInstance-1515730970 tempest-TestShelveInstance-1515730970-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 13:09:05.850700 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-400d063e-284d-40fb-b707-d207d68dc34d tempest-TestShelveInstance-1515730970 tempest-TestShelveInstance-1515730970-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 13:09:05.989724 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.policy [None req-400d063e-284d-40fb-b707-d207d68dc34d tempest-TestShelveInstance-1515730970 tempest-TestShelveInstance-1515730970-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '818488ec88264dcdb3a7bac93352b56b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe2a769f6b7645cbb7ec24ba01e13a4a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116064) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 13:09:05.997422 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: INFO nova.api.openstack.requestlog [None req-400d063e-284d-40fb-b707-d207d68dc34d tempest-TestShelveInstance-1515730970 tempest-TestShelveInstance-1515730970-project] 10.222.0.49 "GET /compute/v2.1/servers/0c5fe6a3-7904-4ee6-9f04-90633ff50db2" status: 200 len: 1569 microversion: 2.1 time: 0.163087 Dec 14 13:09:05.998072 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: [pid: 116064|app: 0|req: 538/1095] 10.222.0.49 () {58 vars in 1235 bytes} [Tue Dec 14 13:09:05 2021] GET /compute/v2.1/servers/0c5fe6a3-7904-4ee6-9f04-90633ff50db2 => generated 1569 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 14 13:09:07.014615 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.api.openstack.wsgi [None req-9734da83-2982-43a7-919d-f9e0d6d2c36c tempest-TestShelveInstance-1515730970 tempest-TestShelveInstance-1515730970-project] Calling method '>' {{(pid=116063) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 13:09:07.015225 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.compute.api [None req-9734da83-2982-43a7-919d-f9e0d6d2c36c tempest-TestShelveInstance-1515730970 tempest-TestShelveInstance-1515730970-project] [instance: 0c5fe6a3-7904-4ee6-9f04-90633ff50db2] Fetching instance by UUID {{(pid=116063) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 13:09:07.021666 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-9734da83-2982-43a7-919d-f9e0d6d2c36c tempest-TestShelveInstance-1515730970 tempest-TestShelveInstance-1515730970-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 13:09:07.022108 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-9734da83-2982-43a7-919d-f9e0d6d2c36c tempest-TestShelveInstance-1515730970 tempest-TestShelveInstance-1515730970-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 13:09:07.022878 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-9734da83-2982-43a7-919d-f9e0d6d2c36c tempest-TestShelveInstance-1515730970 tempest-TestShelveInstance-1515730970-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 13:09:07.023308 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-9734da83-2982-43a7-919d-f9e0d6d2c36c tempest-TestShelveInstance-1515730970 tempest-TestShelveInstance-1515730970-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 13:09:07.160034 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.policy [None req-9734da83-2982-43a7-919d-f9e0d6d2c36c tempest-TestShelveInstance-1515730970 tempest-TestShelveInstance-1515730970-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '818488ec88264dcdb3a7bac93352b56b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe2a769f6b7645cbb7ec24ba01e13a4a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116063) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 13:09:07.168713 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: INFO nova.api.openstack.requestlog [None req-9734da83-2982-43a7-919d-f9e0d6d2c36c tempest-TestShelveInstance-1515730970 tempest-TestShelveInstance-1515730970-project] 10.222.0.49 "GET /compute/v2.1/servers/0c5fe6a3-7904-4ee6-9f04-90633ff50db2" status: 200 len: 1569 microversion: 2.1 time: 0.157872 Dec 14 13:09:07.169331 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: [pid: 116063|app: 0|req: 558/1096] 10.222.0.49 () {58 vars in 1235 bytes} [Tue Dec 14 13:09:07 2021] GET /compute/v2.1/servers/0c5fe6a3-7904-4ee6-9f04-90633ff50db2 => generated 1569 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 14 13:09:08.190305 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.api.openstack.wsgi [None req-00339241-5bc4-466e-8412-a66d39edbc53 tempest-TestShelveInstance-1515730970 tempest-TestShelveInstance-1515730970-project] Calling method '>' {{(pid=116064) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 13:09:08.191185 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.compute.api [None req-00339241-5bc4-466e-8412-a66d39edbc53 tempest-TestShelveInstance-1515730970 tempest-TestShelveInstance-1515730970-project] [instance: 0c5fe6a3-7904-4ee6-9f04-90633ff50db2] Fetching instance by UUID {{(pid=116064) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 13:09:08.201861 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-00339241-5bc4-466e-8412-a66d39edbc53 tempest-TestShelveInstance-1515730970 tempest-TestShelveInstance-1515730970-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 13:09:08.202589 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-00339241-5bc4-466e-8412-a66d39edbc53 tempest-TestShelveInstance-1515730970 tempest-TestShelveInstance-1515730970-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 13:09:08.203869 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-00339241-5bc4-466e-8412-a66d39edbc53 tempest-TestShelveInstance-1515730970 tempest-TestShelveInstance-1515730970-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 13:09:08.204584 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-00339241-5bc4-466e-8412-a66d39edbc53 tempest-TestShelveInstance-1515730970 tempest-TestShelveInstance-1515730970-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 13:09:08.349719 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.policy [None req-00339241-5bc4-466e-8412-a66d39edbc53 tempest-TestShelveInstance-1515730970 tempest-TestShelveInstance-1515730970-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '818488ec88264dcdb3a7bac93352b56b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe2a769f6b7645cbb7ec24ba01e13a4a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116064) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 13:09:08.357760 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: INFO nova.api.openstack.requestlog [None req-00339241-5bc4-466e-8412-a66d39edbc53 tempest-TestShelveInstance-1515730970 tempest-TestShelveInstance-1515730970-project] 10.222.0.49 "GET /compute/v2.1/servers/0c5fe6a3-7904-4ee6-9f04-90633ff50db2" status: 200 len: 1569 microversion: 2.1 time: 0.174001 Dec 14 13:09:08.358404 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: [pid: 116064|app: 0|req: 539/1097] 10.222.0.49 () {58 vars in 1235 bytes} [Tue Dec 14 13:09:08 2021] GET /compute/v2.1/servers/0c5fe6a3-7904-4ee6-9f04-90633ff50db2 => generated 1569 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 14 13:09:09.379347 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.api.openstack.wsgi [None req-5c486a27-a225-445f-89e9-54013487bfcb tempest-TestShelveInstance-1515730970 tempest-TestShelveInstance-1515730970-project] Calling method '>' {{(pid=116063) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 13:09:09.379962 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.compute.api [None req-5c486a27-a225-445f-89e9-54013487bfcb tempest-TestShelveInstance-1515730970 tempest-TestShelveInstance-1515730970-project] [instance: 0c5fe6a3-7904-4ee6-9f04-90633ff50db2] Fetching instance by UUID {{(pid=116063) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 13:09:09.389206 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-5c486a27-a225-445f-89e9-54013487bfcb tempest-TestShelveInstance-1515730970 tempest-TestShelveInstance-1515730970-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 13:09:09.389650 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-5c486a27-a225-445f-89e9-54013487bfcb tempest-TestShelveInstance-1515730970 tempest-TestShelveInstance-1515730970-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 13:09:09.390421 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-5c486a27-a225-445f-89e9-54013487bfcb tempest-TestShelveInstance-1515730970 tempest-TestShelveInstance-1515730970-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 13:09:09.390853 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-5c486a27-a225-445f-89e9-54013487bfcb tempest-TestShelveInstance-1515730970 tempest-TestShelveInstance-1515730970-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 13:09:09.531400 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.policy [None req-5c486a27-a225-445f-89e9-54013487bfcb tempest-TestShelveInstance-1515730970 tempest-TestShelveInstance-1515730970-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '818488ec88264dcdb3a7bac93352b56b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe2a769f6b7645cbb7ec24ba01e13a4a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116063) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 13:09:09.539123 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: INFO nova.api.openstack.requestlog [None req-5c486a27-a225-445f-89e9-54013487bfcb tempest-TestShelveInstance-1515730970 tempest-TestShelveInstance-1515730970-project] 10.222.0.49 "GET /compute/v2.1/servers/0c5fe6a3-7904-4ee6-9f04-90633ff50db2" status: 200 len: 1510 microversion: 2.1 time: 0.165684 Dec 14 13:09:09.539701 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: [pid: 116063|app: 0|req: 559/1098] 10.222.0.49 () {58 vars in 1235 bytes} [Tue Dec 14 13:09:09 2021] GET /compute/v2.1/servers/0c5fe6a3-7904-4ee6-9f04-90633ff50db2 => generated 1510 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 14 13:09:09.555520 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.api.openstack.wsgi [None req-2b58d4c3-5342-49a6-b9f7-4a6397c9f683 tempest-TestShelveInstance-1515730970 tempest-TestShelveInstance-1515730970-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=116064) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 14 13:09:09.556059 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.compute.api [None req-2b58d4c3-5342-49a6-b9f7-4a6397c9f683 tempest-TestShelveInstance-1515730970 tempest-TestShelveInstance-1515730970-project] [instance: 0c5fe6a3-7904-4ee6-9f04-90633ff50db2] Fetching instance by UUID {{(pid=116064) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 13:09:09.563142 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-2b58d4c3-5342-49a6-b9f7-4a6397c9f683 tempest-TestShelveInstance-1515730970 tempest-TestShelveInstance-1515730970-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 13:09:09.563600 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-2b58d4c3-5342-49a6-b9f7-4a6397c9f683 tempest-TestShelveInstance-1515730970 tempest-TestShelveInstance-1515730970-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 13:09:09.564395 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-2b58d4c3-5342-49a6-b9f7-4a6397c9f683 tempest-TestShelveInstance-1515730970 tempest-TestShelveInstance-1515730970-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 13:09:09.564835 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-2b58d4c3-5342-49a6-b9f7-4a6397c9f683 tempest-TestShelveInstance-1515730970 tempest-TestShelveInstance-1515730970-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 13:09:09.643130 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: INFO nova.api.openstack.requestlog [None req-2b58d4c3-5342-49a6-b9f7-4a6397c9f683 tempest-TestShelveInstance-1515730970 tempest-TestShelveInstance-1515730970-project] 10.222.0.49 "POST /compute/v2.1/servers/0c5fe6a3-7904-4ee6-9f04-90633ff50db2/action" status: 202 len: 0 microversion: 2.1 time: 0.091036 Dec 14 13:09:09.643669 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: [pid: 116064|app: 0|req: 540/1099] 10.222.0.49 () {60 vars in 1277 bytes} [Tue Dec 14 13:09:09 2021] POST /compute/v2.1/servers/0c5fe6a3-7904-4ee6-9f04-90633ff50db2/action => generated 0 bytes in 93 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Dec 14 13:09:09.652111 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.api.openstack.wsgi [None req-89cdaf58-aa92-45f8-86fe-d26a572e3eca tempest-TestShelveInstance-1515730970 tempest-TestShelveInstance-1515730970-project] Calling method '>' {{(pid=116063) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 13:09:09.652731 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.compute.api [None req-89cdaf58-aa92-45f8-86fe-d26a572e3eca tempest-TestShelveInstance-1515730970 tempest-TestShelveInstance-1515730970-project] [instance: 0c5fe6a3-7904-4ee6-9f04-90633ff50db2] Fetching instance by UUID {{(pid=116063) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 13:09:09.658927 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-89cdaf58-aa92-45f8-86fe-d26a572e3eca tempest-TestShelveInstance-1515730970 tempest-TestShelveInstance-1515730970-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 13:09:09.659382 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-89cdaf58-aa92-45f8-86fe-d26a572e3eca tempest-TestShelveInstance-1515730970 tempest-TestShelveInstance-1515730970-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 13:09:09.660166 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-89cdaf58-aa92-45f8-86fe-d26a572e3eca tempest-TestShelveInstance-1515730970 tempest-TestShelveInstance-1515730970-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 13:09:09.660944 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-89cdaf58-aa92-45f8-86fe-d26a572e3eca tempest-TestShelveInstance-1515730970 tempest-TestShelveInstance-1515730970-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 13:09:09.796535 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.policy [None req-89cdaf58-aa92-45f8-86fe-d26a572e3eca tempest-TestShelveInstance-1515730970 tempest-TestShelveInstance-1515730970-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '818488ec88264dcdb3a7bac93352b56b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe2a769f6b7645cbb7ec24ba01e13a4a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116063) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 13:09:09.804062 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: INFO nova.api.openstack.requestlog [None req-89cdaf58-aa92-45f8-86fe-d26a572e3eca tempest-TestShelveInstance-1515730970 tempest-TestShelveInstance-1515730970-project] 10.222.0.49 "GET /compute/v2.1/servers/0c5fe6a3-7904-4ee6-9f04-90633ff50db2" status: 200 len: 1518 microversion: 2.1 time: 0.156068 Dec 14 13:09:09.804634 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: [pid: 116063|app: 0|req: 560/1100] 10.222.0.49 () {58 vars in 1235 bytes} [Tue Dec 14 13:09:09 2021] GET /compute/v2.1/servers/0c5fe6a3-7904-4ee6-9f04-90633ff50db2 => generated 1518 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 14 13:09:10.821301 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.api.openstack.wsgi [None req-16bb8090-2bb0-4766-b3e4-dbb8de806b35 tempest-TestShelveInstance-1515730970 tempest-TestShelveInstance-1515730970-project] Calling method '>' {{(pid=116064) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 13:09:10.821912 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.compute.api [None req-16bb8090-2bb0-4766-b3e4-dbb8de806b35 tempest-TestShelveInstance-1515730970 tempest-TestShelveInstance-1515730970-project] [instance: 0c5fe6a3-7904-4ee6-9f04-90633ff50db2] Fetching instance by UUID {{(pid=116064) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 13:09:10.828475 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-16bb8090-2bb0-4766-b3e4-dbb8de806b35 tempest-TestShelveInstance-1515730970 tempest-TestShelveInstance-1515730970-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 13:09:10.828965 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-16bb8090-2bb0-4766-b3e4-dbb8de806b35 tempest-TestShelveInstance-1515730970 tempest-TestShelveInstance-1515730970-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 13:09:10.829777 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-16bb8090-2bb0-4766-b3e4-dbb8de806b35 tempest-TestShelveInstance-1515730970 tempest-TestShelveInstance-1515730970-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 13:09:10.830210 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-16bb8090-2bb0-4766-b3e4-dbb8de806b35 tempest-TestShelveInstance-1515730970 tempest-TestShelveInstance-1515730970-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 13:09:10.962349 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.policy [None req-16bb8090-2bb0-4766-b3e4-dbb8de806b35 tempest-TestShelveInstance-1515730970 tempest-TestShelveInstance-1515730970-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '818488ec88264dcdb3a7bac93352b56b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe2a769f6b7645cbb7ec24ba01e13a4a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116064) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 13:09:10.970324 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: INFO nova.api.openstack.requestlog [None req-16bb8090-2bb0-4766-b3e4-dbb8de806b35 tempest-TestShelveInstance-1515730970 tempest-TestShelveInstance-1515730970-project] 10.222.0.49 "GET /compute/v2.1/servers/0c5fe6a3-7904-4ee6-9f04-90633ff50db2" status: 200 len: 1518 microversion: 2.1 time: 0.152712 Dec 14 13:09:10.971125 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: [pid: 116064|app: 0|req: 541/1101] 10.222.0.49 () {58 vars in 1235 bytes} [Tue Dec 14 13:09:10 2021] GET /compute/v2.1/servers/0c5fe6a3-7904-4ee6-9f04-90633ff50db2 => generated 1518 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 14 13:09:11.942509 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.api.openstack.wsgi [req-0d4a0a10-6c47-44d6-96fc-b808c47050a9 req-4712de27-2551-4430-beb8-71ec5314c7d8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0c5fe6a3-7904-4ee6-9f04-90633ff50db2", "name": "network-vif-unplugged", "status": "completed", "tag": "6b399ecc-9d61-4402-b72e-7daa479ee08d"}]} {{(pid=116063) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 14 13:09:11.944089 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 14 13:09:11.944089 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: warnings.warn(msg) Dec 14 13:09:11.951976 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [req-0d4a0a10-6c47-44d6-96fc-b808c47050a9 req-4712de27-2551-4430-beb8-71ec5314c7d8 service nova] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 13:09:11.952818 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [req-0d4a0a10-6c47-44d6-96fc-b808c47050a9 req-4712de27-2551-4430-beb8-71ec5314c7d8 service nova] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 13:09:11.964642 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.api.openstack.compute.server_external_events [req-0d4a0a10-6c47-44d6-96fc-b808c47050a9 req-4712de27-2551-4430-beb8-71ec5314c7d8 service nova] Unable to find a host for instance 0c5fe6a3-7904-4ee6-9f04-90633ff50db2. Dropping event network-vif-unplugged {{(pid=116063) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:138}} Dec 14 13:09:11.965547 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: INFO nova.api.openstack.requestlog [req-0d4a0a10-6c47-44d6-96fc-b808c47050a9 req-4712de27-2551-4430-beb8-71ec5314c7d8 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.097249 Dec 14 13:09:11.966197 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: [pid: 116063|app: 0|req: 561/1102] 10.222.0.49 () {64 vars in 1317 bytes} [Tue Dec 14 13:09:11 2021] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 98 msecs (HTTP/1.1 207) 9 headers in 367 bytes (2 switches on core 0) Dec 14 13:09:11.987266 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.api.openstack.wsgi [None req-a36af888-b9ee-40fb-8c11-e2039b9c1028 tempest-TestShelveInstance-1515730970 tempest-TestShelveInstance-1515730970-project] Calling method '>' {{(pid=116064) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 13:09:11.987875 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.compute.api [None req-a36af888-b9ee-40fb-8c11-e2039b9c1028 tempest-TestShelveInstance-1515730970 tempest-TestShelveInstance-1515730970-project] [instance: 0c5fe6a3-7904-4ee6-9f04-90633ff50db2] Fetching instance by UUID {{(pid=116064) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 13:09:11.994171 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-a36af888-b9ee-40fb-8c11-e2039b9c1028 tempest-TestShelveInstance-1515730970 tempest-TestShelveInstance-1515730970-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 13:09:11.994614 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-a36af888-b9ee-40fb-8c11-e2039b9c1028 tempest-TestShelveInstance-1515730970 tempest-TestShelveInstance-1515730970-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 13:09:11.995377 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-a36af888-b9ee-40fb-8c11-e2039b9c1028 tempest-TestShelveInstance-1515730970 tempest-TestShelveInstance-1515730970-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 13:09:11.995804 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-a36af888-b9ee-40fb-8c11-e2039b9c1028 tempest-TestShelveInstance-1515730970 tempest-TestShelveInstance-1515730970-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 13:09:12.136455 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.policy [None req-a36af888-b9ee-40fb-8c11-e2039b9c1028 tempest-TestShelveInstance-1515730970 tempest-TestShelveInstance-1515730970-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '818488ec88264dcdb3a7bac93352b56b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe2a769f6b7645cbb7ec24ba01e13a4a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116064) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 13:09:12.143885 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: INFO nova.api.openstack.requestlog [None req-a36af888-b9ee-40fb-8c11-e2039b9c1028 tempest-TestShelveInstance-1515730970 tempest-TestShelveInstance-1515730970-project] 10.222.0.49 "GET /compute/v2.1/servers/0c5fe6a3-7904-4ee6-9f04-90633ff50db2" status: 200 len: 1518 microversion: 2.1 time: 0.160329 Dec 14 13:09:12.144458 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: [pid: 116064|app: 0|req: 542/1103] 10.222.0.49 () {58 vars in 1235 bytes} [Tue Dec 14 13:09:11 2021] GET /compute/v2.1/servers/0c5fe6a3-7904-4ee6-9f04-90633ff50db2 => generated 1518 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 14 13:09:13.165394 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.api.openstack.wsgi [None req-d628aa71-399f-498b-8eed-df24cbd937fd tempest-TestShelveInstance-1515730970 tempest-TestShelveInstance-1515730970-project] Calling method '>' {{(pid=116063) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 13:09:13.166263 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.compute.api [None req-d628aa71-399f-498b-8eed-df24cbd937fd tempest-TestShelveInstance-1515730970 tempest-TestShelveInstance-1515730970-project] [instance: 0c5fe6a3-7904-4ee6-9f04-90633ff50db2] Fetching instance by UUID {{(pid=116063) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 13:09:13.174134 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-d628aa71-399f-498b-8eed-df24cbd937fd tempest-TestShelveInstance-1515730970 tempest-TestShelveInstance-1515730970-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 13:09:13.174579 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-d628aa71-399f-498b-8eed-df24cbd937fd tempest-TestShelveInstance-1515730970 tempest-TestShelveInstance-1515730970-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 13:09:13.175350 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-d628aa71-399f-498b-8eed-df24cbd937fd tempest-TestShelveInstance-1515730970 tempest-TestShelveInstance-1515730970-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 13:09:13.175781 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-d628aa71-399f-498b-8eed-df24cbd937fd tempest-TestShelveInstance-1515730970 tempest-TestShelveInstance-1515730970-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 13:09:13.317202 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.policy [None req-d628aa71-399f-498b-8eed-df24cbd937fd tempest-TestShelveInstance-1515730970 tempest-TestShelveInstance-1515730970-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '818488ec88264dcdb3a7bac93352b56b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe2a769f6b7645cbb7ec24ba01e13a4a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116063) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 13:09:13.324662 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: INFO nova.api.openstack.requestlog [None req-d628aa71-399f-498b-8eed-df24cbd937fd tempest-TestShelveInstance-1515730970 tempest-TestShelveInstance-1515730970-project] 10.222.0.49 "GET /compute/v2.1/servers/0c5fe6a3-7904-4ee6-9f04-90633ff50db2" status: 200 len: 1518 microversion: 2.1 time: 0.165880 Dec 14 13:09:13.325235 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: [pid: 116063|app: 0|req: 562/1104] 10.222.0.49 () {58 vars in 1235 bytes} [Tue Dec 14 13:09:13 2021] GET /compute/v2.1/servers/0c5fe6a3-7904-4ee6-9f04-90633ff50db2 => generated 1518 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 14 13:09:14.344365 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.api.openstack.wsgi [None req-9e2e7fa9-cef2-4a57-9e99-a463095f389b tempest-TestShelveInstance-1515730970 tempest-TestShelveInstance-1515730970-project] Calling method '>' {{(pid=116064) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 13:09:14.345301 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.compute.api [None req-9e2e7fa9-cef2-4a57-9e99-a463095f389b tempest-TestShelveInstance-1515730970 tempest-TestShelveInstance-1515730970-project] [instance: 0c5fe6a3-7904-4ee6-9f04-90633ff50db2] Fetching instance by UUID {{(pid=116064) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 13:09:14.354720 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-9e2e7fa9-cef2-4a57-9e99-a463095f389b tempest-TestShelveInstance-1515730970 tempest-TestShelveInstance-1515730970-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 13:09:14.355405 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-9e2e7fa9-cef2-4a57-9e99-a463095f389b tempest-TestShelveInstance-1515730970 tempest-TestShelveInstance-1515730970-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 13:09:14.356625 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-9e2e7fa9-cef2-4a57-9e99-a463095f389b tempest-TestShelveInstance-1515730970 tempest-TestShelveInstance-1515730970-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 13:09:14.357340 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-9e2e7fa9-cef2-4a57-9e99-a463095f389b tempest-TestShelveInstance-1515730970 tempest-TestShelveInstance-1515730970-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 13:09:14.503249 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.policy [None req-9e2e7fa9-cef2-4a57-9e99-a463095f389b tempest-TestShelveInstance-1515730970 tempest-TestShelveInstance-1515730970-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '818488ec88264dcdb3a7bac93352b56b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe2a769f6b7645cbb7ec24ba01e13a4a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116064) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 13:09:14.510886 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: INFO nova.api.openstack.requestlog [None req-9e2e7fa9-cef2-4a57-9e99-a463095f389b tempest-TestShelveInstance-1515730970 tempest-TestShelveInstance-1515730970-project] 10.222.0.49 "GET /compute/v2.1/servers/0c5fe6a3-7904-4ee6-9f04-90633ff50db2" status: 200 len: 1520 microversion: 2.1 time: 0.172282 Dec 14 13:09:14.511468 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: [pid: 116064|app: 0|req: 543/1105] 10.222.0.49 () {58 vars in 1235 bytes} [Tue Dec 14 13:09:14 2021] GET /compute/v2.1/servers/0c5fe6a3-7904-4ee6-9f04-90633ff50db2 => generated 1520 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 14 13:09:15.528337 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.api.openstack.wsgi [None req-97bf81e6-24d2-4a3a-931e-a1bc3249456b tempest-TestShelveInstance-1515730970 tempest-TestShelveInstance-1515730970-project] Calling method '>' {{(pid=116063) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 13:09:15.529071 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.compute.api [None req-97bf81e6-24d2-4a3a-931e-a1bc3249456b tempest-TestShelveInstance-1515730970 tempest-TestShelveInstance-1515730970-project] [instance: 0c5fe6a3-7904-4ee6-9f04-90633ff50db2] Fetching instance by UUID {{(pid=116063) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 13:09:15.535955 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-97bf81e6-24d2-4a3a-931e-a1bc3249456b tempest-TestShelveInstance-1515730970 tempest-TestShelveInstance-1515730970-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 13:09:15.536401 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-97bf81e6-24d2-4a3a-931e-a1bc3249456b tempest-TestShelveInstance-1515730970 tempest-TestShelveInstance-1515730970-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 13:09:15.537217 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-97bf81e6-24d2-4a3a-931e-a1bc3249456b tempest-TestShelveInstance-1515730970 tempest-TestShelveInstance-1515730970-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 13:09:15.537656 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-97bf81e6-24d2-4a3a-931e-a1bc3249456b tempest-TestShelveInstance-1515730970 tempest-TestShelveInstance-1515730970-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 13:09:15.672217 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.policy [None req-97bf81e6-24d2-4a3a-931e-a1bc3249456b tempest-TestShelveInstance-1515730970 tempest-TestShelveInstance-1515730970-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '818488ec88264dcdb3a7bac93352b56b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe2a769f6b7645cbb7ec24ba01e13a4a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116063) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 13:09:15.679566 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: INFO nova.api.openstack.requestlog [None req-97bf81e6-24d2-4a3a-931e-a1bc3249456b tempest-TestShelveInstance-1515730970 tempest-TestShelveInstance-1515730970-project] 10.222.0.49 "GET /compute/v2.1/servers/0c5fe6a3-7904-4ee6-9f04-90633ff50db2" status: 200 len: 1576 microversion: 2.1 time: 0.154954 Dec 14 13:09:15.680095 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: [pid: 116063|app: 0|req: 563/1106] 10.222.0.49 () {58 vars in 1235 bytes} [Tue Dec 14 13:09:15 2021] GET /compute/v2.1/servers/0c5fe6a3-7904-4ee6-9f04-90633ff50db2 => generated 1576 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 14 13:09:16.701327 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.api.openstack.wsgi [None req-57c7c854-e84a-499d-baa0-d4d30e895724 tempest-TestShelveInstance-1515730970 tempest-TestShelveInstance-1515730970-project] Calling method '>' {{(pid=116064) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 13:09:16.701942 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.compute.api [None req-57c7c854-e84a-499d-baa0-d4d30e895724 tempest-TestShelveInstance-1515730970 tempest-TestShelveInstance-1515730970-project] [instance: 0c5fe6a3-7904-4ee6-9f04-90633ff50db2] Fetching instance by UUID {{(pid=116064) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 13:09:16.708550 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-57c7c854-e84a-499d-baa0-d4d30e895724 tempest-TestShelveInstance-1515730970 tempest-TestShelveInstance-1515730970-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 13:09:16.709016 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-57c7c854-e84a-499d-baa0-d4d30e895724 tempest-TestShelveInstance-1515730970 tempest-TestShelveInstance-1515730970-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 13:09:16.709823 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-57c7c854-e84a-499d-baa0-d4d30e895724 tempest-TestShelveInstance-1515730970 tempest-TestShelveInstance-1515730970-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 13:09:16.710253 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-57c7c854-e84a-499d-baa0-d4d30e895724 tempest-TestShelveInstance-1515730970 tempest-TestShelveInstance-1515730970-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 13:09:16.842852 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.policy [None req-57c7c854-e84a-499d-baa0-d4d30e895724 tempest-TestShelveInstance-1515730970 tempest-TestShelveInstance-1515730970-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '818488ec88264dcdb3a7bac93352b56b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe2a769f6b7645cbb7ec24ba01e13a4a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116064) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 13:09:16.850534 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: INFO nova.api.openstack.requestlog [None req-57c7c854-e84a-499d-baa0-d4d30e895724 tempest-TestShelveInstance-1515730970 tempest-TestShelveInstance-1515730970-project] 10.222.0.49 "GET /compute/v2.1/servers/0c5fe6a3-7904-4ee6-9f04-90633ff50db2" status: 200 len: 1576 microversion: 2.1 time: 0.154965 Dec 14 13:09:16.851104 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: [pid: 116064|app: 0|req: 544/1107] 10.222.0.49 () {58 vars in 1235 bytes} [Tue Dec 14 13:09:16 2021] GET /compute/v2.1/servers/0c5fe6a3-7904-4ee6-9f04-90633ff50db2 => generated 1576 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 14 13:09:17.867656 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.api.openstack.wsgi [None req-62ba596a-4f57-4899-a3f4-69ecd4b83e83 tempest-TestShelveInstance-1515730970 tempest-TestShelveInstance-1515730970-project] Calling method '>' {{(pid=116063) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 13:09:17.868275 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.compute.api [None req-62ba596a-4f57-4899-a3f4-69ecd4b83e83 tempest-TestShelveInstance-1515730970 tempest-TestShelveInstance-1515730970-project] [instance: 0c5fe6a3-7904-4ee6-9f04-90633ff50db2] Fetching instance by UUID {{(pid=116063) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 13:09:17.875027 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-62ba596a-4f57-4899-a3f4-69ecd4b83e83 tempest-TestShelveInstance-1515730970 tempest-TestShelveInstance-1515730970-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 13:09:17.875474 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-62ba596a-4f57-4899-a3f4-69ecd4b83e83 tempest-TestShelveInstance-1515730970 tempest-TestShelveInstance-1515730970-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 13:09:17.876249 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-62ba596a-4f57-4899-a3f4-69ecd4b83e83 tempest-TestShelveInstance-1515730970 tempest-TestShelveInstance-1515730970-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 13:09:17.876677 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-62ba596a-4f57-4899-a3f4-69ecd4b83e83 tempest-TestShelveInstance-1515730970 tempest-TestShelveInstance-1515730970-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 13:09:18.021566 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.policy [None req-62ba596a-4f57-4899-a3f4-69ecd4b83e83 tempest-TestShelveInstance-1515730970 tempest-TestShelveInstance-1515730970-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '818488ec88264dcdb3a7bac93352b56b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe2a769f6b7645cbb7ec24ba01e13a4a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116063) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 13:09:18.029412 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: INFO nova.api.openstack.requestlog [None req-62ba596a-4f57-4899-a3f4-69ecd4b83e83 tempest-TestShelveInstance-1515730970 tempest-TestShelveInstance-1515730970-project] 10.222.0.49 "GET /compute/v2.1/servers/0c5fe6a3-7904-4ee6-9f04-90633ff50db2" status: 200 len: 1576 microversion: 2.1 time: 0.165507 Dec 14 13:09:18.029982 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: [pid: 116063|app: 0|req: 564/1108] 10.222.0.49 () {58 vars in 1235 bytes} [Tue Dec 14 13:09:17 2021] GET /compute/v2.1/servers/0c5fe6a3-7904-4ee6-9f04-90633ff50db2 => generated 1576 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 14 13:09:19.050949 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.api.openstack.wsgi [None req-08fa12bf-c728-4062-9959-ef29c39e4081 tempest-TestShelveInstance-1515730970 tempest-TestShelveInstance-1515730970-project] Calling method '>' {{(pid=116064) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 13:09:19.052062 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.compute.api [None req-08fa12bf-c728-4062-9959-ef29c39e4081 tempest-TestShelveInstance-1515730970 tempest-TestShelveInstance-1515730970-project] [instance: 0c5fe6a3-7904-4ee6-9f04-90633ff50db2] Fetching instance by UUID {{(pid=116064) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 13:09:19.063036 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-08fa12bf-c728-4062-9959-ef29c39e4081 tempest-TestShelveInstance-1515730970 tempest-TestShelveInstance-1515730970-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 13:09:19.063780 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-08fa12bf-c728-4062-9959-ef29c39e4081 tempest-TestShelveInstance-1515730970 tempest-TestShelveInstance-1515730970-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 13:09:19.065127 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-08fa12bf-c728-4062-9959-ef29c39e4081 tempest-TestShelveInstance-1515730970 tempest-TestShelveInstance-1515730970-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 13:09:19.065853 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-08fa12bf-c728-4062-9959-ef29c39e4081 tempest-TestShelveInstance-1515730970 tempest-TestShelveInstance-1515730970-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 13:09:19.204468 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.policy [None req-08fa12bf-c728-4062-9959-ef29c39e4081 tempest-TestShelveInstance-1515730970 tempest-TestShelveInstance-1515730970-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '818488ec88264dcdb3a7bac93352b56b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe2a769f6b7645cbb7ec24ba01e13a4a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116064) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 13:09:19.211852 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: INFO nova.api.openstack.requestlog [None req-08fa12bf-c728-4062-9959-ef29c39e4081 tempest-TestShelveInstance-1515730970 tempest-TestShelveInstance-1515730970-project] 10.222.0.49 "GET /compute/v2.1/servers/0c5fe6a3-7904-4ee6-9f04-90633ff50db2" status: 200 len: 1576 microversion: 2.1 time: 0.167117 Dec 14 13:09:19.212419 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: [pid: 116064|app: 0|req: 545/1109] 10.222.0.49 () {58 vars in 1235 bytes} [Tue Dec 14 13:09:19 2021] GET /compute/v2.1/servers/0c5fe6a3-7904-4ee6-9f04-90633ff50db2 => generated 1576 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 14 13:09:20.232719 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.api.openstack.wsgi [None req-fcf032c3-a47f-420b-bed4-6734ecd1164a tempest-TestShelveInstance-1515730970 tempest-TestShelveInstance-1515730970-project] Calling method '>' {{(pid=116063) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 13:09:20.233575 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.compute.api [None req-fcf032c3-a47f-420b-bed4-6734ecd1164a tempest-TestShelveInstance-1515730970 tempest-TestShelveInstance-1515730970-project] [instance: 0c5fe6a3-7904-4ee6-9f04-90633ff50db2] Fetching instance by UUID {{(pid=116063) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 13:09:20.244184 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-fcf032c3-a47f-420b-bed4-6734ecd1164a tempest-TestShelveInstance-1515730970 tempest-TestShelveInstance-1515730970-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 13:09:20.244927 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-fcf032c3-a47f-420b-bed4-6734ecd1164a tempest-TestShelveInstance-1515730970 tempest-TestShelveInstance-1515730970-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 13:09:20.246236 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-fcf032c3-a47f-420b-bed4-6734ecd1164a tempest-TestShelveInstance-1515730970 tempest-TestShelveInstance-1515730970-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 13:09:20.246952 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-fcf032c3-a47f-420b-bed4-6734ecd1164a tempest-TestShelveInstance-1515730970 tempest-TestShelveInstance-1515730970-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 13:09:20.381694 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.policy [None req-fcf032c3-a47f-420b-bed4-6734ecd1164a tempest-TestShelveInstance-1515730970 tempest-TestShelveInstance-1515730970-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '818488ec88264dcdb3a7bac93352b56b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe2a769f6b7645cbb7ec24ba01e13a4a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116063) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 13:09:20.389649 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: INFO nova.api.openstack.requestlog [None req-fcf032c3-a47f-420b-bed4-6734ecd1164a tempest-TestShelveInstance-1515730970 tempest-TestShelveInstance-1515730970-project] 10.222.0.49 "GET /compute/v2.1/servers/0c5fe6a3-7904-4ee6-9f04-90633ff50db2" status: 200 len: 1576 microversion: 2.1 time: 0.163166 Dec 14 13:09:20.390217 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: [pid: 116063|app: 0|req: 565/1110] 10.222.0.49 () {58 vars in 1235 bytes} [Tue Dec 14 13:09:20 2021] GET /compute/v2.1/servers/0c5fe6a3-7904-4ee6-9f04-90633ff50db2 => generated 1576 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 14 13:09:21.410757 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.api.openstack.wsgi [None req-b6666b5f-9b93-4891-9efe-f9feb491d1fd tempest-TestShelveInstance-1515730970 tempest-TestShelveInstance-1515730970-project] Calling method '>' {{(pid=116064) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 13:09:21.412038 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.compute.api [None req-b6666b5f-9b93-4891-9efe-f9feb491d1fd tempest-TestShelveInstance-1515730970 tempest-TestShelveInstance-1515730970-project] [instance: 0c5fe6a3-7904-4ee6-9f04-90633ff50db2] Fetching instance by UUID {{(pid=116064) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 13:09:21.421438 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-b6666b5f-9b93-4891-9efe-f9feb491d1fd tempest-TestShelveInstance-1515730970 tempest-TestShelveInstance-1515730970-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 13:09:21.421885 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-b6666b5f-9b93-4891-9efe-f9feb491d1fd tempest-TestShelveInstance-1515730970 tempest-TestShelveInstance-1515730970-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 13:09:21.422660 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-b6666b5f-9b93-4891-9efe-f9feb491d1fd tempest-TestShelveInstance-1515730970 tempest-TestShelveInstance-1515730970-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 13:09:21.423087 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-b6666b5f-9b93-4891-9efe-f9feb491d1fd tempest-TestShelveInstance-1515730970 tempest-TestShelveInstance-1515730970-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 13:09:21.560716 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.policy [None req-b6666b5f-9b93-4891-9efe-f9feb491d1fd tempest-TestShelveInstance-1515730970 tempest-TestShelveInstance-1515730970-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '818488ec88264dcdb3a7bac93352b56b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe2a769f6b7645cbb7ec24ba01e13a4a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116064) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 13:09:21.568569 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: INFO nova.api.openstack.requestlog [None req-b6666b5f-9b93-4891-9efe-f9feb491d1fd tempest-TestShelveInstance-1515730970 tempest-TestShelveInstance-1515730970-project] 10.222.0.49 "GET /compute/v2.1/servers/0c5fe6a3-7904-4ee6-9f04-90633ff50db2" status: 200 len: 1576 microversion: 2.1 time: 0.164315 Dec 14 13:09:21.569165 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: [pid: 116064|app: 0|req: 546/1111] 10.222.0.49 () {58 vars in 1235 bytes} [Tue Dec 14 13:09:21 2021] GET /compute/v2.1/servers/0c5fe6a3-7904-4ee6-9f04-90633ff50db2 => generated 1576 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 14 13:09:22.586134 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.api.openstack.wsgi [None req-e9fa71eb-f550-41bb-ba66-8e4992c56be9 tempest-TestShelveInstance-1515730970 tempest-TestShelveInstance-1515730970-project] Calling method '>' {{(pid=116063) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 13:09:22.586794 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.compute.api [None req-e9fa71eb-f550-41bb-ba66-8e4992c56be9 tempest-TestShelveInstance-1515730970 tempest-TestShelveInstance-1515730970-project] [instance: 0c5fe6a3-7904-4ee6-9f04-90633ff50db2] Fetching instance by UUID {{(pid=116063) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 13:09:22.593534 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-e9fa71eb-f550-41bb-ba66-8e4992c56be9 tempest-TestShelveInstance-1515730970 tempest-TestShelveInstance-1515730970-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 13:09:22.593980 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-e9fa71eb-f550-41bb-ba66-8e4992c56be9 tempest-TestShelveInstance-1515730970 tempest-TestShelveInstance-1515730970-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 13:09:22.594758 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-e9fa71eb-f550-41bb-ba66-8e4992c56be9 tempest-TestShelveInstance-1515730970 tempest-TestShelveInstance-1515730970-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 13:09:22.595187 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-e9fa71eb-f550-41bb-ba66-8e4992c56be9 tempest-TestShelveInstance-1515730970 tempest-TestShelveInstance-1515730970-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 13:09:22.731870 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.policy [None req-e9fa71eb-f550-41bb-ba66-8e4992c56be9 tempest-TestShelveInstance-1515730970 tempest-TestShelveInstance-1515730970-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '818488ec88264dcdb3a7bac93352b56b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe2a769f6b7645cbb7ec24ba01e13a4a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116063) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 13:09:22.739348 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: INFO nova.api.openstack.requestlog [None req-e9fa71eb-f550-41bb-ba66-8e4992c56be9 tempest-TestShelveInstance-1515730970 tempest-TestShelveInstance-1515730970-project] 10.222.0.49 "GET /compute/v2.1/servers/0c5fe6a3-7904-4ee6-9f04-90633ff50db2" status: 200 len: 1576 microversion: 2.1 time: 0.157062 Dec 14 13:09:22.739927 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: [pid: 116063|app: 0|req: 566/1112] 10.222.0.49 () {58 vars in 1235 bytes} [Tue Dec 14 13:09:22 2021] GET /compute/v2.1/servers/0c5fe6a3-7904-4ee6-9f04-90633ff50db2 => generated 1576 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 14 13:09:23.760412 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.api.openstack.wsgi [None req-80ee8b3c-5e67-4c30-95ee-c05fe71bfce8 tempest-TestShelveInstance-1515730970 tempest-TestShelveInstance-1515730970-project] Calling method '>' {{(pid=116064) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 13:09:23.761397 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.compute.api [None req-80ee8b3c-5e67-4c30-95ee-c05fe71bfce8 tempest-TestShelveInstance-1515730970 tempest-TestShelveInstance-1515730970-project] [instance: 0c5fe6a3-7904-4ee6-9f04-90633ff50db2] Fetching instance by UUID {{(pid=116064) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 13:09:23.768941 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-80ee8b3c-5e67-4c30-95ee-c05fe71bfce8 tempest-TestShelveInstance-1515730970 tempest-TestShelveInstance-1515730970-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 13:09:23.769424 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-80ee8b3c-5e67-4c30-95ee-c05fe71bfce8 tempest-TestShelveInstance-1515730970 tempest-TestShelveInstance-1515730970-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 13:09:23.770244 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-80ee8b3c-5e67-4c30-95ee-c05fe71bfce8 tempest-TestShelveInstance-1515730970 tempest-TestShelveInstance-1515730970-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 13:09:23.770701 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-80ee8b3c-5e67-4c30-95ee-c05fe71bfce8 tempest-TestShelveInstance-1515730970 tempest-TestShelveInstance-1515730970-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 13:09:23.908533 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.policy [None req-80ee8b3c-5e67-4c30-95ee-c05fe71bfce8 tempest-TestShelveInstance-1515730970 tempest-TestShelveInstance-1515730970-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '818488ec88264dcdb3a7bac93352b56b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe2a769f6b7645cbb7ec24ba01e13a4a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116064) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 13:09:23.916588 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: INFO nova.api.openstack.requestlog [None req-80ee8b3c-5e67-4c30-95ee-c05fe71bfce8 tempest-TestShelveInstance-1515730970 tempest-TestShelveInstance-1515730970-project] 10.222.0.49 "GET /compute/v2.1/servers/0c5fe6a3-7904-4ee6-9f04-90633ff50db2" status: 200 len: 1576 microversion: 2.1 time: 0.162441 Dec 14 13:09:23.917535 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: [pid: 116064|app: 0|req: 547/1113] 10.222.0.49 () {58 vars in 1235 bytes} [Tue Dec 14 13:09:23 2021] GET /compute/v2.1/servers/0c5fe6a3-7904-4ee6-9f04-90633ff50db2 => generated 1576 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 14 13:09:24.001727 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.api.openstack.wsgi [req-a2c074e3-0b69-47b8-947c-c65184d79e32 req-9f943e0c-b67e-472e-a19a-864a246b265e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0c5fe6a3-7904-4ee6-9f04-90633ff50db2", "name": "network-vif-plugged", "status": "completed", "tag": "6b399ecc-9d61-4402-b72e-7daa479ee08d"}]} {{(pid=116063) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 14 13:09:24.003603 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 14 13:09:24.003603 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: warnings.warn(msg) Dec 14 13:09:24.011402 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [req-a2c074e3-0b69-47b8-947c-c65184d79e32 req-9f943e0c-b67e-472e-a19a-864a246b265e service nova] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 13:09:24.011542 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [req-a2c074e3-0b69-47b8-947c-c65184d79e32 req-9f943e0c-b67e-472e-a19a-864a246b265e service nova] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 13:09:24.022775 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: INFO nova.api.openstack.compute.server_external_events [req-a2c074e3-0b69-47b8-947c-c65184d79e32 req-9f943e0c-b67e-472e-a19a-864a246b265e service nova] Creating event network-vif-plugged:6b399ecc-9d61-4402-b72e-7daa479ee08d for instance 0c5fe6a3-7904-4ee6-9f04-90633ff50db2 on hv-cinder-78447 Dec 14 13:09:24.027919 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: INFO nova.api.openstack.requestlog [req-a2c074e3-0b69-47b8-947c-c65184d79e32 req-9f943e0c-b67e-472e-a19a-864a246b265e service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030817 Dec 14 13:09:24.028582 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: [pid: 116063|app: 0|req: 567/1114] 10.222.0.49 () {64 vars in 1317 bytes} [Tue Dec 14 13:09:23 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 14 13:09:24.938085 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.api.openstack.wsgi [None req-87d7354e-658b-46f2-9b80-cbf985c06a19 tempest-TestShelveInstance-1515730970 tempest-TestShelveInstance-1515730970-project] Calling method '>' {{(pid=116064) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 13:09:24.939067 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.compute.api [None req-87d7354e-658b-46f2-9b80-cbf985c06a19 tempest-TestShelveInstance-1515730970 tempest-TestShelveInstance-1515730970-project] [instance: 0c5fe6a3-7904-4ee6-9f04-90633ff50db2] Fetching instance by UUID {{(pid=116064) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 13:09:24.949817 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-87d7354e-658b-46f2-9b80-cbf985c06a19 tempest-TestShelveInstance-1515730970 tempest-TestShelveInstance-1515730970-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 13:09:24.950567 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-87d7354e-658b-46f2-9b80-cbf985c06a19 tempest-TestShelveInstance-1515730970 tempest-TestShelveInstance-1515730970-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 13:09:24.951298 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-87d7354e-658b-46f2-9b80-cbf985c06a19 tempest-TestShelveInstance-1515730970 tempest-TestShelveInstance-1515730970-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 13:09:24.951737 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-87d7354e-658b-46f2-9b80-cbf985c06a19 tempest-TestShelveInstance-1515730970 tempest-TestShelveInstance-1515730970-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 13:09:25.093310 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.policy [None req-87d7354e-658b-46f2-9b80-cbf985c06a19 tempest-TestShelveInstance-1515730970 tempest-TestShelveInstance-1515730970-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '818488ec88264dcdb3a7bac93352b56b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe2a769f6b7645cbb7ec24ba01e13a4a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116064) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 13:09:25.100752 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: INFO nova.api.openstack.requestlog [None req-87d7354e-658b-46f2-9b80-cbf985c06a19 tempest-TestShelveInstance-1515730970 tempest-TestShelveInstance-1515730970-project] 10.222.0.49 "GET /compute/v2.1/servers/0c5fe6a3-7904-4ee6-9f04-90633ff50db2" status: 200 len: 1576 microversion: 2.1 time: 0.168926 Dec 14 13:09:25.101355 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: [pid: 116064|app: 0|req: 548/1115] 10.222.0.49 () {58 vars in 1235 bytes} [Tue Dec 14 13:09:24 2021] GET /compute/v2.1/servers/0c5fe6a3-7904-4ee6-9f04-90633ff50db2 => generated 1576 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 14 13:09:26.122954 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.api.openstack.wsgi [None req-1666f012-a386-4e62-b840-918fc760f1be tempest-TestShelveInstance-1515730970 tempest-TestShelveInstance-1515730970-project] Calling method '>' {{(pid=116063) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 13:09:26.123697 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.compute.api [None req-1666f012-a386-4e62-b840-918fc760f1be tempest-TestShelveInstance-1515730970 tempest-TestShelveInstance-1515730970-project] [instance: 0c5fe6a3-7904-4ee6-9f04-90633ff50db2] Fetching instance by UUID {{(pid=116063) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 13:09:26.130600 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-1666f012-a386-4e62-b840-918fc760f1be tempest-TestShelveInstance-1515730970 tempest-TestShelveInstance-1515730970-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 13:09:26.131067 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-1666f012-a386-4e62-b840-918fc760f1be tempest-TestShelveInstance-1515730970 tempest-TestShelveInstance-1515730970-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 13:09:26.131879 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-1666f012-a386-4e62-b840-918fc760f1be tempest-TestShelveInstance-1515730970 tempest-TestShelveInstance-1515730970-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 13:09:26.132337 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-1666f012-a386-4e62-b840-918fc760f1be tempest-TestShelveInstance-1515730970 tempest-TestShelveInstance-1515730970-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 13:09:26.278909 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.policy [None req-1666f012-a386-4e62-b840-918fc760f1be tempest-TestShelveInstance-1515730970 tempest-TestShelveInstance-1515730970-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '818488ec88264dcdb3a7bac93352b56b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe2a769f6b7645cbb7ec24ba01e13a4a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116063) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 13:09:26.286767 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: INFO nova.api.openstack.requestlog [None req-1666f012-a386-4e62-b840-918fc760f1be tempest-TestShelveInstance-1515730970 tempest-TestShelveInstance-1515730970-project] 10.222.0.49 "GET /compute/v2.1/servers/0c5fe6a3-7904-4ee6-9f04-90633ff50db2" status: 200 len: 1563 microversion: 2.1 time: 0.170928 Dec 14 13:09:26.287328 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: [pid: 116063|app: 0|req: 568/1116] 10.222.0.49 () {58 vars in 1235 bytes} [Tue Dec 14 13:09:26 2021] GET /compute/v2.1/servers/0c5fe6a3-7904-4ee6-9f04-90633ff50db2 => generated 1563 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 14 13:09:46.985152 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Dec 14 13:09:46.986288 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: Tue Dec 14 13:09:46 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Dec 14 13:10:40.157854 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.api.openstack.wsgi [None req-e58ac698-fca2-4799-9d7c-a58c9d884efd tempest-TestShelveInstance-1515730970 tempest-TestShelveInstance-1515730970-project] Calling method '>' {{(pid=116064) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 13:10:40.158433 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.compute.api [None req-e58ac698-fca2-4799-9d7c-a58c9d884efd tempest-TestShelveInstance-1515730970 tempest-TestShelveInstance-1515730970-project] [instance: 0c5fe6a3-7904-4ee6-9f04-90633ff50db2] Fetching instance by UUID {{(pid=116064) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 13:10:40.161042 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.api.openstack.wsgi [req-79551b6e-0d53-4c4c-a75d-80940183763e req-edb4eeba-86d0-4b99-90a9-2dea53a98328 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0c5fe6a3-7904-4ee6-9f04-90633ff50db2", "tag": "6b399ecc-9d61-4402-b72e-7daa479ee08d"}]} {{(pid=116063) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 14 13:10:40.162634 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 14 13:10:40.162634 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: warnings.warn(msg) Dec 14 13:10:40.164967 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-e58ac698-fca2-4799-9d7c-a58c9d884efd tempest-TestShelveInstance-1515730970 tempest-TestShelveInstance-1515730970-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 13:10:40.165409 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-e58ac698-fca2-4799-9d7c-a58c9d884efd tempest-TestShelveInstance-1515730970 tempest-TestShelveInstance-1515730970-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 13:10:40.166172 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-e58ac698-fca2-4799-9d7c-a58c9d884efd tempest-TestShelveInstance-1515730970 tempest-TestShelveInstance-1515730970-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 13:10:40.166790 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-e58ac698-fca2-4799-9d7c-a58c9d884efd tempest-TestShelveInstance-1515730970 tempest-TestShelveInstance-1515730970-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 13:10:40.170060 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [req-79551b6e-0d53-4c4c-a75d-80940183763e req-edb4eeba-86d0-4b99-90a9-2dea53a98328 service nova] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 13:10:40.170555 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [req-79551b6e-0d53-4c4c-a75d-80940183763e req-edb4eeba-86d0-4b99-90a9-2dea53a98328 service nova] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 13:10:40.181748 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: INFO nova.api.openstack.compute.server_external_events [req-79551b6e-0d53-4c4c-a75d-80940183763e req-edb4eeba-86d0-4b99-90a9-2dea53a98328 service nova] Creating event network-changed:6b399ecc-9d61-4402-b72e-7daa479ee08d for instance 0c5fe6a3-7904-4ee6-9f04-90633ff50db2 on hv-cinder-78447 Dec 14 13:10:40.187269 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: INFO nova.api.openstack.requestlog [req-79551b6e-0d53-4c4c-a75d-80940183763e req-edb4eeba-86d0-4b99-90a9-2dea53a98328 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031408 Dec 14 13:10:40.188195 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: [pid: 116063|app: 0|req: 569/1117] 10.222.0.49 () {64 vars in 1317 bytes} [Tue Dec 14 13:10:40 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 14 13:10:40.192134 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.compute.api [None req-e58ac698-fca2-4799-9d7c-a58c9d884efd tempest-TestShelveInstance-1515730970 tempest-TestShelveInstance-1515730970-project] [instance: 0c5fe6a3-7904-4ee6-9f04-90633ff50db2] Going to try to terminate instance {{(pid=116064) delete /opt/stack/nova/nova/compute/api.py:2614}} Dec 14 13:10:40.273278 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: INFO nova.api.openstack.requestlog [None req-e58ac698-fca2-4799-9d7c-a58c9d884efd tempest-TestShelveInstance-1515730970 tempest-TestShelveInstance-1515730970-project] 10.222.0.49 "DELETE /compute/v2.1/servers/0c5fe6a3-7904-4ee6-9f04-90633ff50db2" status: 204 len: 0 microversion: 2.1 time: 0.119674 Dec 14 13:10:40.274471 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: [pid: 116064|app: 0|req: 549/1118] 10.222.0.49 () {58 vars in 1238 bytes} [Tue Dec 14 13:10:40 2021] DELETE /compute/v2.1/servers/0c5fe6a3-7904-4ee6-9f04-90633ff50db2 => generated 0 bytes in 122 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Dec 14 13:10:40.283640 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.api.openstack.wsgi [None req-11780b7c-d242-4e81-8b11-df52510131ae tempest-TestShelveInstance-1515730970 tempest-TestShelveInstance-1515730970-project] Calling method '>' {{(pid=116063) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 13:10:40.285115 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.compute.api [None req-11780b7c-d242-4e81-8b11-df52510131ae tempest-TestShelveInstance-1515730970 tempest-TestShelveInstance-1515730970-project] [instance: 0c5fe6a3-7904-4ee6-9f04-90633ff50db2] Fetching instance by UUID {{(pid=116063) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 13:10:40.292489 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-11780b7c-d242-4e81-8b11-df52510131ae tempest-TestShelveInstance-1515730970 tempest-TestShelveInstance-1515730970-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 13:10:40.292993 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-11780b7c-d242-4e81-8b11-df52510131ae tempest-TestShelveInstance-1515730970 tempest-TestShelveInstance-1515730970-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 13:10:40.293988 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-11780b7c-d242-4e81-8b11-df52510131ae tempest-TestShelveInstance-1515730970 tempest-TestShelveInstance-1515730970-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 13:10:40.294404 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-11780b7c-d242-4e81-8b11-df52510131ae tempest-TestShelveInstance-1515730970 tempest-TestShelveInstance-1515730970-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 13:10:40.438934 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.policy [None req-11780b7c-d242-4e81-8b11-df52510131ae tempest-TestShelveInstance-1515730970 tempest-TestShelveInstance-1515730970-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '818488ec88264dcdb3a7bac93352b56b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe2a769f6b7645cbb7ec24ba01e13a4a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116063) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 13:10:40.447630 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: INFO nova.api.openstack.requestlog [None req-11780b7c-d242-4e81-8b11-df52510131ae tempest-TestShelveInstance-1515730970 tempest-TestShelveInstance-1515730970-project] 10.222.0.49 "GET /compute/v2.1/servers/0c5fe6a3-7904-4ee6-9f04-90633ff50db2" status: 200 len: 1569 microversion: 2.1 time: 0.168599 Dec 14 13:10:40.448703 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: [pid: 116063|app: 0|req: 570/1119] 10.222.0.49 () {58 vars in 1235 bytes} [Tue Dec 14 13:10:40 2021] GET /compute/v2.1/servers/0c5fe6a3-7904-4ee6-9f04-90633ff50db2 => generated 1569 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 14 13:10:41.466820 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.api.openstack.wsgi [None req-a77a444d-0c97-4769-ad34-fca3d4674991 tempest-TestShelveInstance-1515730970 tempest-TestShelveInstance-1515730970-project] Calling method '>' {{(pid=116064) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 13:10:41.467512 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.compute.api [None req-a77a444d-0c97-4769-ad34-fca3d4674991 tempest-TestShelveInstance-1515730970 tempest-TestShelveInstance-1515730970-project] [instance: 0c5fe6a3-7904-4ee6-9f04-90633ff50db2] Fetching instance by UUID {{(pid=116064) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 13:10:41.474389 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-a77a444d-0c97-4769-ad34-fca3d4674991 tempest-TestShelveInstance-1515730970 tempest-TestShelveInstance-1515730970-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 13:10:41.474838 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-a77a444d-0c97-4769-ad34-fca3d4674991 tempest-TestShelveInstance-1515730970 tempest-TestShelveInstance-1515730970-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 13:10:41.475621 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-a77a444d-0c97-4769-ad34-fca3d4674991 tempest-TestShelveInstance-1515730970 tempest-TestShelveInstance-1515730970-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 13:10:41.476055 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-a77a444d-0c97-4769-ad34-fca3d4674991 tempest-TestShelveInstance-1515730970 tempest-TestShelveInstance-1515730970-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 13:10:41.618319 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.policy [None req-a77a444d-0c97-4769-ad34-fca3d4674991 tempest-TestShelveInstance-1515730970 tempest-TestShelveInstance-1515730970-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '818488ec88264dcdb3a7bac93352b56b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe2a769f6b7645cbb7ec24ba01e13a4a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116064) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 13:10:41.626416 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: INFO nova.api.openstack.requestlog [None req-a77a444d-0c97-4769-ad34-fca3d4674991 tempest-TestShelveInstance-1515730970 tempest-TestShelveInstance-1515730970-project] 10.222.0.49 "GET /compute/v2.1/servers/0c5fe6a3-7904-4ee6-9f04-90633ff50db2" status: 200 len: 1450 microversion: 2.1 time: 0.163939 Dec 14 13:10:41.626988 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: [pid: 116064|app: 0|req: 550/1120] 10.222.0.49 () {58 vars in 1235 bytes} [Tue Dec 14 13:10:41 2021] GET /compute/v2.1/servers/0c5fe6a3-7904-4ee6-9f04-90633ff50db2 => generated 1450 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 14 13:10:42.390489 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.api.openstack.wsgi [req-4994c116-093d-4d94-bcec-0a7dbd81ec1d req-bfb65176-574a-4856-a965-4beb373d61e5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0c5fe6a3-7904-4ee6-9f04-90633ff50db2", "name": "network-vif-deleted", "tag": "6b399ecc-9d61-4402-b72e-7daa479ee08d"}]} {{(pid=116063) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 14 13:10:42.391986 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 14 13:10:42.391986 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: warnings.warn(msg) Dec 14 13:10:42.399003 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [req-4994c116-093d-4d94-bcec-0a7dbd81ec1d req-bfb65176-574a-4856-a965-4beb373d61e5 service nova] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 13:10:42.399450 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [req-4994c116-093d-4d94-bcec-0a7dbd81ec1d req-bfb65176-574a-4856-a965-4beb373d61e5 service nova] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 13:10:42.410822 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: INFO nova.api.openstack.compute.server_external_events [req-4994c116-093d-4d94-bcec-0a7dbd81ec1d req-bfb65176-574a-4856-a965-4beb373d61e5 service nova] Creating event network-vif-deleted:6b399ecc-9d61-4402-b72e-7daa479ee08d for instance 0c5fe6a3-7904-4ee6-9f04-90633ff50db2 on hv-cinder-78447 Dec 14 13:10:42.415586 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: INFO nova.api.openstack.requestlog [req-4994c116-093d-4d94-bcec-0a7dbd81ec1d req-bfb65176-574a-4856-a965-4beb373d61e5 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.082869 Dec 14 13:10:42.416211 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: [pid: 116063|app: 0|req: 571/1121] 10.222.0.49 () {64 vars in 1317 bytes} [Tue Dec 14 13:10:42 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 14 13:10:42.643546 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.api.openstack.wsgi [None req-e96d2f33-ad30-485e-9c85-17b463fc755b tempest-TestShelveInstance-1515730970 tempest-TestShelveInstance-1515730970-project] Calling method '>' {{(pid=116064) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 13:10:42.644770 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.compute.api [None req-e96d2f33-ad30-485e-9c85-17b463fc755b tempest-TestShelveInstance-1515730970 tempest-TestShelveInstance-1515730970-project] [instance: 0c5fe6a3-7904-4ee6-9f04-90633ff50db2] Fetching instance by UUID {{(pid=116064) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 13:10:42.651497 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-e96d2f33-ad30-485e-9c85-17b463fc755b tempest-TestShelveInstance-1515730970 tempest-TestShelveInstance-1515730970-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 13:10:42.652312 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-e96d2f33-ad30-485e-9c85-17b463fc755b tempest-TestShelveInstance-1515730970 tempest-TestShelveInstance-1515730970-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 13:10:42.653149 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-e96d2f33-ad30-485e-9c85-17b463fc755b tempest-TestShelveInstance-1515730970 tempest-TestShelveInstance-1515730970-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 13:10:42.653594 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-e96d2f33-ad30-485e-9c85-17b463fc755b tempest-TestShelveInstance-1515730970 tempest-TestShelveInstance-1515730970-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 13:10:42.681986 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.api.openstack.wsgi [None req-5ad9ca31-3c1d-4ad1-bff0-53f68b09bab6 tempest-TestVolumeBootPattern-232608497 tempest-TestVolumeBootPattern-232608497-project] Calling method '>' {{(pid=116063) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 13:10:42.683026 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.compute.api [None req-5ad9ca31-3c1d-4ad1-bff0-53f68b09bab6 tempest-TestVolumeBootPattern-232608497 tempest-TestVolumeBootPattern-232608497-project] [instance: 0ae818b3-6456-4c1f-8ad2-0509dce1e575] Fetching instance by UUID {{(pid=116063) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 13:10:42.693582 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-5ad9ca31-3c1d-4ad1-bff0-53f68b09bab6 tempest-TestVolumeBootPattern-232608497 tempest-TestVolumeBootPattern-232608497-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 13:10:42.694547 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-5ad9ca31-3c1d-4ad1-bff0-53f68b09bab6 tempest-TestVolumeBootPattern-232608497 tempest-TestVolumeBootPattern-232608497-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 13:10:42.695803 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-5ad9ca31-3c1d-4ad1-bff0-53f68b09bab6 tempest-TestVolumeBootPattern-232608497 tempest-TestVolumeBootPattern-232608497-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 13:10:42.697018 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-5ad9ca31-3c1d-4ad1-bff0-53f68b09bab6 tempest-TestVolumeBootPattern-232608497 tempest-TestVolumeBootPattern-232608497-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 13:10:42.725342 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.compute.api [None req-5ad9ca31-3c1d-4ad1-bff0-53f68b09bab6 tempest-TestVolumeBootPattern-232608497 tempest-TestVolumeBootPattern-232608497-project] [instance: 0ae818b3-6456-4c1f-8ad2-0509dce1e575] Going to try to terminate instance {{(pid=116063) delete /opt/stack/nova/nova/compute/api.py:2614}} Dec 14 13:10:42.731023 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.policy [None req-e96d2f33-ad30-485e-9c85-17b463fc755b tempest-TestShelveInstance-1515730970 tempest-TestShelveInstance-1515730970-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '818488ec88264dcdb3a7bac93352b56b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe2a769f6b7645cbb7ec24ba01e13a4a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116064) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 13:10:42.738723 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: INFO nova.api.openstack.requestlog [None req-e96d2f33-ad30-485e-9c85-17b463fc755b tempest-TestShelveInstance-1515730970 tempest-TestShelveInstance-1515730970-project] 10.222.0.49 "GET /compute/v2.1/servers/0c5fe6a3-7904-4ee6-9f04-90633ff50db2" status: 200 len: 1219 microversion: 2.1 time: 0.098982 Dec 14 13:10:42.739309 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: [pid: 116064|app: 0|req: 551/1122] 10.222.0.49 () {58 vars in 1235 bytes} [Tue Dec 14 13:10:42 2021] GET /compute/v2.1/servers/0c5fe6a3-7904-4ee6-9f04-90633ff50db2 => generated 1219 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 14 13:10:42.810662 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: INFO nova.api.openstack.requestlog [None req-5ad9ca31-3c1d-4ad1-bff0-53f68b09bab6 tempest-TestVolumeBootPattern-232608497 tempest-TestVolumeBootPattern-232608497-project] 10.222.0.49 "DELETE /compute/v2.1/servers/0ae818b3-6456-4c1f-8ad2-0509dce1e575" status: 204 len: 0 microversion: 2.1 time: 0.133599 Dec 14 13:10:42.811595 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: [pid: 116063|app: 0|req: 572/1123] 10.222.0.49 () {58 vars in 1238 bytes} [Tue Dec 14 13:10:42 2021] DELETE /compute/v2.1/servers/0ae818b3-6456-4c1f-8ad2-0509dce1e575 => generated 0 bytes in 136 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Dec 14 13:10:42.821391 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.api.openstack.wsgi [None req-e33afd00-4faf-4f6b-8856-5f78fa92eb9e tempest-TestVolumeBootPattern-232608497 tempest-TestVolumeBootPattern-232608497-project] Calling method '>' {{(pid=116064) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 13:10:42.822019 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.compute.api [None req-e33afd00-4faf-4f6b-8856-5f78fa92eb9e tempest-TestVolumeBootPattern-232608497 tempest-TestVolumeBootPattern-232608497-project] [instance: 0ae818b3-6456-4c1f-8ad2-0509dce1e575] Fetching instance by UUID {{(pid=116064) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 13:10:42.828736 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-e33afd00-4faf-4f6b-8856-5f78fa92eb9e tempest-TestVolumeBootPattern-232608497 tempest-TestVolumeBootPattern-232608497-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 13:10:42.829255 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-e33afd00-4faf-4f6b-8856-5f78fa92eb9e tempest-TestVolumeBootPattern-232608497 tempest-TestVolumeBootPattern-232608497-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 13:10:42.830182 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-e33afd00-4faf-4f6b-8856-5f78fa92eb9e tempest-TestVolumeBootPattern-232608497 tempest-TestVolumeBootPattern-232608497-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 13:10:42.830851 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-e33afd00-4faf-4f6b-8856-5f78fa92eb9e tempest-TestVolumeBootPattern-232608497 tempest-TestVolumeBootPattern-232608497-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 13:10:42.965930 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.policy [None req-e33afd00-4faf-4f6b-8856-5f78fa92eb9e tempest-TestVolumeBootPattern-232608497 tempest-TestVolumeBootPattern-232608497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94008a0d97204aff87f20bdeadbdd783', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b854de8019ad4a598587133ba362564b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116064) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 13:10:42.973712 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: INFO nova.api.openstack.requestlog [None req-e33afd00-4faf-4f6b-8856-5f78fa92eb9e tempest-TestVolumeBootPattern-232608497 tempest-TestVolumeBootPattern-232608497-project] 10.222.0.49 "GET /compute/v2.1/servers/0ae818b3-6456-4c1f-8ad2-0509dce1e575" status: 200 len: 1577 microversion: 2.1 time: 0.157412 Dec 14 13:10:42.974299 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: [pid: 116064|app: 0|req: 552/1124] 10.222.0.49 () {58 vars in 1235 bytes} [Tue Dec 14 13:10:42 2021] GET /compute/v2.1/servers/0ae818b3-6456-4c1f-8ad2-0509dce1e575 => generated 1577 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 14 13:10:43.759178 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.api.openstack.wsgi [None req-63e02cc8-dbae-4af2-809b-621714640e35 tempest-TestShelveInstance-1515730970 tempest-TestShelveInstance-1515730970-project] Calling method '>' {{(pid=116063) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 13:10:43.759899 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.compute.api [None req-63e02cc8-dbae-4af2-809b-621714640e35 tempest-TestShelveInstance-1515730970 tempest-TestShelveInstance-1515730970-project] [instance: 0c5fe6a3-7904-4ee6-9f04-90633ff50db2] Fetching instance by UUID {{(pid=116063) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 13:10:43.766964 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-63e02cc8-dbae-4af2-809b-621714640e35 tempest-TestShelveInstance-1515730970 tempest-TestShelveInstance-1515730970-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 13:10:43.767432 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-63e02cc8-dbae-4af2-809b-621714640e35 tempest-TestShelveInstance-1515730970 tempest-TestShelveInstance-1515730970-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 13:10:43.768231 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-63e02cc8-dbae-4af2-809b-621714640e35 tempest-TestShelveInstance-1515730970 tempest-TestShelveInstance-1515730970-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 13:10:43.768677 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-63e02cc8-dbae-4af2-809b-621714640e35 tempest-TestShelveInstance-1515730970 tempest-TestShelveInstance-1515730970-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 13:10:43.782742 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: INFO nova.api.openstack.wsgi [None req-63e02cc8-dbae-4af2-809b-621714640e35 tempest-TestShelveInstance-1515730970 tempest-TestShelveInstance-1515730970-project] HTTP exception thrown: Instance 0c5fe6a3-7904-4ee6-9f04-90633ff50db2 could not be found. Dec 14 13:10:43.783384 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.api.openstack.wsgi [None req-63e02cc8-dbae-4af2-809b-621714640e35 tempest-TestShelveInstance-1515730970 tempest-TestShelveInstance-1515730970-project] Returning 404 to user: Instance 0c5fe6a3-7904-4ee6-9f04-90633ff50db2 could not be found. {{(pid=116063) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 14 13:10:43.784552 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: INFO nova.api.openstack.requestlog [None req-63e02cc8-dbae-4af2-809b-621714640e35 tempest-TestShelveInstance-1515730970 tempest-TestShelveInstance-1515730970-project] 10.222.0.49 "GET /compute/v2.1/servers/0c5fe6a3-7904-4ee6-9f04-90633ff50db2" status: 404 len: 111 microversion: 2.1 time: 0.030595 Dec 14 13:10:43.785142 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: [pid: 116063|app: 0|req: 573/1125] 10.222.0.49 () {58 vars in 1235 bytes} [Tue Dec 14 13:10:43 2021] GET /compute/v2.1/servers/0c5fe6a3-7904-4ee6-9f04-90633ff50db2 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Dec 14 13:10:43.959445 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.api.openstack.wsgi [None req-c275aee9-4b7a-432e-a6c4-a209983d17e7 tempest-TestShelveInstance-1515730970 tempest-TestShelveInstance-1515730970-project] Calling method '.version_select at 0x7f2ace4161f0>' {{(pid=116064) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 13:10:43.988784 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: INFO nova.api.openstack.requestlog [None req-c275aee9-4b7a-432e-a6c4-a209983d17e7 tempest-TestShelveInstance-1515730970 tempest-TestShelveInstance-1515730970-project] 10.222.0.49 "DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-1808417179" status: 202 len: 0 microversion: 2.1 time: 0.033559 Dec 14 13:10:43.989614 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: [pid: 116064|app: 0|req: 553/1126] 10.222.0.49 () {58 vars in 1253 bytes} [Tue Dec 14 13:10:43 2021] DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-1808417179 => generated 0 bytes in 35 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Dec 14 13:10:43.990894 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.api.openstack.wsgi [None req-5ec1e52f-7e39-49fa-a01c-ddf4c47b08e8 tempest-TestVolumeBootPattern-232608497 tempest-TestVolumeBootPattern-232608497-project] Calling method '>' {{(pid=116063) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 13:10:43.991532 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.compute.api [None req-5ec1e52f-7e39-49fa-a01c-ddf4c47b08e8 tempest-TestVolumeBootPattern-232608497 tempest-TestVolumeBootPattern-232608497-project] [instance: 0ae818b3-6456-4c1f-8ad2-0509dce1e575] Fetching instance by UUID {{(pid=116063) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 13:10:43.999566 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-5ec1e52f-7e39-49fa-a01c-ddf4c47b08e8 tempest-TestVolumeBootPattern-232608497 tempest-TestVolumeBootPattern-232608497-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 13:10:44.000004 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-5ec1e52f-7e39-49fa-a01c-ddf4c47b08e8 tempest-TestVolumeBootPattern-232608497 tempest-TestVolumeBootPattern-232608497-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 13:10:44.000823 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-5ec1e52f-7e39-49fa-a01c-ddf4c47b08e8 tempest-TestVolumeBootPattern-232608497 tempest-TestVolumeBootPattern-232608497-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 13:10:44.001281 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-5ec1e52f-7e39-49fa-a01c-ddf4c47b08e8 tempest-TestVolumeBootPattern-232608497 tempest-TestVolumeBootPattern-232608497-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 13:10:44.259571 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.policy [None req-5ec1e52f-7e39-49fa-a01c-ddf4c47b08e8 tempest-TestVolumeBootPattern-232608497 tempest-TestVolumeBootPattern-232608497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94008a0d97204aff87f20bdeadbdd783', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b854de8019ad4a598587133ba362564b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116063) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 13:10:44.267235 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: INFO nova.api.openstack.requestlog [None req-5ec1e52f-7e39-49fa-a01c-ddf4c47b08e8 tempest-TestVolumeBootPattern-232608497 tempest-TestVolumeBootPattern-232608497-project] 10.222.0.49 "GET /compute/v2.1/servers/0ae818b3-6456-4c1f-8ad2-0509dce1e575" status: 200 len: 1577 microversion: 2.1 time: 0.280123 Dec 14 13:10:44.267808 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: [pid: 116063|app: 0|req: 574/1127] 10.222.0.49 () {58 vars in 1235 bytes} [Tue Dec 14 13:10:43 2021] GET /compute/v2.1/servers/0ae818b3-6456-4c1f-8ad2-0509dce1e575 => generated 1577 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 14 13:10:44.434326 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.api.openstack.wsgi [req-aab0ae8e-0d9d-4231-a05f-d241565cbafa req-83d106a4-08ff-44a6-ba40-df83e6a2c323 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0ae818b3-6456-4c1f-8ad2-0509dce1e575", "name": "network-vif-unplugged", "status": "completed", "tag": "0b8646d5-2a96-4065-b8d7-d8717ba061ca"}]} {{(pid=116064) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 14 13:10:44.436840 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 14 13:10:44.436840 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: warnings.warn(msg) Dec 14 13:10:44.449616 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [req-aab0ae8e-0d9d-4231-a05f-d241565cbafa req-83d106a4-08ff-44a6-ba40-df83e6a2c323 service nova] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 13:10:44.450313 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [req-aab0ae8e-0d9d-4231-a05f-d241565cbafa req-83d106a4-08ff-44a6-ba40-df83e6a2c323 service nova] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 13:10:44.474326 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: INFO nova.api.openstack.compute.server_external_events [req-aab0ae8e-0d9d-4231-a05f-d241565cbafa req-83d106a4-08ff-44a6-ba40-df83e6a2c323 service nova] Creating event network-vif-unplugged:0b8646d5-2a96-4065-b8d7-d8717ba061ca for instance 0ae818b3-6456-4c1f-8ad2-0509dce1e575 on hv-cinder-78447 Dec 14 13:10:44.480693 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: INFO nova.api.openstack.requestlog [req-aab0ae8e-0d9d-4231-a05f-d241565cbafa req-83d106a4-08ff-44a6-ba40-df83e6a2c323 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.049922 Dec 14 13:10:44.481952 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: [pid: 116064|app: 0|req: 554/1128] 10.222.0.49 () {64 vars in 1317 bytes} [Tue Dec 14 13:10:44 2021] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 14 13:10:45.286477 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.api.openstack.wsgi [None req-0951d3d7-38f4-463e-b22d-420e9ef00cf4 tempest-TestVolumeBootPattern-232608497 tempest-TestVolumeBootPattern-232608497-project] Calling method '>' {{(pid=116063) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 13:10:45.288255 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.compute.api [None req-0951d3d7-38f4-463e-b22d-420e9ef00cf4 tempest-TestVolumeBootPattern-232608497 tempest-TestVolumeBootPattern-232608497-project] [instance: 0ae818b3-6456-4c1f-8ad2-0509dce1e575] Fetching instance by UUID {{(pid=116063) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 13:10:45.295614 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-0951d3d7-38f4-463e-b22d-420e9ef00cf4 tempest-TestVolumeBootPattern-232608497 tempest-TestVolumeBootPattern-232608497-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 13:10:45.296346 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-0951d3d7-38f4-463e-b22d-420e9ef00cf4 tempest-TestVolumeBootPattern-232608497 tempest-TestVolumeBootPattern-232608497-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 13:10:45.297733 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-0951d3d7-38f4-463e-b22d-420e9ef00cf4 tempest-TestVolumeBootPattern-232608497 tempest-TestVolumeBootPattern-232608497-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 13:10:45.298579 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-0951d3d7-38f4-463e-b22d-420e9ef00cf4 tempest-TestVolumeBootPattern-232608497 tempest-TestVolumeBootPattern-232608497-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 13:10:45.397847 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.policy [None req-0951d3d7-38f4-463e-b22d-420e9ef00cf4 tempest-TestVolumeBootPattern-232608497 tempest-TestVolumeBootPattern-232608497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94008a0d97204aff87f20bdeadbdd783', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b854de8019ad4a598587133ba362564b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116063) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 13:10:45.405784 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: INFO nova.api.openstack.requestlog [None req-0951d3d7-38f4-463e-b22d-420e9ef00cf4 tempest-TestVolumeBootPattern-232608497 tempest-TestVolumeBootPattern-232608497-project] 10.222.0.49 "GET /compute/v2.1/servers/0ae818b3-6456-4c1f-8ad2-0509dce1e575" status: 200 len: 1509 microversion: 2.1 time: 0.125962 Dec 14 13:10:45.406357 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: [pid: 116063|app: 0|req: 575/1129] 10.222.0.49 () {58 vars in 1235 bytes} [Tue Dec 14 13:10:45 2021] GET /compute/v2.1/servers/0ae818b3-6456-4c1f-8ad2-0509dce1e575 => generated 1509 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 14 13:10:45.429521 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.api.openstack.wsgi [req-2f94e76d-c00c-4b7f-873e-654f30b4ff8a req-67500413-4351-40bf-8f25-11719775aeba service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0ae818b3-6456-4c1f-8ad2-0509dce1e575", "name": "network-vif-deleted", "tag": "0b8646d5-2a96-4065-b8d7-d8717ba061ca"}]} {{(pid=116064) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 14 13:10:45.432180 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 14 13:10:45.432180 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: warnings.warn(msg) Dec 14 13:10:45.443545 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [req-2f94e76d-c00c-4b7f-873e-654f30b4ff8a req-67500413-4351-40bf-8f25-11719775aeba service nova] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 13:10:45.444394 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [req-2f94e76d-c00c-4b7f-873e-654f30b4ff8a req-67500413-4351-40bf-8f25-11719775aeba service nova] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 13:10:45.459045 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: INFO nova.api.openstack.compute.server_external_events [req-2f94e76d-c00c-4b7f-873e-654f30b4ff8a req-67500413-4351-40bf-8f25-11719775aeba service nova] Creating event network-vif-deleted:0b8646d5-2a96-4065-b8d7-d8717ba061ca for instance 0ae818b3-6456-4c1f-8ad2-0509dce1e575 on hv-cinder-78447 Dec 14 13:10:45.468752 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: INFO nova.api.openstack.requestlog [req-2f94e76d-c00c-4b7f-873e-654f30b4ff8a req-67500413-4351-40bf-8f25-11719775aeba service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044631 Dec 14 13:10:45.468931 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: [pid: 116064|app: 0|req: 555/1130] 10.222.0.49 () {64 vars in 1317 bytes} [Tue Dec 14 13:10:45 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 14 13:10:46.423208 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.api.openstack.wsgi [None req-fde292bd-083b-413d-b18c-042951ef7cff tempest-TestVolumeBootPattern-232608497 tempest-TestVolumeBootPattern-232608497-project] Calling method '>' {{(pid=116063) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 13:10:46.424555 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.compute.api [None req-fde292bd-083b-413d-b18c-042951ef7cff tempest-TestVolumeBootPattern-232608497 tempest-TestVolumeBootPattern-232608497-project] [instance: 0ae818b3-6456-4c1f-8ad2-0509dce1e575] Fetching instance by UUID {{(pid=116063) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 13:10:46.431977 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-fde292bd-083b-413d-b18c-042951ef7cff tempest-TestVolumeBootPattern-232608497 tempest-TestVolumeBootPattern-232608497-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 13:10:46.432423 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-fde292bd-083b-413d-b18c-042951ef7cff tempest-TestVolumeBootPattern-232608497 tempest-TestVolumeBootPattern-232608497-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 13:10:46.433397 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-fde292bd-083b-413d-b18c-042951ef7cff tempest-TestVolumeBootPattern-232608497 tempest-TestVolumeBootPattern-232608497-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 13:10:46.433830 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-fde292bd-083b-413d-b18c-042951ef7cff tempest-TestVolumeBootPattern-232608497 tempest-TestVolumeBootPattern-232608497-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 13:10:46.448486 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: INFO nova.api.openstack.wsgi [None req-fde292bd-083b-413d-b18c-042951ef7cff tempest-TestVolumeBootPattern-232608497 tempest-TestVolumeBootPattern-232608497-project] HTTP exception thrown: Instance 0ae818b3-6456-4c1f-8ad2-0509dce1e575 could not be found. Dec 14 13:10:46.449108 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.api.openstack.wsgi [None req-fde292bd-083b-413d-b18c-042951ef7cff tempest-TestVolumeBootPattern-232608497 tempest-TestVolumeBootPattern-232608497-project] Returning 404 to user: Instance 0ae818b3-6456-4c1f-8ad2-0509dce1e575 could not be found. {{(pid=116063) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 14 13:10:46.449944 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: INFO nova.api.openstack.requestlog [None req-fde292bd-083b-413d-b18c-042951ef7cff tempest-TestVolumeBootPattern-232608497 tempest-TestVolumeBootPattern-232608497-project] 10.222.0.49 "GET /compute/v2.1/servers/0ae818b3-6456-4c1f-8ad2-0509dce1e575" status: 404 len: 111 microversion: 2.1 time: 0.030652 Dec 14 13:10:46.459570 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: [pid: 116063|app: 0|req: 576/1131] 10.222.0.49 () {58 vars in 1235 bytes} [Tue Dec 14 13:10:46 2021] GET /compute/v2.1/servers/0ae818b3-6456-4c1f-8ad2-0509dce1e575 => generated 111 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Dec 14 13:10:46.503660 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.api.openstack.wsgi [None req-10c4ffdf-d660-46c8-8720-5d8afcb3ac26 tempest-TestVolumeBootPattern-232608497 tempest-TestVolumeBootPattern-232608497-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-36983082", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-878167248", "security_groups": [{"name": "tempest-secgroup-smoke-1999256453"}], "block_device_mapping_v2": [{"uuid": "86dd4156-36b1-48e5-95d8-21c722b51907", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "7f5ca66d-8559-4e12-9014-f81fba56fd65"}]}} {{(pid=116064) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 14 13:10:46.674511 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.network.neutron [None req-10c4ffdf-d660-46c8-8720-5d8afcb3ac26 tempest-TestVolumeBootPattern-232608497 tempest-TestVolumeBootPattern-232608497-project] validate_networks() for [('7f5ca66d-8559-4e12-9014-f81fba56fd65', None, None, None, None, None)] {{(pid=116064) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Dec 14 13:10:47.216033 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.virt.hardware [None req-10c4ffdf-d660-46c8-8720-5d8afcb3ac26 tempest-TestVolumeBootPattern-232608497 tempest-TestVolumeBootPattern-232608497-project] Flavor limits 0:0:0 {{(pid=116064) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Dec 14 13:10:47.216455 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.virt.hardware [None req-10c4ffdf-d660-46c8-8720-5d8afcb3ac26 tempest-TestVolumeBootPattern-232608497 tempest-TestVolumeBootPattern-232608497-project] Image limits 0:0:0 {{(pid=116064) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Dec 14 13:10:47.216970 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.virt.hardware [None req-10c4ffdf-d660-46c8-8720-5d8afcb3ac26 tempest-TestVolumeBootPattern-232608497 tempest-TestVolumeBootPattern-232608497-project] Flavor pref 0:0:0 {{(pid=116064) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Dec 14 13:10:47.217716 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.virt.hardware [None req-10c4ffdf-d660-46c8-8720-5d8afcb3ac26 tempest-TestVolumeBootPattern-232608497 tempest-TestVolumeBootPattern-232608497-project] Image pref 0:0:0 {{(pid=116064) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Dec 14 13:10:47.218439 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.virt.hardware [None req-10c4ffdf-d660-46c8-8720-5d8afcb3ac26 tempest-TestVolumeBootPattern-232608497 tempest-TestVolumeBootPattern-232608497-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=116064) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Dec 14 13:10:47.226919 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-10c4ffdf-d660-46c8-8720-5d8afcb3ac26 tempest-TestVolumeBootPattern-232608497 tempest-TestVolumeBootPattern-232608497-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 13:10:47.227365 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-10c4ffdf-d660-46c8-8720-5d8afcb3ac26 tempest-TestVolumeBootPattern-232608497 tempest-TestVolumeBootPattern-232608497-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 13:10:47.228193 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-10c4ffdf-d660-46c8-8720-5d8afcb3ac26 tempest-TestVolumeBootPattern-232608497 tempest-TestVolumeBootPattern-232608497-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 13:10:47.228747 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-10c4ffdf-d660-46c8-8720-5d8afcb3ac26 tempest-TestVolumeBootPattern-232608497 tempest-TestVolumeBootPattern-232608497-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 13:10:47.244766 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.quota [None req-10c4ffdf-d660-46c8-8720-5d8afcb3ac26 tempest-TestVolumeBootPattern-232608497 tempest-TestVolumeBootPattern-232608497-project] Getting quotas for project b854de8019ad4a598587133ba362564b. Resources: {'cores', 'instances', 'ram'} {{(pid=116064) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 14 13:10:47.249063 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.quota [None req-10c4ffdf-d660-46c8-8720-5d8afcb3ac26 tempest-TestVolumeBootPattern-232608497 tempest-TestVolumeBootPattern-232608497-project] Getting quotas for user 94008a0d97204aff87f20bdeadbdd783 and project b854de8019ad4a598587133ba362564b. Resources: {'cores', 'instances', 'ram'} {{(pid=116064) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 14 13:10:47.320484 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.compute.api [None req-10c4ffdf-d660-46c8-8720-5d8afcb3ac26 tempest-TestVolumeBootPattern-232608497 tempest-TestVolumeBootPattern-232608497-project] Going to run 1 instances... {{(pid=116064) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Dec 14 13:10:47.322936 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.compute.api [None req-10c4ffdf-d660-46c8-8720-5d8afcb3ac26 tempest-TestVolumeBootPattern-232608497 tempest-TestVolumeBootPattern-232608497-project] [instance: 6ffe001e-4663-4c36-8a16-5cc57d821992] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='86dd4156-36b1-48e5-95d8-21c722b51907',volume_size=None,volume_type=None)] {{(pid=116064) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Dec 14 13:10:47.480768 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: INFO nova.api.openstack.requestlog [None req-10c4ffdf-d660-46c8-8720-5d8afcb3ac26 tempest-TestVolumeBootPattern-232608497 tempest-TestVolumeBootPattern-232608497-project] 10.222.0.49 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.983814 Dec 14 13:10:47.481977 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: [pid: 116064|app: 0|req: 556/1132] 10.222.0.49 () {60 vars in 1146 bytes} [Tue Dec 14 13:10:46 2021] POST /compute/v2.1/servers => generated 406 bytes in 986 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Dec 14 13:10:47.491964 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.api.openstack.wsgi [None req-37c8f1ed-d27c-4ac6-85c8-1c15bdedfc0d tempest-TestVolumeBootPattern-232608497 tempest-TestVolumeBootPattern-232608497-project] Calling method '>' {{(pid=116063) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 13:10:47.493248 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.compute.api [None req-37c8f1ed-d27c-4ac6-85c8-1c15bdedfc0d tempest-TestVolumeBootPattern-232608497 tempest-TestVolumeBootPattern-232608497-project] [instance: 6ffe001e-4663-4c36-8a16-5cc57d821992] Fetching instance by UUID {{(pid=116063) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 13:10:47.563191 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.policy [None req-37c8f1ed-d27c-4ac6-85c8-1c15bdedfc0d tempest-TestVolumeBootPattern-232608497 tempest-TestVolumeBootPattern-232608497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94008a0d97204aff87f20bdeadbdd783', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b854de8019ad4a598587133ba362564b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116063) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 13:10:47.569763 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: INFO nova.api.openstack.requestlog [None req-37c8f1ed-d27c-4ac6-85c8-1c15bdedfc0d tempest-TestVolumeBootPattern-232608497 tempest-TestVolumeBootPattern-232608497-project] 10.222.0.49 "GET /compute/v2.1/servers/6ffe001e-4663-4c36-8a16-5cc57d821992" status: 200 len: 1092 microversion: 2.1 time: 0.081784 Dec 14 13:10:47.570332 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: [pid: 116063|app: 0|req: 577/1133] 10.222.0.49 () {58 vars in 1235 bytes} [Tue Dec 14 13:10:47 2021] GET /compute/v2.1/servers/6ffe001e-4663-4c36-8a16-5cc57d821992 => generated 1092 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 14 13:10:48.586496 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.api.openstack.wsgi [None req-c0261e45-7b63-40a8-ad87-7a223fe96efd tempest-TestVolumeBootPattern-232608497 tempest-TestVolumeBootPattern-232608497-project] Calling method '>' {{(pid=116064) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 13:10:48.587076 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.compute.api [None req-c0261e45-7b63-40a8-ad87-7a223fe96efd tempest-TestVolumeBootPattern-232608497 tempest-TestVolumeBootPattern-232608497-project] [instance: 6ffe001e-4663-4c36-8a16-5cc57d821992] Fetching instance by UUID {{(pid=116064) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 13:10:48.594930 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-c0261e45-7b63-40a8-ad87-7a223fe96efd tempest-TestVolumeBootPattern-232608497 tempest-TestVolumeBootPattern-232608497-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 13:10:48.595383 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-c0261e45-7b63-40a8-ad87-7a223fe96efd tempest-TestVolumeBootPattern-232608497 tempest-TestVolumeBootPattern-232608497-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 13:10:48.596186 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-c0261e45-7b63-40a8-ad87-7a223fe96efd tempest-TestVolumeBootPattern-232608497 tempest-TestVolumeBootPattern-232608497-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 13:10:48.596621 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-c0261e45-7b63-40a8-ad87-7a223fe96efd tempest-TestVolumeBootPattern-232608497 tempest-TestVolumeBootPattern-232608497-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 13:10:48.656592 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.policy [None req-c0261e45-7b63-40a8-ad87-7a223fe96efd tempest-TestVolumeBootPattern-232608497 tempest-TestVolumeBootPattern-232608497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94008a0d97204aff87f20bdeadbdd783', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b854de8019ad4a598587133ba362564b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116064) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 13:10:48.665060 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: INFO nova.api.openstack.requestlog [None req-c0261e45-7b63-40a8-ad87-7a223fe96efd tempest-TestVolumeBootPattern-232608497 tempest-TestVolumeBootPattern-232608497-project] 10.222.0.49 "GET /compute/v2.1/servers/6ffe001e-4663-4c36-8a16-5cc57d821992" status: 200 len: 1208 microversion: 2.1 time: 0.082144 Dec 14 13:10:48.674423 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: [pid: 116064|app: 0|req: 557/1134] 10.222.0.49 () {58 vars in 1235 bytes} [Tue Dec 14 13:10:48 2021] GET /compute/v2.1/servers/6ffe001e-4663-4c36-8a16-5cc57d821992 => generated 1208 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 14 13:10:49.682283 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.api.openstack.wsgi [None req-af0c325a-56d0-42c2-a401-15666a2ca351 tempest-TestVolumeBootPattern-232608497 tempest-TestVolumeBootPattern-232608497-project] Calling method '>' {{(pid=116063) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 13:10:49.682877 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.compute.api [None req-af0c325a-56d0-42c2-a401-15666a2ca351 tempest-TestVolumeBootPattern-232608497 tempest-TestVolumeBootPattern-232608497-project] [instance: 6ffe001e-4663-4c36-8a16-5cc57d821992] Fetching instance by UUID {{(pid=116063) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 13:10:49.690974 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-af0c325a-56d0-42c2-a401-15666a2ca351 tempest-TestVolumeBootPattern-232608497 tempest-TestVolumeBootPattern-232608497-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 13:10:49.691430 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-af0c325a-56d0-42c2-a401-15666a2ca351 tempest-TestVolumeBootPattern-232608497 tempest-TestVolumeBootPattern-232608497-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 13:10:49.692201 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-af0c325a-56d0-42c2-a401-15666a2ca351 tempest-TestVolumeBootPattern-232608497 tempest-TestVolumeBootPattern-232608497-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 13:10:49.692628 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-af0c325a-56d0-42c2-a401-15666a2ca351 tempest-TestVolumeBootPattern-232608497 tempest-TestVolumeBootPattern-232608497-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 13:10:49.866170 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.policy [None req-af0c325a-56d0-42c2-a401-15666a2ca351 tempest-TestVolumeBootPattern-232608497 tempest-TestVolumeBootPattern-232608497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94008a0d97204aff87f20bdeadbdd783', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b854de8019ad4a598587133ba362564b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116063) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 13:10:49.874959 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: INFO nova.api.openstack.requestlog [None req-af0c325a-56d0-42c2-a401-15666a2ca351 tempest-TestVolumeBootPattern-232608497 tempest-TestVolumeBootPattern-232608497-project] 10.222.0.49 "GET /compute/v2.1/servers/6ffe001e-4663-4c36-8a16-5cc57d821992" status: 200 len: 1264 microversion: 2.1 time: 0.196295 Dec 14 13:10:49.885376 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: [pid: 116063|app: 0|req: 578/1135] 10.222.0.49 () {58 vars in 1235 bytes} [Tue Dec 14 13:10:49 2021] GET /compute/v2.1/servers/6ffe001e-4663-4c36-8a16-5cc57d821992 => generated 1264 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 14 13:10:50.892179 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.api.openstack.wsgi [None req-8c7f6ebe-ee1a-403f-8986-b7ce26e8af13 tempest-TestVolumeBootPattern-232608497 tempest-TestVolumeBootPattern-232608497-project] Calling method '>' {{(pid=116064) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 13:10:50.892793 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.compute.api [None req-8c7f6ebe-ee1a-403f-8986-b7ce26e8af13 tempest-TestVolumeBootPattern-232608497 tempest-TestVolumeBootPattern-232608497-project] [instance: 6ffe001e-4663-4c36-8a16-5cc57d821992] Fetching instance by UUID {{(pid=116064) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 13:10:50.899810 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-8c7f6ebe-ee1a-403f-8986-b7ce26e8af13 tempest-TestVolumeBootPattern-232608497 tempest-TestVolumeBootPattern-232608497-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 13:10:50.900470 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-8c7f6ebe-ee1a-403f-8986-b7ce26e8af13 tempest-TestVolumeBootPattern-232608497 tempest-TestVolumeBootPattern-232608497-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 13:10:50.901486 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-8c7f6ebe-ee1a-403f-8986-b7ce26e8af13 tempest-TestVolumeBootPattern-232608497 tempest-TestVolumeBootPattern-232608497-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 13:10:50.902086 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-8c7f6ebe-ee1a-403f-8986-b7ce26e8af13 tempest-TestVolumeBootPattern-232608497 tempest-TestVolumeBootPattern-232608497-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 13:10:51.011773 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.api.openstack.wsgi [req-7ed65436-3f4c-4012-a655-76efa88b463e req-432a203c-1802-413c-afd8-a494ebc2df8b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6ffe001e-4663-4c36-8a16-5cc57d821992", "tag": "6aec8549-7ca3-4c26-b734-050efe27049d"}]} {{(pid=116063) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 14 13:10:51.017137 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 14 13:10:51.017137 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: warnings.warn(msg) Dec 14 13:10:51.032945 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [req-7ed65436-3f4c-4012-a655-76efa88b463e req-432a203c-1802-413c-afd8-a494ebc2df8b service nova] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 13:10:51.034789 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [req-7ed65436-3f4c-4012-a655-76efa88b463e req-432a203c-1802-413c-afd8-a494ebc2df8b service nova] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 13:10:51.049667 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: INFO nova.api.openstack.compute.server_external_events [req-7ed65436-3f4c-4012-a655-76efa88b463e req-432a203c-1802-413c-afd8-a494ebc2df8b service nova] Creating event network-changed:6aec8549-7ca3-4c26-b734-050efe27049d for instance 6ffe001e-4663-4c36-8a16-5cc57d821992 on hv-cinder-78447 Dec 14 13:10:51.057830 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: INFO nova.api.openstack.requestlog [req-7ed65436-3f4c-4012-a655-76efa88b463e req-432a203c-1802-413c-afd8-a494ebc2df8b service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.053371 Dec 14 13:10:51.059326 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: [pid: 116063|app: 0|req: 579/1136] 10.222.0.49 () {64 vars in 1317 bytes} [Tue Dec 14 13:10:51 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 14 13:10:51.074170 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.policy [None req-8c7f6ebe-ee1a-403f-8986-b7ce26e8af13 tempest-TestVolumeBootPattern-232608497 tempest-TestVolumeBootPattern-232608497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94008a0d97204aff87f20bdeadbdd783', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b854de8019ad4a598587133ba362564b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116064) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 13:10:51.084146 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: INFO nova.api.openstack.requestlog [None req-8c7f6ebe-ee1a-403f-8986-b7ce26e8af13 tempest-TestVolumeBootPattern-232608497 tempest-TestVolumeBootPattern-232608497-project] 10.222.0.49 "GET /compute/v2.1/servers/6ffe001e-4663-4c36-8a16-5cc57d821992" status: 200 len: 1264 microversion: 2.1 time: 0.195277 Dec 14 13:10:51.085255 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: [pid: 116064|app: 0|req: 558/1137] 10.222.0.49 () {58 vars in 1235 bytes} [Tue Dec 14 13:10:50 2021] GET /compute/v2.1/servers/6ffe001e-4663-4c36-8a16-5cc57d821992 => generated 1264 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 14 13:10:52.101988 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.api.openstack.wsgi [None req-4f64fb9a-5a51-4246-9037-3c16361d3b61 tempest-TestVolumeBootPattern-232608497 tempest-TestVolumeBootPattern-232608497-project] Calling method '>' {{(pid=116063) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 13:10:52.103038 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.compute.api [None req-4f64fb9a-5a51-4246-9037-3c16361d3b61 tempest-TestVolumeBootPattern-232608497 tempest-TestVolumeBootPattern-232608497-project] [instance: 6ffe001e-4663-4c36-8a16-5cc57d821992] Fetching instance by UUID {{(pid=116063) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 13:10:52.109429 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-4f64fb9a-5a51-4246-9037-3c16361d3b61 tempest-TestVolumeBootPattern-232608497 tempest-TestVolumeBootPattern-232608497-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 13:10:52.109836 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-4f64fb9a-5a51-4246-9037-3c16361d3b61 tempest-TestVolumeBootPattern-232608497 tempest-TestVolumeBootPattern-232608497-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 13:10:52.110785 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-4f64fb9a-5a51-4246-9037-3c16361d3b61 tempest-TestVolumeBootPattern-232608497 tempest-TestVolumeBootPattern-232608497-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 13:10:52.111223 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-4f64fb9a-5a51-4246-9037-3c16361d3b61 tempest-TestVolumeBootPattern-232608497 tempest-TestVolumeBootPattern-232608497-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 13:10:52.316129 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.policy [None req-4f64fb9a-5a51-4246-9037-3c16361d3b61 tempest-TestVolumeBootPattern-232608497 tempest-TestVolumeBootPattern-232608497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94008a0d97204aff87f20bdeadbdd783', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b854de8019ad4a598587133ba362564b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116063) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 13:10:52.324308 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: INFO nova.api.openstack.requestlog [None req-4f64fb9a-5a51-4246-9037-3c16361d3b61 tempest-TestVolumeBootPattern-232608497 tempest-TestVolumeBootPattern-232608497-project] 10.222.0.49 "GET /compute/v2.1/servers/6ffe001e-4663-4c36-8a16-5cc57d821992" status: 200 len: 1264 microversion: 2.1 time: 0.226653 Dec 14 13:10:52.333830 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: [pid: 116063|app: 0|req: 580/1138] 10.222.0.49 () {58 vars in 1235 bytes} [Tue Dec 14 13:10:52 2021] GET /compute/v2.1/servers/6ffe001e-4663-4c36-8a16-5cc57d821992 => generated 1264 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 14 13:10:53.344569 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.api.openstack.wsgi [None req-7c575322-e521-47f3-83eb-f33be715ffda tempest-TestVolumeBootPattern-232608497 tempest-TestVolumeBootPattern-232608497-project] Calling method '>' {{(pid=116064) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 13:10:53.345563 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.compute.api [None req-7c575322-e521-47f3-83eb-f33be715ffda tempest-TestVolumeBootPattern-232608497 tempest-TestVolumeBootPattern-232608497-project] [instance: 6ffe001e-4663-4c36-8a16-5cc57d821992] Fetching instance by UUID {{(pid=116064) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 13:10:53.356180 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-7c575322-e521-47f3-83eb-f33be715ffda tempest-TestVolumeBootPattern-232608497 tempest-TestVolumeBootPattern-232608497-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 13:10:53.356950 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-7c575322-e521-47f3-83eb-f33be715ffda tempest-TestVolumeBootPattern-232608497 tempest-TestVolumeBootPattern-232608497-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 13:10:53.358285 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-7c575322-e521-47f3-83eb-f33be715ffda tempest-TestVolumeBootPattern-232608497 tempest-TestVolumeBootPattern-232608497-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 13:10:53.359007 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-7c575322-e521-47f3-83eb-f33be715ffda tempest-TestVolumeBootPattern-232608497 tempest-TestVolumeBootPattern-232608497-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 13:10:53.502542 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.policy [None req-7c575322-e521-47f3-83eb-f33be715ffda tempest-TestVolumeBootPattern-232608497 tempest-TestVolumeBootPattern-232608497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94008a0d97204aff87f20bdeadbdd783', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b854de8019ad4a598587133ba362564b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116064) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 13:10:53.511323 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: INFO nova.api.openstack.requestlog [None req-7c575322-e521-47f3-83eb-f33be715ffda tempest-TestVolumeBootPattern-232608497 tempest-TestVolumeBootPattern-232608497-project] 10.222.0.49 "GET /compute/v2.1/servers/6ffe001e-4663-4c36-8a16-5cc57d821992" status: 200 len: 1264 microversion: 2.1 time: 0.173054 Dec 14 13:10:53.511899 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: [pid: 116064|app: 0|req: 559/1139] 10.222.0.49 () {58 vars in 1235 bytes} [Tue Dec 14 13:10:53 2021] GET /compute/v2.1/servers/6ffe001e-4663-4c36-8a16-5cc57d821992 => generated 1264 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 14 13:10:54.527811 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.api.openstack.wsgi [None req-346bad5b-96cd-42e3-a635-d993d3ba40dc tempest-TestVolumeBootPattern-232608497 tempest-TestVolumeBootPattern-232608497-project] Calling method '>' {{(pid=116063) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 13:10:54.528407 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.compute.api [None req-346bad5b-96cd-42e3-a635-d993d3ba40dc tempest-TestVolumeBootPattern-232608497 tempest-TestVolumeBootPattern-232608497-project] [instance: 6ffe001e-4663-4c36-8a16-5cc57d821992] Fetching instance by UUID {{(pid=116063) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 13:10:54.535814 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-346bad5b-96cd-42e3-a635-d993d3ba40dc tempest-TestVolumeBootPattern-232608497 tempest-TestVolumeBootPattern-232608497-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 13:10:54.536256 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-346bad5b-96cd-42e3-a635-d993d3ba40dc tempest-TestVolumeBootPattern-232608497 tempest-TestVolumeBootPattern-232608497-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 13:10:54.537313 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-346bad5b-96cd-42e3-a635-d993d3ba40dc tempest-TestVolumeBootPattern-232608497 tempest-TestVolumeBootPattern-232608497-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 13:10:54.537759 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-346bad5b-96cd-42e3-a635-d993d3ba40dc tempest-TestVolumeBootPattern-232608497 tempest-TestVolumeBootPattern-232608497-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 13:10:54.675097 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.policy [None req-346bad5b-96cd-42e3-a635-d993d3ba40dc tempest-TestVolumeBootPattern-232608497 tempest-TestVolumeBootPattern-232608497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94008a0d97204aff87f20bdeadbdd783', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b854de8019ad4a598587133ba362564b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116063) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 13:10:54.682567 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: INFO nova.api.openstack.requestlog [None req-346bad5b-96cd-42e3-a635-d993d3ba40dc tempest-TestVolumeBootPattern-232608497 tempest-TestVolumeBootPattern-232608497-project] 10.222.0.49 "GET /compute/v2.1/servers/6ffe001e-4663-4c36-8a16-5cc57d821992" status: 200 len: 1264 microversion: 2.1 time: 0.158491 Dec 14 13:10:54.683131 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: [pid: 116063|app: 0|req: 581/1140] 10.222.0.49 () {58 vars in 1235 bytes} [Tue Dec 14 13:10:54 2021] GET /compute/v2.1/servers/6ffe001e-4663-4c36-8a16-5cc57d821992 => generated 1264 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 14 13:10:55.703766 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.api.openstack.wsgi [None req-f3518997-5577-4d7d-a79d-56d7b1a71d1f tempest-TestVolumeBootPattern-232608497 tempest-TestVolumeBootPattern-232608497-project] Calling method '>' {{(pid=116064) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 13:10:55.704706 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.compute.api [None req-f3518997-5577-4d7d-a79d-56d7b1a71d1f tempest-TestVolumeBootPattern-232608497 tempest-TestVolumeBootPattern-232608497-project] [instance: 6ffe001e-4663-4c36-8a16-5cc57d821992] Fetching instance by UUID {{(pid=116064) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 13:10:55.713047 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-f3518997-5577-4d7d-a79d-56d7b1a71d1f tempest-TestVolumeBootPattern-232608497 tempest-TestVolumeBootPattern-232608497-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 13:10:55.713498 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-f3518997-5577-4d7d-a79d-56d7b1a71d1f tempest-TestVolumeBootPattern-232608497 tempest-TestVolumeBootPattern-232608497-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 13:10:55.714266 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-f3518997-5577-4d7d-a79d-56d7b1a71d1f tempest-TestVolumeBootPattern-232608497 tempest-TestVolumeBootPattern-232608497-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 13:10:55.714699 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-f3518997-5577-4d7d-a79d-56d7b1a71d1f tempest-TestVolumeBootPattern-232608497 tempest-TestVolumeBootPattern-232608497-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 13:10:55.857641 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.policy [None req-f3518997-5577-4d7d-a79d-56d7b1a71d1f tempest-TestVolumeBootPattern-232608497 tempest-TestVolumeBootPattern-232608497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94008a0d97204aff87f20bdeadbdd783', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b854de8019ad4a598587133ba362564b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116064) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 13:10:55.866054 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: INFO nova.api.openstack.requestlog [None req-f3518997-5577-4d7d-a79d-56d7b1a71d1f tempest-TestVolumeBootPattern-232608497 tempest-TestVolumeBootPattern-232608497-project] 10.222.0.49 "GET /compute/v2.1/servers/6ffe001e-4663-4c36-8a16-5cc57d821992" status: 200 len: 1264 microversion: 2.1 time: 0.168509 Dec 14 13:10:55.866663 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: [pid: 116064|app: 0|req: 560/1141] 10.222.0.49 () {58 vars in 1235 bytes} [Tue Dec 14 13:10:55 2021] GET /compute/v2.1/servers/6ffe001e-4663-4c36-8a16-5cc57d821992 => generated 1264 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 14 13:10:56.883730 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.api.openstack.wsgi [None req-9e309c83-60f6-4498-898f-ef6044750ab2 tempest-TestVolumeBootPattern-232608497 tempest-TestVolumeBootPattern-232608497-project] Calling method '>' {{(pid=116063) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 13:10:56.884881 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.compute.api [None req-9e309c83-60f6-4498-898f-ef6044750ab2 tempest-TestVolumeBootPattern-232608497 tempest-TestVolumeBootPattern-232608497-project] [instance: 6ffe001e-4663-4c36-8a16-5cc57d821992] Fetching instance by UUID {{(pid=116063) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 13:10:56.893698 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-9e309c83-60f6-4498-898f-ef6044750ab2 tempest-TestVolumeBootPattern-232608497 tempest-TestVolumeBootPattern-232608497-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 13:10:56.894152 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-9e309c83-60f6-4498-898f-ef6044750ab2 tempest-TestVolumeBootPattern-232608497 tempest-TestVolumeBootPattern-232608497-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 13:10:56.894947 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-9e309c83-60f6-4498-898f-ef6044750ab2 tempest-TestVolumeBootPattern-232608497 tempest-TestVolumeBootPattern-232608497-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 13:10:56.895383 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-9e309c83-60f6-4498-898f-ef6044750ab2 tempest-TestVolumeBootPattern-232608497 tempest-TestVolumeBootPattern-232608497-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 13:10:57.033668 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.policy [None req-9e309c83-60f6-4498-898f-ef6044750ab2 tempest-TestVolumeBootPattern-232608497 tempest-TestVolumeBootPattern-232608497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94008a0d97204aff87f20bdeadbdd783', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b854de8019ad4a598587133ba362564b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116063) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 13:10:57.041608 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: INFO nova.api.openstack.requestlog [None req-9e309c83-60f6-4498-898f-ef6044750ab2 tempest-TestVolumeBootPattern-232608497 tempest-TestVolumeBootPattern-232608497-project] 10.222.0.49 "GET /compute/v2.1/servers/6ffe001e-4663-4c36-8a16-5cc57d821992" status: 200 len: 1264 microversion: 2.1 time: 0.162125 Dec 14 13:10:57.042177 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: [pid: 116063|app: 0|req: 582/1142] 10.222.0.49 () {58 vars in 1235 bytes} [Tue Dec 14 13:10:56 2021] GET /compute/v2.1/servers/6ffe001e-4663-4c36-8a16-5cc57d821992 => generated 1264 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 14 13:10:58.062695 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.api.openstack.wsgi [None req-8971b3d2-df8d-43dd-a74d-757f87f598f5 tempest-TestVolumeBootPattern-232608497 tempest-TestVolumeBootPattern-232608497-project] Calling method '>' {{(pid=116064) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 13:10:58.063663 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.compute.api [None req-8971b3d2-df8d-43dd-a74d-757f87f598f5 tempest-TestVolumeBootPattern-232608497 tempest-TestVolumeBootPattern-232608497-project] [instance: 6ffe001e-4663-4c36-8a16-5cc57d821992] Fetching instance by UUID {{(pid=116064) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 13:10:58.072023 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-8971b3d2-df8d-43dd-a74d-757f87f598f5 tempest-TestVolumeBootPattern-232608497 tempest-TestVolumeBootPattern-232608497-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 13:10:58.072480 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-8971b3d2-df8d-43dd-a74d-757f87f598f5 tempest-TestVolumeBootPattern-232608497 tempest-TestVolumeBootPattern-232608497-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 13:10:58.073285 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-8971b3d2-df8d-43dd-a74d-757f87f598f5 tempest-TestVolumeBootPattern-232608497 tempest-TestVolumeBootPattern-232608497-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 13:10:58.073723 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-8971b3d2-df8d-43dd-a74d-757f87f598f5 tempest-TestVolumeBootPattern-232608497 tempest-TestVolumeBootPattern-232608497-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 13:10:58.204917 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.policy [None req-8971b3d2-df8d-43dd-a74d-757f87f598f5 tempest-TestVolumeBootPattern-232608497 tempest-TestVolumeBootPattern-232608497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94008a0d97204aff87f20bdeadbdd783', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b854de8019ad4a598587133ba362564b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116064) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 13:10:58.217263 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: INFO nova.api.openstack.requestlog [None req-8971b3d2-df8d-43dd-a74d-757f87f598f5 tempest-TestVolumeBootPattern-232608497 tempest-TestVolumeBootPattern-232608497-project] 10.222.0.49 "GET /compute/v2.1/servers/6ffe001e-4663-4c36-8a16-5cc57d821992" status: 200 len: 1264 microversion: 2.1 time: 0.160625 Dec 14 13:10:58.218113 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: [pid: 116064|app: 0|req: 561/1143] 10.222.0.49 () {58 vars in 1235 bytes} [Tue Dec 14 13:10:58 2021] GET /compute/v2.1/servers/6ffe001e-4663-4c36-8a16-5cc57d821992 => generated 1264 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 14 13:10:59.238725 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.api.openstack.wsgi [None req-08f3a5c0-e238-4b4e-a6c6-d3556eaa1d0c tempest-TestVolumeBootPattern-232608497 tempest-TestVolumeBootPattern-232608497-project] Calling method '>' {{(pid=116063) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 13:10:59.239643 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.compute.api [None req-08f3a5c0-e238-4b4e-a6c6-d3556eaa1d0c tempest-TestVolumeBootPattern-232608497 tempest-TestVolumeBootPattern-232608497-project] [instance: 6ffe001e-4663-4c36-8a16-5cc57d821992] Fetching instance by UUID {{(pid=116063) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 13:10:59.247149 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-08f3a5c0-e238-4b4e-a6c6-d3556eaa1d0c tempest-TestVolumeBootPattern-232608497 tempest-TestVolumeBootPattern-232608497-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 13:10:59.247591 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-08f3a5c0-e238-4b4e-a6c6-d3556eaa1d0c tempest-TestVolumeBootPattern-232608497 tempest-TestVolumeBootPattern-232608497-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 13:10:59.248374 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-08f3a5c0-e238-4b4e-a6c6-d3556eaa1d0c tempest-TestVolumeBootPattern-232608497 tempest-TestVolumeBootPattern-232608497-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 13:10:59.248798 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-08f3a5c0-e238-4b4e-a6c6-d3556eaa1d0c tempest-TestVolumeBootPattern-232608497 tempest-TestVolumeBootPattern-232608497-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 13:10:59.395847 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.policy [None req-08f3a5c0-e238-4b4e-a6c6-d3556eaa1d0c tempest-TestVolumeBootPattern-232608497 tempest-TestVolumeBootPattern-232608497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94008a0d97204aff87f20bdeadbdd783', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b854de8019ad4a598587133ba362564b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116063) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 13:10:59.404020 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: INFO nova.api.openstack.requestlog [None req-08f3a5c0-e238-4b4e-a6c6-d3556eaa1d0c tempest-TestVolumeBootPattern-232608497 tempest-TestVolumeBootPattern-232608497-project] 10.222.0.49 "GET /compute/v2.1/servers/6ffe001e-4663-4c36-8a16-5cc57d821992" status: 200 len: 1264 microversion: 2.1 time: 0.171600 Dec 14 13:10:59.404593 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: [pid: 116063|app: 0|req: 583/1144] 10.222.0.49 () {58 vars in 1235 bytes} [Tue Dec 14 13:10:59 2021] GET /compute/v2.1/servers/6ffe001e-4663-4c36-8a16-5cc57d821992 => generated 1264 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 14 13:11:00.421655 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.api.openstack.wsgi [None req-56ea719a-b0f7-415c-a7f4-abb4d3245808 tempest-TestVolumeBootPattern-232608497 tempest-TestVolumeBootPattern-232608497-project] Calling method '>' {{(pid=116064) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 13:11:00.422883 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.compute.api [None req-56ea719a-b0f7-415c-a7f4-abb4d3245808 tempest-TestVolumeBootPattern-232608497 tempest-TestVolumeBootPattern-232608497-project] [instance: 6ffe001e-4663-4c36-8a16-5cc57d821992] Fetching instance by UUID {{(pid=116064) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 13:11:00.429847 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-56ea719a-b0f7-415c-a7f4-abb4d3245808 tempest-TestVolumeBootPattern-232608497 tempest-TestVolumeBootPattern-232608497-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 13:11:00.430307 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-56ea719a-b0f7-415c-a7f4-abb4d3245808 tempest-TestVolumeBootPattern-232608497 tempest-TestVolumeBootPattern-232608497-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 13:11:00.431132 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-56ea719a-b0f7-415c-a7f4-abb4d3245808 tempest-TestVolumeBootPattern-232608497 tempest-TestVolumeBootPattern-232608497-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 13:11:00.431542 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-56ea719a-b0f7-415c-a7f4-abb4d3245808 tempest-TestVolumeBootPattern-232608497 tempest-TestVolumeBootPattern-232608497-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 13:11:00.543153 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.api.openstack.wsgi [req-0285ac3d-00d5-40ac-9d3a-b58c933191e5 req-f6dfd092-21fb-4294-ba01-173823fcadef service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6ffe001e-4663-4c36-8a16-5cc57d821992", "name": "network-vif-plugged", "status": "completed", "tag": "6aec8549-7ca3-4c26-b734-050efe27049d"}]} {{(pid=116063) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 14 13:11:00.544682 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 14 13:11:00.544682 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: warnings.warn(msg) Dec 14 13:11:00.552182 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [req-0285ac3d-00d5-40ac-9d3a-b58c933191e5 req-f6dfd092-21fb-4294-ba01-173823fcadef service nova] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 13:11:00.552867 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [req-0285ac3d-00d5-40ac-9d3a-b58c933191e5 req-f6dfd092-21fb-4294-ba01-173823fcadef service nova] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 13:11:00.564623 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: INFO nova.api.openstack.compute.server_external_events [req-0285ac3d-00d5-40ac-9d3a-b58c933191e5 req-f6dfd092-21fb-4294-ba01-173823fcadef service nova] Creating event network-vif-plugged:6aec8549-7ca3-4c26-b734-050efe27049d for instance 6ffe001e-4663-4c36-8a16-5cc57d821992 on hv-cinder-78447 Dec 14 13:11:00.567870 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.policy [None req-56ea719a-b0f7-415c-a7f4-abb4d3245808 tempest-TestVolumeBootPattern-232608497 tempest-TestVolumeBootPattern-232608497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94008a0d97204aff87f20bdeadbdd783', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b854de8019ad4a598587133ba362564b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116064) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 13:11:00.570296 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: INFO nova.api.openstack.requestlog [req-0285ac3d-00d5-40ac-9d3a-b58c933191e5 req-f6dfd092-21fb-4294-ba01-173823fcadef service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030859 Dec 14 13:11:00.571496 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: [pid: 116063|app: 0|req: 584/1145] 10.222.0.49 () {64 vars in 1317 bytes} [Tue Dec 14 13:11:00 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 14 13:11:00.576070 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: INFO nova.api.openstack.requestlog [None req-56ea719a-b0f7-415c-a7f4-abb4d3245808 tempest-TestVolumeBootPattern-232608497 tempest-TestVolumeBootPattern-232608497-project] 10.222.0.49 "GET /compute/v2.1/servers/6ffe001e-4663-4c36-8a16-5cc57d821992" status: 200 len: 1264 microversion: 2.1 time: 0.158319 Dec 14 13:11:00.576648 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: [pid: 116064|app: 0|req: 562/1146] 10.222.0.49 () {58 vars in 1235 bytes} [Tue Dec 14 13:11:00 2021] GET /compute/v2.1/servers/6ffe001e-4663-4c36-8a16-5cc57d821992 => generated 1264 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 14 13:11:01.598332 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.api.openstack.wsgi [None req-b878c580-a9aa-43c5-92e1-037caec38df9 tempest-TestVolumeBootPattern-232608497 tempest-TestVolumeBootPattern-232608497-project] Calling method '>' {{(pid=116063) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 13:11:01.599414 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.compute.api [None req-b878c580-a9aa-43c5-92e1-037caec38df9 tempest-TestVolumeBootPattern-232608497 tempest-TestVolumeBootPattern-232608497-project] [instance: 6ffe001e-4663-4c36-8a16-5cc57d821992] Fetching instance by UUID {{(pid=116063) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 13:11:01.610076 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-b878c580-a9aa-43c5-92e1-037caec38df9 tempest-TestVolumeBootPattern-232608497 tempest-TestVolumeBootPattern-232608497-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 13:11:01.610814 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-b878c580-a9aa-43c5-92e1-037caec38df9 tempest-TestVolumeBootPattern-232608497 tempest-TestVolumeBootPattern-232608497-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 13:11:01.612093 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-b878c580-a9aa-43c5-92e1-037caec38df9 tempest-TestVolumeBootPattern-232608497 tempest-TestVolumeBootPattern-232608497-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 13:11:01.612803 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-b878c580-a9aa-43c5-92e1-037caec38df9 tempest-TestVolumeBootPattern-232608497 tempest-TestVolumeBootPattern-232608497-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 13:11:01.758750 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.policy [None req-b878c580-a9aa-43c5-92e1-037caec38df9 tempest-TestVolumeBootPattern-232608497 tempest-TestVolumeBootPattern-232608497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94008a0d97204aff87f20bdeadbdd783', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b854de8019ad4a598587133ba362564b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116063) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 13:11:01.766754 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: INFO nova.api.openstack.requestlog [None req-b878c580-a9aa-43c5-92e1-037caec38df9 tempest-TestVolumeBootPattern-232608497 tempest-TestVolumeBootPattern-232608497-project] 10.222.0.49 "GET /compute/v2.1/servers/6ffe001e-4663-4c36-8a16-5cc57d821992" status: 200 len: 1264 microversion: 2.1 time: 0.175908 Dec 14 13:11:01.767351 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: [pid: 116063|app: 0|req: 585/1147] 10.222.0.49 () {58 vars in 1235 bytes} [Tue Dec 14 13:11:01 2021] GET /compute/v2.1/servers/6ffe001e-4663-4c36-8a16-5cc57d821992 => generated 1264 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 14 13:11:02.787693 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.api.openstack.wsgi [None req-a16f138a-4e14-4696-81e8-4943c2ded474 tempest-TestVolumeBootPattern-232608497 tempest-TestVolumeBootPattern-232608497-project] Calling method '>' {{(pid=116064) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 13:11:02.788641 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.compute.api [None req-a16f138a-4e14-4696-81e8-4943c2ded474 tempest-TestVolumeBootPattern-232608497 tempest-TestVolumeBootPattern-232608497-project] [instance: 6ffe001e-4663-4c36-8a16-5cc57d821992] Fetching instance by UUID {{(pid=116064) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 13:11:02.796272 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-a16f138a-4e14-4696-81e8-4943c2ded474 tempest-TestVolumeBootPattern-232608497 tempest-TestVolumeBootPattern-232608497-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 13:11:02.796747 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-a16f138a-4e14-4696-81e8-4943c2ded474 tempest-TestVolumeBootPattern-232608497 tempest-TestVolumeBootPattern-232608497-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 13:11:02.797603 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-a16f138a-4e14-4696-81e8-4943c2ded474 tempest-TestVolumeBootPattern-232608497 tempest-TestVolumeBootPattern-232608497-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 13:11:02.798060 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-a16f138a-4e14-4696-81e8-4943c2ded474 tempest-TestVolumeBootPattern-232608497 tempest-TestVolumeBootPattern-232608497-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 13:11:02.932448 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.policy [None req-a16f138a-4e14-4696-81e8-4943c2ded474 tempest-TestVolumeBootPattern-232608497 tempest-TestVolumeBootPattern-232608497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94008a0d97204aff87f20bdeadbdd783', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b854de8019ad4a598587133ba362564b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116064) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 13:11:02.940656 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: INFO nova.api.openstack.requestlog [None req-a16f138a-4e14-4696-81e8-4943c2ded474 tempest-TestVolumeBootPattern-232608497 tempest-TestVolumeBootPattern-232608497-project] 10.222.0.49 "GET /compute/v2.1/servers/6ffe001e-4663-4c36-8a16-5cc57d821992" status: 200 len: 1452 microversion: 2.1 time: 0.159601 Dec 14 13:11:02.941273 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: [pid: 116064|app: 0|req: 563/1148] 10.222.0.49 () {58 vars in 1235 bytes} [Tue Dec 14 13:11:02 2021] GET /compute/v2.1/servers/6ffe001e-4663-4c36-8a16-5cc57d821992 => generated 1452 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 14 13:11:02.956891 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.api.openstack.wsgi [None req-bee2591f-eb55-42a4-811d-850db88ab7a9 tempest-TestVolumeBootPattern-232608497 tempest-TestVolumeBootPattern-232608497-project] Calling method '>' {{(pid=116063) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 13:11:02.957530 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.compute.api [None req-bee2591f-eb55-42a4-811d-850db88ab7a9 tempest-TestVolumeBootPattern-232608497 tempest-TestVolumeBootPattern-232608497-project] [instance: 6ffe001e-4663-4c36-8a16-5cc57d821992] Fetching instance by UUID {{(pid=116063) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 13:11:02.964697 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-bee2591f-eb55-42a4-811d-850db88ab7a9 tempest-TestVolumeBootPattern-232608497 tempest-TestVolumeBootPattern-232608497-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 13:11:02.965428 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-bee2591f-eb55-42a4-811d-850db88ab7a9 tempest-TestVolumeBootPattern-232608497 tempest-TestVolumeBootPattern-232608497-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 13:11:02.966225 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-bee2591f-eb55-42a4-811d-850db88ab7a9 tempest-TestVolumeBootPattern-232608497 tempest-TestVolumeBootPattern-232608497-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 13:11:02.966663 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-bee2591f-eb55-42a4-811d-850db88ab7a9 tempest-TestVolumeBootPattern-232608497 tempest-TestVolumeBootPattern-232608497-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 13:11:03.112690 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.policy [None req-bee2591f-eb55-42a4-811d-850db88ab7a9 tempest-TestVolumeBootPattern-232608497 tempest-TestVolumeBootPattern-232608497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94008a0d97204aff87f20bdeadbdd783', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b854de8019ad4a598587133ba362564b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116063) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 13:11:03.121809 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: INFO nova.api.openstack.requestlog [None req-bee2591f-eb55-42a4-811d-850db88ab7a9 tempest-TestVolumeBootPattern-232608497 tempest-TestVolumeBootPattern-232608497-project] 10.222.0.49 "GET /compute/v2.1/servers/6ffe001e-4663-4c36-8a16-5cc57d821992" status: 200 len: 1452 microversion: 2.1 time: 0.168526 Dec 14 13:11:03.122410 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: [pid: 116063|app: 0|req: 586/1149] 10.222.0.49 () {58 vars in 1235 bytes} [Tue Dec 14 13:11:02 2021] GET /compute/v2.1/servers/6ffe001e-4663-4c36-8a16-5cc57d821992 => generated 1452 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 14 13:11:04.982798 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.api.openstack.wsgi [req-24a61a51-b186-40e1-8098-d5a883679de6 req-b05e8280-4b5a-40c3-b58a-03c450c0e56b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6ffe001e-4663-4c36-8a16-5cc57d821992", "tag": "6aec8549-7ca3-4c26-b734-050efe27049d"}]} {{(pid=116064) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 14 13:11:04.984366 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 14 13:11:04.984366 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: warnings.warn(msg) Dec 14 13:11:04.991837 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [req-24a61a51-b186-40e1-8098-d5a883679de6 req-b05e8280-4b5a-40c3-b58a-03c450c0e56b service nova] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 13:11:04.992278 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [req-24a61a51-b186-40e1-8098-d5a883679de6 req-b05e8280-4b5a-40c3-b58a-03c450c0e56b service nova] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 13:11:05.003857 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: INFO nova.api.openstack.compute.server_external_events [req-24a61a51-b186-40e1-8098-d5a883679de6 req-b05e8280-4b5a-40c3-b58a-03c450c0e56b service nova] Creating event network-changed:6aec8549-7ca3-4c26-b734-050efe27049d for instance 6ffe001e-4663-4c36-8a16-5cc57d821992 on hv-cinder-78447 Dec 14 13:11:05.009039 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: INFO nova.api.openstack.requestlog [req-24a61a51-b186-40e1-8098-d5a883679de6 req-b05e8280-4b5a-40c3-b58a-03c450c0e56b service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.029913 Dec 14 13:11:05.009888 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: [pid: 116064|app: 0|req: 564/1150] 10.222.0.49 () {64 vars in 1317 bytes} [Tue Dec 14 13:11:04 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 14 13:12:39.144986 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.api.openstack.wsgi [None req-296ab7ca-81c0-4660-9928-34770ceb5065 tempest-TestVolumeBootPattern-232608497 tempest-TestVolumeBootPattern-232608497-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1400913724", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-878167248", "security_groups": [{"name": "tempest-secgroup-smoke-1999256453"}], "block_device_mapping_v2": [{"uuid": "75ef375b-f2ee-4629-8c21-c7b99d3bb670", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "7f5ca66d-8559-4e12-9014-f81fba56fd65"}]}} {{(pid=116063) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 14 13:12:39.263729 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.network.neutron [None req-296ab7ca-81c0-4660-9928-34770ceb5065 tempest-TestVolumeBootPattern-232608497 tempest-TestVolumeBootPattern-232608497-project] validate_networks() for [('7f5ca66d-8559-4e12-9014-f81fba56fd65', None, None, None, None, None)] {{(pid=116063) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Dec 14 13:12:39.784198 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.virt.hardware [None req-296ab7ca-81c0-4660-9928-34770ceb5065 tempest-TestVolumeBootPattern-232608497 tempest-TestVolumeBootPattern-232608497-project] Flavor limits 0:0:0 {{(pid=116063) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Dec 14 13:12:39.784615 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.virt.hardware [None req-296ab7ca-81c0-4660-9928-34770ceb5065 tempest-TestVolumeBootPattern-232608497 tempest-TestVolumeBootPattern-232608497-project] Image limits 0:0:0 {{(pid=116063) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Dec 14 13:12:39.785143 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.virt.hardware [None req-296ab7ca-81c0-4660-9928-34770ceb5065 tempest-TestVolumeBootPattern-232608497 tempest-TestVolumeBootPattern-232608497-project] Flavor pref 0:0:0 {{(pid=116063) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Dec 14 13:12:39.785541 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.virt.hardware [None req-296ab7ca-81c0-4660-9928-34770ceb5065 tempest-TestVolumeBootPattern-232608497 tempest-TestVolumeBootPattern-232608497-project] Image pref 0:0:0 {{(pid=116063) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Dec 14 13:12:39.785946 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.virt.hardware [None req-296ab7ca-81c0-4660-9928-34770ceb5065 tempest-TestVolumeBootPattern-232608497 tempest-TestVolumeBootPattern-232608497-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=116063) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Dec 14 13:12:39.794494 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-296ab7ca-81c0-4660-9928-34770ceb5065 tempest-TestVolumeBootPattern-232608497 tempest-TestVolumeBootPattern-232608497-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 13:12:39.794935 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-296ab7ca-81c0-4660-9928-34770ceb5065 tempest-TestVolumeBootPattern-232608497 tempest-TestVolumeBootPattern-232608497-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 13:12:39.795732 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-296ab7ca-81c0-4660-9928-34770ceb5065 tempest-TestVolumeBootPattern-232608497 tempest-TestVolumeBootPattern-232608497-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 13:12:39.796158 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-296ab7ca-81c0-4660-9928-34770ceb5065 tempest-TestVolumeBootPattern-232608497 tempest-TestVolumeBootPattern-232608497-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 13:12:39.812012 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.quota [None req-296ab7ca-81c0-4660-9928-34770ceb5065 tempest-TestVolumeBootPattern-232608497 tempest-TestVolumeBootPattern-232608497-project] Getting quotas for project b854de8019ad4a598587133ba362564b. Resources: {'cores', 'instances', 'ram'} {{(pid=116063) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 14 13:12:39.816201 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.quota [None req-296ab7ca-81c0-4660-9928-34770ceb5065 tempest-TestVolumeBootPattern-232608497 tempest-TestVolumeBootPattern-232608497-project] Getting quotas for user 94008a0d97204aff87f20bdeadbdd783 and project b854de8019ad4a598587133ba362564b. Resources: {'cores', 'instances', 'ram'} {{(pid=116063) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 14 13:12:39.872960 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.compute.api [None req-296ab7ca-81c0-4660-9928-34770ceb5065 tempest-TestVolumeBootPattern-232608497 tempest-TestVolumeBootPattern-232608497-project] Going to run 1 instances... {{(pid=116063) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Dec 14 13:12:39.875133 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.compute.api [None req-296ab7ca-81c0-4660-9928-34770ceb5065 tempest-TestVolumeBootPattern-232608497 tempest-TestVolumeBootPattern-232608497-project] [instance: 86c97e97-93e7-40dc-9bcb-b2cf281f4374] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='75ef375b-f2ee-4629-8c21-c7b99d3bb670',volume_size=None,volume_type=None)] {{(pid=116063) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Dec 14 13:12:39.999646 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: INFO nova.api.openstack.requestlog [None req-296ab7ca-81c0-4660-9928-34770ceb5065 tempest-TestVolumeBootPattern-232608497 tempest-TestVolumeBootPattern-232608497-project] 10.222.0.49 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.859399 Dec 14 13:12:40.000276 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: [pid: 116063|app: 0|req: 587/1151] 10.222.0.49 () {60 vars in 1146 bytes} [Tue Dec 14 13:12:39 2021] POST /compute/v2.1/servers => generated 406 bytes in 861 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Dec 14 13:12:40.011470 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.api.openstack.wsgi [None req-0a98f379-7e5d-432d-ace1-4d311d15a3c7 tempest-TestVolumeBootPattern-232608497 tempest-TestVolumeBootPattern-232608497-project] Calling method '>' {{(pid=116064) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 13:12:40.012164 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.compute.api [None req-0a98f379-7e5d-432d-ace1-4d311d15a3c7 tempest-TestVolumeBootPattern-232608497 tempest-TestVolumeBootPattern-232608497-project] [instance: 86c97e97-93e7-40dc-9bcb-b2cf281f4374] Fetching instance by UUID {{(pid=116064) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 13:12:40.064946 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.policy [None req-0a98f379-7e5d-432d-ace1-4d311d15a3c7 tempest-TestVolumeBootPattern-232608497 tempest-TestVolumeBootPattern-232608497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94008a0d97204aff87f20bdeadbdd783', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b854de8019ad4a598587133ba362564b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116064) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 13:12:40.071384 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: INFO nova.api.openstack.requestlog [None req-0a98f379-7e5d-432d-ace1-4d311d15a3c7 tempest-TestVolumeBootPattern-232608497 tempest-TestVolumeBootPattern-232608497-project] 10.222.0.49 "GET /compute/v2.1/servers/86c97e97-93e7-40dc-9bcb-b2cf281f4374" status: 200 len: 1094 microversion: 2.1 time: 0.064856 Dec 14 13:12:40.071986 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: [pid: 116064|app: 0|req: 565/1152] 10.222.0.49 () {58 vars in 1235 bytes} [Tue Dec 14 13:12:40 2021] GET /compute/v2.1/servers/86c97e97-93e7-40dc-9bcb-b2cf281f4374 => generated 1094 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 14 13:12:41.087871 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.api.openstack.wsgi [None req-0f1d7662-6ac9-46cb-8368-c7cf3595c6b1 tempest-TestVolumeBootPattern-232608497 tempest-TestVolumeBootPattern-232608497-project] Calling method '>' {{(pid=116063) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 13:12:41.088511 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.compute.api [None req-0f1d7662-6ac9-46cb-8368-c7cf3595c6b1 tempest-TestVolumeBootPattern-232608497 tempest-TestVolumeBootPattern-232608497-project] [instance: 86c97e97-93e7-40dc-9bcb-b2cf281f4374] Fetching instance by UUID {{(pid=116063) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 13:12:41.095032 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-0f1d7662-6ac9-46cb-8368-c7cf3595c6b1 tempest-TestVolumeBootPattern-232608497 tempest-TestVolumeBootPattern-232608497-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 13:12:41.095472 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-0f1d7662-6ac9-46cb-8368-c7cf3595c6b1 tempest-TestVolumeBootPattern-232608497 tempest-TestVolumeBootPattern-232608497-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 13:12:41.096235 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-0f1d7662-6ac9-46cb-8368-c7cf3595c6b1 tempest-TestVolumeBootPattern-232608497 tempest-TestVolumeBootPattern-232608497-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 13:12:41.096660 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-0f1d7662-6ac9-46cb-8368-c7cf3595c6b1 tempest-TestVolumeBootPattern-232608497 tempest-TestVolumeBootPattern-232608497-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 13:12:41.154213 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.policy [None req-0f1d7662-6ac9-46cb-8368-c7cf3595c6b1 tempest-TestVolumeBootPattern-232608497 tempest-TestVolumeBootPattern-232608497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94008a0d97204aff87f20bdeadbdd783', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b854de8019ad4a598587133ba362564b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116063) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 13:12:41.161994 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: INFO nova.api.openstack.requestlog [None req-0f1d7662-6ac9-46cb-8368-c7cf3595c6b1 tempest-TestVolumeBootPattern-232608497 tempest-TestVolumeBootPattern-232608497-project] 10.222.0.49 "GET /compute/v2.1/servers/86c97e97-93e7-40dc-9bcb-b2cf281f4374" status: 200 len: 1210 microversion: 2.1 time: 0.078382 Dec 14 13:12:41.162554 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: [pid: 116063|app: 0|req: 588/1153] 10.222.0.49 () {58 vars in 1235 bytes} [Tue Dec 14 13:12:41 2021] GET /compute/v2.1/servers/86c97e97-93e7-40dc-9bcb-b2cf281f4374 => generated 1210 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 14 13:12:42.180498 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.api.openstack.wsgi [None req-94ae7ec3-9f24-4122-a4e1-a9bc8a558135 tempest-TestVolumeBootPattern-232608497 tempest-TestVolumeBootPattern-232608497-project] Calling method '>' {{(pid=116064) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 13:12:42.181141 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.compute.api [None req-94ae7ec3-9f24-4122-a4e1-a9bc8a558135 tempest-TestVolumeBootPattern-232608497 tempest-TestVolumeBootPattern-232608497-project] [instance: 86c97e97-93e7-40dc-9bcb-b2cf281f4374] Fetching instance by UUID {{(pid=116064) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 13:12:42.188378 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-94ae7ec3-9f24-4122-a4e1-a9bc8a558135 tempest-TestVolumeBootPattern-232608497 tempest-TestVolumeBootPattern-232608497-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 13:12:42.188835 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-94ae7ec3-9f24-4122-a4e1-a9bc8a558135 tempest-TestVolumeBootPattern-232608497 tempest-TestVolumeBootPattern-232608497-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 13:12:42.189937 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-94ae7ec3-9f24-4122-a4e1-a9bc8a558135 tempest-TestVolumeBootPattern-232608497 tempest-TestVolumeBootPattern-232608497-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 13:12:42.190509 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-94ae7ec3-9f24-4122-a4e1-a9bc8a558135 tempest-TestVolumeBootPattern-232608497 tempest-TestVolumeBootPattern-232608497-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 13:12:42.247918 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.api.openstack.wsgi [req-ad7083a6-907c-44d2-9473-c83f5e81d723 req-59c4c0f8-0ae4-4222-9915-402a5f7ca2b1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "86c97e97-93e7-40dc-9bcb-b2cf281f4374", "tag": "76fa7e39-7900-423e-94b0-185970c0230d"}]} {{(pid=116063) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 14 13:12:42.249600 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 14 13:12:42.249600 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: warnings.warn(msg) Dec 14 13:12:42.257774 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [req-ad7083a6-907c-44d2-9473-c83f5e81d723 req-59c4c0f8-0ae4-4222-9915-402a5f7ca2b1 service nova] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 13:12:42.258465 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [req-ad7083a6-907c-44d2-9473-c83f5e81d723 req-59c4c0f8-0ae4-4222-9915-402a5f7ca2b1 service nova] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 13:12:42.269801 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: INFO nova.api.openstack.compute.server_external_events [req-ad7083a6-907c-44d2-9473-c83f5e81d723 req-59c4c0f8-0ae4-4222-9915-402a5f7ca2b1 service nova] Creating event network-changed:76fa7e39-7900-423e-94b0-185970c0230d for instance 86c97e97-93e7-40dc-9bcb-b2cf281f4374 on hv-cinder-78447 Dec 14 13:12:42.275077 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: INFO nova.api.openstack.requestlog [req-ad7083a6-907c-44d2-9473-c83f5e81d723 req-59c4c0f8-0ae4-4222-9915-402a5f7ca2b1 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030829 Dec 14 13:12:42.275960 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: [pid: 116063|app: 0|req: 589/1154] 10.222.0.49 () {64 vars in 1317 bytes} [Tue Dec 14 13:12:42 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Dec 14 13:12:42.371106 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.policy [None req-94ae7ec3-9f24-4122-a4e1-a9bc8a558135 tempest-TestVolumeBootPattern-232608497 tempest-TestVolumeBootPattern-232608497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94008a0d97204aff87f20bdeadbdd783', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b854de8019ad4a598587133ba362564b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116064) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 13:12:42.379298 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: INFO nova.api.openstack.requestlog [None req-94ae7ec3-9f24-4122-a4e1-a9bc8a558135 tempest-TestVolumeBootPattern-232608497 tempest-TestVolumeBootPattern-232608497-project] 10.222.0.49 "GET /compute/v2.1/servers/86c97e97-93e7-40dc-9bcb-b2cf281f4374" status: 200 len: 1266 microversion: 2.1 time: 0.203548 Dec 14 13:12:42.389302 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: [pid: 116064|app: 0|req: 566/1155] 10.222.0.49 () {58 vars in 1235 bytes} [Tue Dec 14 13:12:42 2021] GET /compute/v2.1/servers/86c97e97-93e7-40dc-9bcb-b2cf281f4374 => generated 1266 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 14 13:12:43.402379 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.api.openstack.wsgi [None req-8b03984b-17fa-4f7d-9362-48edaa7b9819 tempest-TestVolumeBootPattern-232608497 tempest-TestVolumeBootPattern-232608497-project] Calling method '>' {{(pid=116063) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 13:12:43.403052 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.compute.api [None req-8b03984b-17fa-4f7d-9362-48edaa7b9819 tempest-TestVolumeBootPattern-232608497 tempest-TestVolumeBootPattern-232608497-project] [instance: 86c97e97-93e7-40dc-9bcb-b2cf281f4374] Fetching instance by UUID {{(pid=116063) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 13:12:43.410637 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-8b03984b-17fa-4f7d-9362-48edaa7b9819 tempest-TestVolumeBootPattern-232608497 tempest-TestVolumeBootPattern-232608497-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 13:12:43.411134 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-8b03984b-17fa-4f7d-9362-48edaa7b9819 tempest-TestVolumeBootPattern-232608497 tempest-TestVolumeBootPattern-232608497-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 13:12:43.411989 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-8b03984b-17fa-4f7d-9362-48edaa7b9819 tempest-TestVolumeBootPattern-232608497 tempest-TestVolumeBootPattern-232608497-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 13:12:43.412456 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-8b03984b-17fa-4f7d-9362-48edaa7b9819 tempest-TestVolumeBootPattern-232608497 tempest-TestVolumeBootPattern-232608497-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 13:12:43.552985 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.policy [None req-8b03984b-17fa-4f7d-9362-48edaa7b9819 tempest-TestVolumeBootPattern-232608497 tempest-TestVolumeBootPattern-232608497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94008a0d97204aff87f20bdeadbdd783', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b854de8019ad4a598587133ba362564b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116063) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 13:12:43.560997 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: INFO nova.api.openstack.requestlog [None req-8b03984b-17fa-4f7d-9362-48edaa7b9819 tempest-TestVolumeBootPattern-232608497 tempest-TestVolumeBootPattern-232608497-project] 10.222.0.49 "GET /compute/v2.1/servers/86c97e97-93e7-40dc-9bcb-b2cf281f4374" status: 200 len: 1266 microversion: 2.1 time: 0.166453 Dec 14 13:12:43.561600 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: [pid: 116063|app: 0|req: 590/1156] 10.222.0.49 () {58 vars in 1235 bytes} [Tue Dec 14 13:12:43 2021] GET /compute/v2.1/servers/86c97e97-93e7-40dc-9bcb-b2cf281f4374 => generated 1266 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 14 13:12:44.579791 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.api.openstack.wsgi [None req-dfeed5e3-c541-4be8-a00f-18ce46b1af95 tempest-TestVolumeBootPattern-232608497 tempest-TestVolumeBootPattern-232608497-project] Calling method '>' {{(pid=116064) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 13:12:44.580466 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.compute.api [None req-dfeed5e3-c541-4be8-a00f-18ce46b1af95 tempest-TestVolumeBootPattern-232608497 tempest-TestVolumeBootPattern-232608497-project] [instance: 86c97e97-93e7-40dc-9bcb-b2cf281f4374] Fetching instance by UUID {{(pid=116064) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 13:12:44.588156 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-dfeed5e3-c541-4be8-a00f-18ce46b1af95 tempest-TestVolumeBootPattern-232608497 tempest-TestVolumeBootPattern-232608497-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 13:12:44.588685 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-dfeed5e3-c541-4be8-a00f-18ce46b1af95 tempest-TestVolumeBootPattern-232608497 tempest-TestVolumeBootPattern-232608497-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 13:12:44.589652 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-dfeed5e3-c541-4be8-a00f-18ce46b1af95 tempest-TestVolumeBootPattern-232608497 tempest-TestVolumeBootPattern-232608497-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 13:12:44.590175 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-dfeed5e3-c541-4be8-a00f-18ce46b1af95 tempest-TestVolumeBootPattern-232608497 tempest-TestVolumeBootPattern-232608497-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 13:12:44.734196 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.policy [None req-dfeed5e3-c541-4be8-a00f-18ce46b1af95 tempest-TestVolumeBootPattern-232608497 tempest-TestVolumeBootPattern-232608497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94008a0d97204aff87f20bdeadbdd783', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b854de8019ad4a598587133ba362564b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116064) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 13:12:44.745841 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: INFO nova.api.openstack.requestlog [None req-dfeed5e3-c541-4be8-a00f-18ce46b1af95 tempest-TestVolumeBootPattern-232608497 tempest-TestVolumeBootPattern-232608497-project] 10.222.0.49 "GET /compute/v2.1/servers/86c97e97-93e7-40dc-9bcb-b2cf281f4374" status: 200 len: 1266 microversion: 2.1 time: 0.170308 Dec 14 13:12:44.746471 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: [pid: 116064|app: 0|req: 567/1157] 10.222.0.49 () {58 vars in 1235 bytes} [Tue Dec 14 13:12:44 2021] GET /compute/v2.1/servers/86c97e97-93e7-40dc-9bcb-b2cf281f4374 => generated 1266 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 14 13:12:45.766629 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.api.openstack.wsgi [None req-d92ba251-5a38-4d9b-b33b-c2eab8d3a84d tempest-TestVolumeBootPattern-232608497 tempest-TestVolumeBootPattern-232608497-project] Calling method '>' {{(pid=116063) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 13:12:45.767627 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.compute.api [None req-d92ba251-5a38-4d9b-b33b-c2eab8d3a84d tempest-TestVolumeBootPattern-232608497 tempest-TestVolumeBootPattern-232608497-project] [instance: 86c97e97-93e7-40dc-9bcb-b2cf281f4374] Fetching instance by UUID {{(pid=116063) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 13:12:45.777450 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-d92ba251-5a38-4d9b-b33b-c2eab8d3a84d tempest-TestVolumeBootPattern-232608497 tempest-TestVolumeBootPattern-232608497-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 13:12:45.777898 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-d92ba251-5a38-4d9b-b33b-c2eab8d3a84d tempest-TestVolumeBootPattern-232608497 tempest-TestVolumeBootPattern-232608497-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 13:12:45.778668 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-d92ba251-5a38-4d9b-b33b-c2eab8d3a84d tempest-TestVolumeBootPattern-232608497 tempest-TestVolumeBootPattern-232608497-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 13:12:45.779100 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-d92ba251-5a38-4d9b-b33b-c2eab8d3a84d tempest-TestVolumeBootPattern-232608497 tempest-TestVolumeBootPattern-232608497-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 13:12:45.916679 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.policy [None req-d92ba251-5a38-4d9b-b33b-c2eab8d3a84d tempest-TestVolumeBootPattern-232608497 tempest-TestVolumeBootPattern-232608497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94008a0d97204aff87f20bdeadbdd783', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b854de8019ad4a598587133ba362564b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116063) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 13:12:45.924307 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: INFO nova.api.openstack.requestlog [None req-d92ba251-5a38-4d9b-b33b-c2eab8d3a84d tempest-TestVolumeBootPattern-232608497 tempest-TestVolumeBootPattern-232608497-project] 10.222.0.49 "GET /compute/v2.1/servers/86c97e97-93e7-40dc-9bcb-b2cf281f4374" status: 200 len: 1266 microversion: 2.1 time: 0.164096 Dec 14 13:12:45.924874 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: [pid: 116063|app: 0|req: 591/1158] 10.222.0.49 () {58 vars in 1235 bytes} [Tue Dec 14 13:12:45 2021] GET /compute/v2.1/servers/86c97e97-93e7-40dc-9bcb-b2cf281f4374 => generated 1266 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 14 13:12:46.949098 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.api.openstack.wsgi [None req-a8acabb0-1380-4d20-8f31-41892576065a tempest-TestVolumeBootPattern-232608497 tempest-TestVolumeBootPattern-232608497-project] Calling method '>' {{(pid=116064) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 13:12:46.950137 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.compute.api [None req-a8acabb0-1380-4d20-8f31-41892576065a tempest-TestVolumeBootPattern-232608497 tempest-TestVolumeBootPattern-232608497-project] [instance: 86c97e97-93e7-40dc-9bcb-b2cf281f4374] Fetching instance by UUID {{(pid=116064) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 13:12:46.960879 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-a8acabb0-1380-4d20-8f31-41892576065a tempest-TestVolumeBootPattern-232608497 tempest-TestVolumeBootPattern-232608497-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 13:12:46.961705 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-a8acabb0-1380-4d20-8f31-41892576065a tempest-TestVolumeBootPattern-232608497 tempest-TestVolumeBootPattern-232608497-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 13:12:46.963004 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-a8acabb0-1380-4d20-8f31-41892576065a tempest-TestVolumeBootPattern-232608497 tempest-TestVolumeBootPattern-232608497-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 13:12:46.963737 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-a8acabb0-1380-4d20-8f31-41892576065a tempest-TestVolumeBootPattern-232608497 tempest-TestVolumeBootPattern-232608497-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 13:12:47.103151 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.policy [None req-a8acabb0-1380-4d20-8f31-41892576065a tempest-TestVolumeBootPattern-232608497 tempest-TestVolumeBootPattern-232608497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94008a0d97204aff87f20bdeadbdd783', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b854de8019ad4a598587133ba362564b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116064) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 13:12:47.110972 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: INFO nova.api.openstack.requestlog [None req-a8acabb0-1380-4d20-8f31-41892576065a tempest-TestVolumeBootPattern-232608497 tempest-TestVolumeBootPattern-232608497-project] 10.222.0.49 "GET /compute/v2.1/servers/86c97e97-93e7-40dc-9bcb-b2cf281f4374" status: 200 len: 1266 microversion: 2.1 time: 0.168088 Dec 14 13:12:47.111479 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: [pid: 116064|app: 0|req: 568/1159] 10.222.0.49 () {58 vars in 1235 bytes} [Tue Dec 14 13:12:46 2021] GET /compute/v2.1/servers/86c97e97-93e7-40dc-9bcb-b2cf281f4374 => generated 1266 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 14 13:12:48.134744 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.api.openstack.wsgi [None req-1c656b7b-72f4-40a1-80f3-4b1066dc70d0 tempest-TestVolumeBootPattern-232608497 tempest-TestVolumeBootPattern-232608497-project] Calling method '>' {{(pid=116063) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 13:12:48.135553 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.compute.api [None req-1c656b7b-72f4-40a1-80f3-4b1066dc70d0 tempest-TestVolumeBootPattern-232608497 tempest-TestVolumeBootPattern-232608497-project] [instance: 86c97e97-93e7-40dc-9bcb-b2cf281f4374] Fetching instance by UUID {{(pid=116063) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 13:12:48.143919 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-1c656b7b-72f4-40a1-80f3-4b1066dc70d0 tempest-TestVolumeBootPattern-232608497 tempest-TestVolumeBootPattern-232608497-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 13:12:48.144267 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-1c656b7b-72f4-40a1-80f3-4b1066dc70d0 tempest-TestVolumeBootPattern-232608497 tempest-TestVolumeBootPattern-232608497-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 13:12:48.145211 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-1c656b7b-72f4-40a1-80f3-4b1066dc70d0 tempest-TestVolumeBootPattern-232608497 tempest-TestVolumeBootPattern-232608497-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 13:12:48.145708 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-1c656b7b-72f4-40a1-80f3-4b1066dc70d0 tempest-TestVolumeBootPattern-232608497 tempest-TestVolumeBootPattern-232608497-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 13:12:48.284066 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.policy [None req-1c656b7b-72f4-40a1-80f3-4b1066dc70d0 tempest-TestVolumeBootPattern-232608497 tempest-TestVolumeBootPattern-232608497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94008a0d97204aff87f20bdeadbdd783', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b854de8019ad4a598587133ba362564b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116063) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 13:12:48.292124 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: INFO nova.api.openstack.requestlog [None req-1c656b7b-72f4-40a1-80f3-4b1066dc70d0 tempest-TestVolumeBootPattern-232608497 tempest-TestVolumeBootPattern-232608497-project] 10.222.0.49 "GET /compute/v2.1/servers/86c97e97-93e7-40dc-9bcb-b2cf281f4374" status: 200 len: 1266 microversion: 2.1 time: 0.163679 Dec 14 13:12:48.292798 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: [pid: 116063|app: 0|req: 592/1160] 10.222.0.49 () {58 vars in 1235 bytes} [Tue Dec 14 13:12:48 2021] GET /compute/v2.1/servers/86c97e97-93e7-40dc-9bcb-b2cf281f4374 => generated 1266 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 14 13:12:49.313280 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.api.openstack.wsgi [None req-1c7f5a56-1393-4a98-b7a9-59f3611ff245 tempest-TestVolumeBootPattern-232608497 tempest-TestVolumeBootPattern-232608497-project] Calling method '>' {{(pid=116064) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 13:12:49.314405 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.compute.api [None req-1c7f5a56-1393-4a98-b7a9-59f3611ff245 tempest-TestVolumeBootPattern-232608497 tempest-TestVolumeBootPattern-232608497-project] [instance: 86c97e97-93e7-40dc-9bcb-b2cf281f4374] Fetching instance by UUID {{(pid=116064) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 13:12:49.325266 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-1c7f5a56-1393-4a98-b7a9-59f3611ff245 tempest-TestVolumeBootPattern-232608497 tempest-TestVolumeBootPattern-232608497-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 13:12:49.326029 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-1c7f5a56-1393-4a98-b7a9-59f3611ff245 tempest-TestVolumeBootPattern-232608497 tempest-TestVolumeBootPattern-232608497-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 13:12:49.327314 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-1c7f5a56-1393-4a98-b7a9-59f3611ff245 tempest-TestVolumeBootPattern-232608497 tempest-TestVolumeBootPattern-232608497-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 13:12:49.328038 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-1c7f5a56-1393-4a98-b7a9-59f3611ff245 tempest-TestVolumeBootPattern-232608497 tempest-TestVolumeBootPattern-232608497-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 13:12:49.468219 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.policy [None req-1c7f5a56-1393-4a98-b7a9-59f3611ff245 tempest-TestVolumeBootPattern-232608497 tempest-TestVolumeBootPattern-232608497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94008a0d97204aff87f20bdeadbdd783', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b854de8019ad4a598587133ba362564b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116064) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 13:12:49.476235 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: INFO nova.api.openstack.requestlog [None req-1c7f5a56-1393-4a98-b7a9-59f3611ff245 tempest-TestVolumeBootPattern-232608497 tempest-TestVolumeBootPattern-232608497-project] 10.222.0.49 "GET /compute/v2.1/servers/86c97e97-93e7-40dc-9bcb-b2cf281f4374" status: 200 len: 1266 microversion: 2.1 time: 0.169295 Dec 14 13:12:49.476767 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: [pid: 116064|app: 0|req: 569/1161] 10.222.0.49 () {58 vars in 1235 bytes} [Tue Dec 14 13:12:49 2021] GET /compute/v2.1/servers/86c97e97-93e7-40dc-9bcb-b2cf281f4374 => generated 1266 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 14 13:12:50.501842 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.api.openstack.wsgi [None req-b0dbd8f8-141e-46d5-9b86-30f322af60ab tempest-TestVolumeBootPattern-232608497 tempest-TestVolumeBootPattern-232608497-project] Calling method '>' {{(pid=116063) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 13:12:50.502676 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.compute.api [None req-b0dbd8f8-141e-46d5-9b86-30f322af60ab tempest-TestVolumeBootPattern-232608497 tempest-TestVolumeBootPattern-232608497-project] [instance: 86c97e97-93e7-40dc-9bcb-b2cf281f4374] Fetching instance by UUID {{(pid=116063) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 13:12:50.512511 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-b0dbd8f8-141e-46d5-9b86-30f322af60ab tempest-TestVolumeBootPattern-232608497 tempest-TestVolumeBootPattern-232608497-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 13:12:50.512987 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-b0dbd8f8-141e-46d5-9b86-30f322af60ab tempest-TestVolumeBootPattern-232608497 tempest-TestVolumeBootPattern-232608497-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 13:12:50.513776 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-b0dbd8f8-141e-46d5-9b86-30f322af60ab tempest-TestVolumeBootPattern-232608497 tempest-TestVolumeBootPattern-232608497-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 13:12:50.514202 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-b0dbd8f8-141e-46d5-9b86-30f322af60ab tempest-TestVolumeBootPattern-232608497 tempest-TestVolumeBootPattern-232608497-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 13:12:50.660813 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.policy [None req-b0dbd8f8-141e-46d5-9b86-30f322af60ab tempest-TestVolumeBootPattern-232608497 tempest-TestVolumeBootPattern-232608497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94008a0d97204aff87f20bdeadbdd783', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b854de8019ad4a598587133ba362564b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116063) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 13:12:50.668966 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: INFO nova.api.openstack.requestlog [None req-b0dbd8f8-141e-46d5-9b86-30f322af60ab tempest-TestVolumeBootPattern-232608497 tempest-TestVolumeBootPattern-232608497-project] 10.222.0.49 "GET /compute/v2.1/servers/86c97e97-93e7-40dc-9bcb-b2cf281f4374" status: 200 len: 1266 microversion: 2.1 time: 0.173380 Dec 14 13:12:50.669571 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: [pid: 116063|app: 0|req: 593/1162] 10.222.0.49 () {58 vars in 1235 bytes} [Tue Dec 14 13:12:50 2021] GET /compute/v2.1/servers/86c97e97-93e7-40dc-9bcb-b2cf281f4374 => generated 1266 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 14 13:12:51.686440 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.api.openstack.wsgi [None req-9da67e17-c6f4-4ff0-9ddf-f695de0704d0 tempest-TestVolumeBootPattern-232608497 tempest-TestVolumeBootPattern-232608497-project] Calling method '>' {{(pid=116064) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 13:12:51.687286 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.compute.api [None req-9da67e17-c6f4-4ff0-9ddf-f695de0704d0 tempest-TestVolumeBootPattern-232608497 tempest-TestVolumeBootPattern-232608497-project] [instance: 86c97e97-93e7-40dc-9bcb-b2cf281f4374] Fetching instance by UUID {{(pid=116064) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 13:12:51.697098 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-9da67e17-c6f4-4ff0-9ddf-f695de0704d0 tempest-TestVolumeBootPattern-232608497 tempest-TestVolumeBootPattern-232608497-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 13:12:51.697804 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-9da67e17-c6f4-4ff0-9ddf-f695de0704d0 tempest-TestVolumeBootPattern-232608497 tempest-TestVolumeBootPattern-232608497-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 13:12:51.699057 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-9da67e17-c6f4-4ff0-9ddf-f695de0704d0 tempest-TestVolumeBootPattern-232608497 tempest-TestVolumeBootPattern-232608497-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 13:12:51.699747 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-9da67e17-c6f4-4ff0-9ddf-f695de0704d0 tempest-TestVolumeBootPattern-232608497 tempest-TestVolumeBootPattern-232608497-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 13:12:51.838276 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.policy [None req-9da67e17-c6f4-4ff0-9ddf-f695de0704d0 tempest-TestVolumeBootPattern-232608497 tempest-TestVolumeBootPattern-232608497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94008a0d97204aff87f20bdeadbdd783', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b854de8019ad4a598587133ba362564b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116064) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 13:12:51.846439 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: INFO nova.api.openstack.requestlog [None req-9da67e17-c6f4-4ff0-9ddf-f695de0704d0 tempest-TestVolumeBootPattern-232608497 tempest-TestVolumeBootPattern-232608497-project] 10.222.0.49 "GET /compute/v2.1/servers/86c97e97-93e7-40dc-9bcb-b2cf281f4374" status: 200 len: 1266 microversion: 2.1 time: 0.165010 Dec 14 13:12:51.847017 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: [pid: 116064|app: 0|req: 570/1163] 10.222.0.49 () {58 vars in 1235 bytes} [Tue Dec 14 13:12:51 2021] GET /compute/v2.1/servers/86c97e97-93e7-40dc-9bcb-b2cf281f4374 => generated 1266 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 14 13:12:52.863611 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.api.openstack.wsgi [None req-3bd4c3be-6d24-4c91-a90d-01135c6da982 tempest-TestVolumeBootPattern-232608497 tempest-TestVolumeBootPattern-232608497-project] Calling method '>' {{(pid=116063) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 13:12:52.864233 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.compute.api [None req-3bd4c3be-6d24-4c91-a90d-01135c6da982 tempest-TestVolumeBootPattern-232608497 tempest-TestVolumeBootPattern-232608497-project] [instance: 86c97e97-93e7-40dc-9bcb-b2cf281f4374] Fetching instance by UUID {{(pid=116063) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 13:12:52.871141 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-3bd4c3be-6d24-4c91-a90d-01135c6da982 tempest-TestVolumeBootPattern-232608497 tempest-TestVolumeBootPattern-232608497-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 13:12:52.871598 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-3bd4c3be-6d24-4c91-a90d-01135c6da982 tempest-TestVolumeBootPattern-232608497 tempest-TestVolumeBootPattern-232608497-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 13:12:52.872352 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-3bd4c3be-6d24-4c91-a90d-01135c6da982 tempest-TestVolumeBootPattern-232608497 tempest-TestVolumeBootPattern-232608497-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 13:12:52.872766 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-3bd4c3be-6d24-4c91-a90d-01135c6da982 tempest-TestVolumeBootPattern-232608497 tempest-TestVolumeBootPattern-232608497-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 13:12:53.015405 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.policy [None req-3bd4c3be-6d24-4c91-a90d-01135c6da982 tempest-TestVolumeBootPattern-232608497 tempest-TestVolumeBootPattern-232608497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94008a0d97204aff87f20bdeadbdd783', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b854de8019ad4a598587133ba362564b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116063) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 13:12:53.023893 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: INFO nova.api.openstack.requestlog [None req-3bd4c3be-6d24-4c91-a90d-01135c6da982 tempest-TestVolumeBootPattern-232608497 tempest-TestVolumeBootPattern-232608497-project] 10.222.0.49 "GET /compute/v2.1/servers/86c97e97-93e7-40dc-9bcb-b2cf281f4374" status: 200 len: 1266 microversion: 2.1 time: 0.163968 Dec 14 13:12:53.024366 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: [pid: 116063|app: 0|req: 594/1164] 10.222.0.49 () {58 vars in 1235 bytes} [Tue Dec 14 13:12:52 2021] GET /compute/v2.1/servers/86c97e97-93e7-40dc-9bcb-b2cf281f4374 => generated 1266 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 14 13:12:53.136578 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.api.openstack.wsgi [req-964de790-8fc3-4fb6-b629-70fdc9962240 req-ec9961c0-21fd-4e3b-a13e-97b09764e906 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "86c97e97-93e7-40dc-9bcb-b2cf281f4374", "name": "network-vif-plugged", "status": "completed", "tag": "76fa7e39-7900-423e-94b0-185970c0230d"}]} {{(pid=116064) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 14 13:12:53.138765 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 14 13:12:53.138765 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: warnings.warn(msg) Dec 14 13:12:53.146399 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [req-964de790-8fc3-4fb6-b629-70fdc9962240 req-ec9961c0-21fd-4e3b-a13e-97b09764e906 service nova] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 13:12:53.146865 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [req-964de790-8fc3-4fb6-b629-70fdc9962240 req-ec9961c0-21fd-4e3b-a13e-97b09764e906 service nova] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 13:12:53.159144 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: INFO nova.api.openstack.compute.server_external_events [req-964de790-8fc3-4fb6-b629-70fdc9962240 req-ec9961c0-21fd-4e3b-a13e-97b09764e906 service nova] Creating event network-vif-plugged:76fa7e39-7900-423e-94b0-185970c0230d for instance 86c97e97-93e7-40dc-9bcb-b2cf281f4374 on hv-cinder-78447 Dec 14 13:12:53.164295 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: INFO nova.api.openstack.requestlog [req-964de790-8fc3-4fb6-b629-70fdc9962240 req-ec9961c0-21fd-4e3b-a13e-97b09764e906 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031361 Dec 14 13:12:53.164886 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: [pid: 116064|app: 0|req: 571/1165] 10.222.0.49 () {64 vars in 1317 bytes} [Tue Dec 14 13:12:53 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 14 13:12:54.044048 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.api.openstack.wsgi [None req-a774c8c6-7b61-4e2f-a959-05a8ece98981 tempest-TestVolumeBootPattern-232608497 tempest-TestVolumeBootPattern-232608497-project] Calling method '>' {{(pid=116063) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 13:12:54.044688 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.compute.api [None req-a774c8c6-7b61-4e2f-a959-05a8ece98981 tempest-TestVolumeBootPattern-232608497 tempest-TestVolumeBootPattern-232608497-project] [instance: 86c97e97-93e7-40dc-9bcb-b2cf281f4374] Fetching instance by UUID {{(pid=116063) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 13:12:54.051621 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-a774c8c6-7b61-4e2f-a959-05a8ece98981 tempest-TestVolumeBootPattern-232608497 tempest-TestVolumeBootPattern-232608497-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 13:12:54.052136 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-a774c8c6-7b61-4e2f-a959-05a8ece98981 tempest-TestVolumeBootPattern-232608497 tempest-TestVolumeBootPattern-232608497-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 13:12:54.053006 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-a774c8c6-7b61-4e2f-a959-05a8ece98981 tempest-TestVolumeBootPattern-232608497 tempest-TestVolumeBootPattern-232608497-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 13:12:54.053436 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-a774c8c6-7b61-4e2f-a959-05a8ece98981 tempest-TestVolumeBootPattern-232608497 tempest-TestVolumeBootPattern-232608497-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 13:12:54.190529 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.policy [None req-a774c8c6-7b61-4e2f-a959-05a8ece98981 tempest-TestVolumeBootPattern-232608497 tempest-TestVolumeBootPattern-232608497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94008a0d97204aff87f20bdeadbdd783', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b854de8019ad4a598587133ba362564b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116063) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 13:12:54.198567 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: INFO nova.api.openstack.requestlog [None req-a774c8c6-7b61-4e2f-a959-05a8ece98981 tempest-TestVolumeBootPattern-232608497 tempest-TestVolumeBootPattern-232608497-project] 10.222.0.49 "GET /compute/v2.1/servers/86c97e97-93e7-40dc-9bcb-b2cf281f4374" status: 200 len: 1266 microversion: 2.1 time: 0.159848 Dec 14 13:12:54.199146 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: [pid: 116063|app: 0|req: 595/1166] 10.222.0.49 () {58 vars in 1235 bytes} [Tue Dec 14 13:12:54 2021] GET /compute/v2.1/servers/86c97e97-93e7-40dc-9bcb-b2cf281f4374 => generated 1266 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 14 13:12:55.221416 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.api.openstack.wsgi [None req-e9532920-1dc2-4325-bbc1-c7e990398060 tempest-TestVolumeBootPattern-232608497 tempest-TestVolumeBootPattern-232608497-project] Calling method '>' {{(pid=116064) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 13:12:55.222441 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.compute.api [None req-e9532920-1dc2-4325-bbc1-c7e990398060 tempest-TestVolumeBootPattern-232608497 tempest-TestVolumeBootPattern-232608497-project] [instance: 86c97e97-93e7-40dc-9bcb-b2cf281f4374] Fetching instance by UUID {{(pid=116064) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 13:12:55.233193 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-e9532920-1dc2-4325-bbc1-c7e990398060 tempest-TestVolumeBootPattern-232608497 tempest-TestVolumeBootPattern-232608497-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 13:12:55.233935 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-e9532920-1dc2-4325-bbc1-c7e990398060 tempest-TestVolumeBootPattern-232608497 tempest-TestVolumeBootPattern-232608497-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 13:12:55.235207 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-e9532920-1dc2-4325-bbc1-c7e990398060 tempest-TestVolumeBootPattern-232608497 tempest-TestVolumeBootPattern-232608497-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 13:12:55.235895 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-e9532920-1dc2-4325-bbc1-c7e990398060 tempest-TestVolumeBootPattern-232608497 tempest-TestVolumeBootPattern-232608497-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 13:12:55.383872 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.policy [None req-e9532920-1dc2-4325-bbc1-c7e990398060 tempest-TestVolumeBootPattern-232608497 tempest-TestVolumeBootPattern-232608497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94008a0d97204aff87f20bdeadbdd783', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b854de8019ad4a598587133ba362564b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116064) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 13:12:55.393276 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: INFO nova.api.openstack.requestlog [None req-e9532920-1dc2-4325-bbc1-c7e990398060 tempest-TestVolumeBootPattern-232608497 tempest-TestVolumeBootPattern-232608497-project] 10.222.0.49 "GET /compute/v2.1/servers/86c97e97-93e7-40dc-9bcb-b2cf281f4374" status: 200 len: 1454 microversion: 2.1 time: 0.179864 Dec 14 13:12:55.393843 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: [pid: 116064|app: 0|req: 572/1167] 10.222.0.49 () {58 vars in 1235 bytes} [Tue Dec 14 13:12:55 2021] GET /compute/v2.1/servers/86c97e97-93e7-40dc-9bcb-b2cf281f4374 => generated 1454 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 14 13:12:55.414041 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.api.openstack.wsgi [None req-ab7ac5d7-a11d-4a1f-92dd-47d97fcc62c9 tempest-TestVolumeBootPattern-232608497 tempest-TestVolumeBootPattern-232608497-project] Calling method '>' {{(pid=116063) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 13:12:55.414657 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.compute.api [None req-ab7ac5d7-a11d-4a1f-92dd-47d97fcc62c9 tempest-TestVolumeBootPattern-232608497 tempest-TestVolumeBootPattern-232608497-project] [instance: 86c97e97-93e7-40dc-9bcb-b2cf281f4374] Fetching instance by UUID {{(pid=116063) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 13:12:55.424166 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-ab7ac5d7-a11d-4a1f-92dd-47d97fcc62c9 tempest-TestVolumeBootPattern-232608497 tempest-TestVolumeBootPattern-232608497-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 13:12:55.424766 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-ab7ac5d7-a11d-4a1f-92dd-47d97fcc62c9 tempest-TestVolumeBootPattern-232608497 tempest-TestVolumeBootPattern-232608497-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 13:12:55.425988 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-ab7ac5d7-a11d-4a1f-92dd-47d97fcc62c9 tempest-TestVolumeBootPattern-232608497 tempest-TestVolumeBootPattern-232608497-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 13:12:55.426572 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-ab7ac5d7-a11d-4a1f-92dd-47d97fcc62c9 tempest-TestVolumeBootPattern-232608497 tempest-TestVolumeBootPattern-232608497-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 13:12:55.571490 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.policy [None req-ab7ac5d7-a11d-4a1f-92dd-47d97fcc62c9 tempest-TestVolumeBootPattern-232608497 tempest-TestVolumeBootPattern-232608497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94008a0d97204aff87f20bdeadbdd783', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b854de8019ad4a598587133ba362564b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116063) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 13:12:55.578933 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: INFO nova.api.openstack.requestlog [None req-ab7ac5d7-a11d-4a1f-92dd-47d97fcc62c9 tempest-TestVolumeBootPattern-232608497 tempest-TestVolumeBootPattern-232608497-project] 10.222.0.49 "GET /compute/v2.1/servers/86c97e97-93e7-40dc-9bcb-b2cf281f4374" status: 200 len: 1454 microversion: 2.1 time: 0.170765 Dec 14 13:12:55.579499 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: [pid: 116063|app: 0|req: 596/1168] 10.222.0.49 () {58 vars in 1235 bytes} [Tue Dec 14 13:12:55 2021] GET /compute/v2.1/servers/86c97e97-93e7-40dc-9bcb-b2cf281f4374 => generated 1454 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 14 13:12:57.453808 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.api.openstack.wsgi [req-b722165a-e17e-48c5-aab1-1511097aa968 req-69916abc-2ead-499d-b783-6b2b256115ff service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "86c97e97-93e7-40dc-9bcb-b2cf281f4374", "tag": "76fa7e39-7900-423e-94b0-185970c0230d"}]} {{(pid=116064) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 14 13:12:57.455355 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 14 13:12:57.455355 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: warnings.warn(msg) Dec 14 13:12:57.463215 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [req-b722165a-e17e-48c5-aab1-1511097aa968 req-69916abc-2ead-499d-b783-6b2b256115ff service nova] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 13:12:57.463653 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [req-b722165a-e17e-48c5-aab1-1511097aa968 req-69916abc-2ead-499d-b783-6b2b256115ff service nova] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 13:12:57.476325 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: INFO nova.api.openstack.compute.server_external_events [req-b722165a-e17e-48c5-aab1-1511097aa968 req-69916abc-2ead-499d-b783-6b2b256115ff service nova] Creating event network-changed:76fa7e39-7900-423e-94b0-185970c0230d for instance 86c97e97-93e7-40dc-9bcb-b2cf281f4374 on hv-cinder-78447 Dec 14 13:12:57.481369 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: INFO nova.api.openstack.requestlog [req-b722165a-e17e-48c5-aab1-1511097aa968 req-69916abc-2ead-499d-b783-6b2b256115ff service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031373 Dec 14 13:12:57.482306 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: [pid: 116064|app: 0|req: 573/1169] 10.222.0.49 () {64 vars in 1317 bytes} [Tue Dec 14 13:12:57 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 14 13:13:06.647824 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Dec 14 13:13:06.648569 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: Tue Dec 14 13:13:06 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Dec 14 13:13:15.256191 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Dec 14 13:13:15.257218 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: Tue Dec 14 13:13:15 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Dec 14 13:13:57.111681 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Dec 14 13:13:57.112520 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: Tue Dec 14 13:13:57 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Dec 14 13:14:37.004395 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.api.openstack.wsgi [None req-9d12cc97-9918-4b12-a849-1620805d1374 tempest-TestVolumeBootPattern-232608497 tempest-TestVolumeBootPattern-232608497-project] Calling method '>' {{(pid=116063) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 13:14:37.004975 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.compute.api [None req-9d12cc97-9918-4b12-a849-1620805d1374 tempest-TestVolumeBootPattern-232608497 tempest-TestVolumeBootPattern-232608497-project] [instance: 86c97e97-93e7-40dc-9bcb-b2cf281f4374] Fetching instance by UUID {{(pid=116063) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 13:14:37.011471 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-9d12cc97-9918-4b12-a849-1620805d1374 tempest-TestVolumeBootPattern-232608497 tempest-TestVolumeBootPattern-232608497-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 13:14:37.011910 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-9d12cc97-9918-4b12-a849-1620805d1374 tempest-TestVolumeBootPattern-232608497 tempest-TestVolumeBootPattern-232608497-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 13:14:37.012689 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-9d12cc97-9918-4b12-a849-1620805d1374 tempest-TestVolumeBootPattern-232608497 tempest-TestVolumeBootPattern-232608497-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 13:14:37.013355 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-9d12cc97-9918-4b12-a849-1620805d1374 tempest-TestVolumeBootPattern-232608497 tempest-TestVolumeBootPattern-232608497-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 13:14:37.038834 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.compute.api [None req-9d12cc97-9918-4b12-a849-1620805d1374 tempest-TestVolumeBootPattern-232608497 tempest-TestVolumeBootPattern-232608497-project] [instance: 86c97e97-93e7-40dc-9bcb-b2cf281f4374] Going to try to terminate instance {{(pid=116063) delete /opt/stack/nova/nova/compute/api.py:2614}} Dec 14 13:14:37.121449 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: INFO nova.api.openstack.requestlog [None req-9d12cc97-9918-4b12-a849-1620805d1374 tempest-TestVolumeBootPattern-232608497 tempest-TestVolumeBootPattern-232608497-project] 10.222.0.49 "DELETE /compute/v2.1/servers/86c97e97-93e7-40dc-9bcb-b2cf281f4374" status: 204 len: 0 microversion: 2.1 time: 0.121574 Dec 14 13:14:37.123776 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: [pid: 116063|app: 0|req: 597/1170] 10.222.0.49 () {58 vars in 1238 bytes} [Tue Dec 14 13:14:36 2021] DELETE /compute/v2.1/servers/86c97e97-93e7-40dc-9bcb-b2cf281f4374 => generated 0 bytes in 125 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Dec 14 13:14:37.132378 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.api.openstack.wsgi [None req-395649bf-0670-404c-a24b-aac0faeb29d3 tempest-TestVolumeBootPattern-232608497 tempest-TestVolumeBootPattern-232608497-project] Calling method '>' {{(pid=116063) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 13:14:37.133094 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.compute.api [None req-395649bf-0670-404c-a24b-aac0faeb29d3 tempest-TestVolumeBootPattern-232608497 tempest-TestVolumeBootPattern-232608497-project] [instance: 86c97e97-93e7-40dc-9bcb-b2cf281f4374] Fetching instance by UUID {{(pid=116063) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 13:14:37.139000 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-395649bf-0670-404c-a24b-aac0faeb29d3 tempest-TestVolumeBootPattern-232608497 tempest-TestVolumeBootPattern-232608497-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 13:14:37.139401 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-395649bf-0670-404c-a24b-aac0faeb29d3 tempest-TestVolumeBootPattern-232608497 tempest-TestVolumeBootPattern-232608497-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 13:14:37.140210 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-395649bf-0670-404c-a24b-aac0faeb29d3 tempest-TestVolumeBootPattern-232608497 tempest-TestVolumeBootPattern-232608497-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 13:14:37.140642 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-395649bf-0670-404c-a24b-aac0faeb29d3 tempest-TestVolumeBootPattern-232608497 tempest-TestVolumeBootPattern-232608497-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 13:14:37.157065 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.api.openstack.wsgi [req-9849ef5f-83cf-49f5-af5e-95a772c27a83 req-8f287ad4-5ab3-4607-9f98-d517949ace3a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "86c97e97-93e7-40dc-9bcb-b2cf281f4374", "tag": "76fa7e39-7900-423e-94b0-185970c0230d"}]} {{(pid=116064) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 14 13:14:37.158788 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 14 13:14:37.158788 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: warnings.warn(msg) Dec 14 13:14:37.166567 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [req-9849ef5f-83cf-49f5-af5e-95a772c27a83 req-8f287ad4-5ab3-4607-9f98-d517949ace3a service nova] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 13:14:37.167002 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [req-9849ef5f-83cf-49f5-af5e-95a772c27a83 req-8f287ad4-5ab3-4607-9f98-d517949ace3a service nova] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 13:14:37.177363 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: INFO nova.api.openstack.compute.server_external_events [req-9849ef5f-83cf-49f5-af5e-95a772c27a83 req-8f287ad4-5ab3-4607-9f98-d517949ace3a service nova] Creating event network-changed:76fa7e39-7900-423e-94b0-185970c0230d for instance 86c97e97-93e7-40dc-9bcb-b2cf281f4374 on hv-cinder-78447 Dec 14 13:14:37.182810 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: INFO nova.api.openstack.requestlog [req-9849ef5f-83cf-49f5-af5e-95a772c27a83 req-8f287ad4-5ab3-4607-9f98-d517949ace3a service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.180585 Dec 14 13:14:37.183742 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: [pid: 116064|app: 0|req: 574/1171] 10.222.0.49 () {64 vars in 1317 bytes} [Tue Dec 14 13:14:37 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 14 13:14:37.333744 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.policy [None req-395649bf-0670-404c-a24b-aac0faeb29d3 tempest-TestVolumeBootPattern-232608497 tempest-TestVolumeBootPattern-232608497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94008a0d97204aff87f20bdeadbdd783', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b854de8019ad4a598587133ba362564b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116063) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 13:14:37.341095 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: INFO nova.api.openstack.requestlog [None req-395649bf-0670-404c-a24b-aac0faeb29d3 tempest-TestVolumeBootPattern-232608497 tempest-TestVolumeBootPattern-232608497-project] 10.222.0.49 "GET /compute/v2.1/servers/86c97e97-93e7-40dc-9bcb-b2cf281f4374" status: 200 len: 1579 microversion: 2.1 time: 0.212755 Dec 14 13:14:37.348971 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: [pid: 116063|app: 0|req: 598/1172] 10.222.0.49 () {58 vars in 1235 bytes} [Tue Dec 14 13:14:37 2021] GET /compute/v2.1/servers/86c97e97-93e7-40dc-9bcb-b2cf281f4374 => generated 1579 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 14 13:14:38.363273 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.api.openstack.wsgi [None req-aefaa5b2-298b-40fd-b861-2287f7ff12e4 tempest-TestVolumeBootPattern-232608497 tempest-TestVolumeBootPattern-232608497-project] Calling method '>' {{(pid=116064) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 13:14:38.364289 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.compute.api [None req-aefaa5b2-298b-40fd-b861-2287f7ff12e4 tempest-TestVolumeBootPattern-232608497 tempest-TestVolumeBootPattern-232608497-project] [instance: 86c97e97-93e7-40dc-9bcb-b2cf281f4374] Fetching instance by UUID {{(pid=116064) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 13:14:38.374833 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-aefaa5b2-298b-40fd-b861-2287f7ff12e4 tempest-TestVolumeBootPattern-232608497 tempest-TestVolumeBootPattern-232608497-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 13:14:38.375533 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-aefaa5b2-298b-40fd-b861-2287f7ff12e4 tempest-TestVolumeBootPattern-232608497 tempest-TestVolumeBootPattern-232608497-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 13:14:38.376834 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-aefaa5b2-298b-40fd-b861-2287f7ff12e4 tempest-TestVolumeBootPattern-232608497 tempest-TestVolumeBootPattern-232608497-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 13:14:38.377657 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-aefaa5b2-298b-40fd-b861-2287f7ff12e4 tempest-TestVolumeBootPattern-232608497 tempest-TestVolumeBootPattern-232608497-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 13:14:38.573783 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.policy [None req-aefaa5b2-298b-40fd-b861-2287f7ff12e4 tempest-TestVolumeBootPattern-232608497 tempest-TestVolumeBootPattern-232608497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94008a0d97204aff87f20bdeadbdd783', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b854de8019ad4a598587133ba362564b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116064) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 13:14:38.581348 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: INFO nova.api.openstack.requestlog [None req-aefaa5b2-298b-40fd-b861-2287f7ff12e4 tempest-TestVolumeBootPattern-232608497 tempest-TestVolumeBootPattern-232608497-project] 10.222.0.49 "GET /compute/v2.1/servers/86c97e97-93e7-40dc-9bcb-b2cf281f4374" status: 200 len: 1460 microversion: 2.1 time: 0.225684 Dec 14 13:14:38.581914 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: [pid: 116064|app: 0|req: 575/1173] 10.222.0.49 () {58 vars in 1235 bytes} [Tue Dec 14 13:14:38 2021] GET /compute/v2.1/servers/86c97e97-93e7-40dc-9bcb-b2cf281f4374 => generated 1460 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 14 13:14:39.208510 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.api.openstack.wsgi [req-a278bc3b-d611-4760-a0bb-cf20f96829e0 req-6ee06ccc-0a8f-4912-ba91-50731c95608c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "86c97e97-93e7-40dc-9bcb-b2cf281f4374", "name": "network-vif-deleted", "tag": "76fa7e39-7900-423e-94b0-185970c0230d"}]} {{(pid=116063) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 14 13:14:39.210459 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 14 13:14:39.210459 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: warnings.warn(msg) Dec 14 13:14:39.219646 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [req-a278bc3b-d611-4760-a0bb-cf20f96829e0 req-6ee06ccc-0a8f-4912-ba91-50731c95608c service nova] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 13:14:39.220094 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [req-a278bc3b-d611-4760-a0bb-cf20f96829e0 req-6ee06ccc-0a8f-4912-ba91-50731c95608c service nova] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 13:14:39.232262 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: INFO nova.api.openstack.compute.server_external_events [req-a278bc3b-d611-4760-a0bb-cf20f96829e0 req-6ee06ccc-0a8f-4912-ba91-50731c95608c service nova] Creating event network-vif-deleted:76fa7e39-7900-423e-94b0-185970c0230d for instance 86c97e97-93e7-40dc-9bcb-b2cf281f4374 on hv-cinder-78447 Dec 14 13:14:39.237289 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: INFO nova.api.openstack.requestlog [req-a278bc3b-d611-4760-a0bb-cf20f96829e0 req-6ee06ccc-0a8f-4912-ba91-50731c95608c service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032546 Dec 14 13:14:39.237885 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: [pid: 116063|app: 0|req: 599/1174] 10.222.0.49 () {64 vars in 1317 bytes} [Tue Dec 14 13:14:39 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 14 13:14:39.598026 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.api.openstack.wsgi [None req-f76c90e2-6060-4382-ab8e-81a9cc1af792 tempest-TestVolumeBootPattern-232608497 tempest-TestVolumeBootPattern-232608497-project] Calling method '>' {{(pid=116064) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 13:14:39.598633 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.compute.api [None req-f76c90e2-6060-4382-ab8e-81a9cc1af792 tempest-TestVolumeBootPattern-232608497 tempest-TestVolumeBootPattern-232608497-project] [instance: 86c97e97-93e7-40dc-9bcb-b2cf281f4374] Fetching instance by UUID {{(pid=116064) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 13:14:39.605366 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-f76c90e2-6060-4382-ab8e-81a9cc1af792 tempest-TestVolumeBootPattern-232608497 tempest-TestVolumeBootPattern-232608497-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 13:14:39.605820 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-f76c90e2-6060-4382-ab8e-81a9cc1af792 tempest-TestVolumeBootPattern-232608497 tempest-TestVolumeBootPattern-232608497-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 13:14:39.606606 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-f76c90e2-6060-4382-ab8e-81a9cc1af792 tempest-TestVolumeBootPattern-232608497 tempest-TestVolumeBootPattern-232608497-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 13:14:39.607040 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-f76c90e2-6060-4382-ab8e-81a9cc1af792 tempest-TestVolumeBootPattern-232608497 tempest-TestVolumeBootPattern-232608497-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 13:14:39.638675 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-f76c90e2-6060-4382-ab8e-81a9cc1af792 tempest-TestVolumeBootPattern-232608497 tempest-TestVolumeBootPattern-232608497-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 13:14:39.639125 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-f76c90e2-6060-4382-ab8e-81a9cc1af792 tempest-TestVolumeBootPattern-232608497 tempest-TestVolumeBootPattern-232608497-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 13:14:39.639568 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.objects.instance [None req-f76c90e2-6060-4382-ab8e-81a9cc1af792 tempest-TestVolumeBootPattern-232608497 tempest-TestVolumeBootPattern-232608497-project] Lazy-loading 'fault' on Instance uuid 86c97e97-93e7-40dc-9bcb-b2cf281f4374 {{(pid=116064) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Dec 14 13:14:39.679463 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.policy [None req-f76c90e2-6060-4382-ab8e-81a9cc1af792 tempest-TestVolumeBootPattern-232608497 tempest-TestVolumeBootPattern-232608497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94008a0d97204aff87f20bdeadbdd783', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b854de8019ad4a598587133ba362564b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116064) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 13:14:39.686964 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: INFO nova.api.openstack.requestlog [None req-f76c90e2-6060-4382-ab8e-81a9cc1af792 tempest-TestVolumeBootPattern-232608497 tempest-TestVolumeBootPattern-232608497-project] 10.222.0.49 "GET /compute/v2.1/servers/86c97e97-93e7-40dc-9bcb-b2cf281f4374" status: 200 len: 1230 microversion: 2.1 time: 0.092967 Dec 14 13:14:39.687529 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: [pid: 116064|app: 0|req: 576/1175] 10.222.0.49 () {58 vars in 1235 bytes} [Tue Dec 14 13:14:39 2021] GET /compute/v2.1/servers/86c97e97-93e7-40dc-9bcb-b2cf281f4374 => generated 1230 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 14 13:14:40.709638 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.api.openstack.wsgi [None req-fe10f905-1b2a-417d-8b68-e6e4b20b0316 tempest-TestVolumeBootPattern-232608497 tempest-TestVolumeBootPattern-232608497-project] Calling method '>' {{(pid=116063) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 13:14:40.710735 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.compute.api [None req-fe10f905-1b2a-417d-8b68-e6e4b20b0316 tempest-TestVolumeBootPattern-232608497 tempest-TestVolumeBootPattern-232608497-project] [instance: 86c97e97-93e7-40dc-9bcb-b2cf281f4374] Fetching instance by UUID {{(pid=116063) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 13:14:40.721986 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-fe10f905-1b2a-417d-8b68-e6e4b20b0316 tempest-TestVolumeBootPattern-232608497 tempest-TestVolumeBootPattern-232608497-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 13:14:40.722605 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-fe10f905-1b2a-417d-8b68-e6e4b20b0316 tempest-TestVolumeBootPattern-232608497 tempest-TestVolumeBootPattern-232608497-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 13:14:40.723857 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-fe10f905-1b2a-417d-8b68-e6e4b20b0316 tempest-TestVolumeBootPattern-232608497 tempest-TestVolumeBootPattern-232608497-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 13:14:40.724948 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-fe10f905-1b2a-417d-8b68-e6e4b20b0316 tempest-TestVolumeBootPattern-232608497 tempest-TestVolumeBootPattern-232608497-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 13:14:40.745287 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: INFO nova.api.openstack.wsgi [None req-fe10f905-1b2a-417d-8b68-e6e4b20b0316 tempest-TestVolumeBootPattern-232608497 tempest-TestVolumeBootPattern-232608497-project] HTTP exception thrown: Instance 86c97e97-93e7-40dc-9bcb-b2cf281f4374 could not be found. Dec 14 13:14:40.745862 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.api.openstack.wsgi [None req-fe10f905-1b2a-417d-8b68-e6e4b20b0316 tempest-TestVolumeBootPattern-232608497 tempest-TestVolumeBootPattern-232608497-project] Returning 404 to user: Instance 86c97e97-93e7-40dc-9bcb-b2cf281f4374 could not be found. {{(pid=116063) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 14 13:14:40.746667 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: INFO nova.api.openstack.requestlog [None req-fe10f905-1b2a-417d-8b68-e6e4b20b0316 tempest-TestVolumeBootPattern-232608497 tempest-TestVolumeBootPattern-232608497-project] 10.222.0.49 "GET /compute/v2.1/servers/86c97e97-93e7-40dc-9bcb-b2cf281f4374" status: 404 len: 111 microversion: 2.1 time: 0.044002 Dec 14 13:14:40.747188 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: [pid: 116063|app: 0|req: 600/1176] 10.222.0.49 () {58 vars in 1235 bytes} [Tue Dec 14 13:14:40 2021] GET /compute/v2.1/servers/86c97e97-93e7-40dc-9bcb-b2cf281f4374 => generated 111 bytes in 46 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Dec 14 13:14:43.851790 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.api.openstack.wsgi [None req-a8d178f9-83f9-4a55-ac00-8305f8b750b8 tempest-TestVolumeBootPattern-232608497 tempest-TestVolumeBootPattern-232608497-project] Calling method '>' {{(pid=116064) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 13:14:43.852326 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.compute.api [None req-a8d178f9-83f9-4a55-ac00-8305f8b750b8 tempest-TestVolumeBootPattern-232608497 tempest-TestVolumeBootPattern-232608497-project] [instance: 6ffe001e-4663-4c36-8a16-5cc57d821992] Fetching instance by UUID {{(pid=116064) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 13:14:43.856590 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.api.openstack.wsgi [req-f338f707-16a0-4b54-bae9-a4b1140d7b31 req-ef709fca-e493-4ef8-baf0-4531e111244b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6ffe001e-4663-4c36-8a16-5cc57d821992", "tag": "6aec8549-7ca3-4c26-b734-050efe27049d"}]} {{(pid=116063) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 14 13:14:43.858355 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 14 13:14:43.858355 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: warnings.warn(msg) Dec 14 13:14:43.865790 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-a8d178f9-83f9-4a55-ac00-8305f8b750b8 tempest-TestVolumeBootPattern-232608497 tempest-TestVolumeBootPattern-232608497-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 13:14:43.866131 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [req-f338f707-16a0-4b54-bae9-a4b1140d7b31 req-ef709fca-e493-4ef8-baf0-4531e111244b service nova] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 13:14:43.866656 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-a8d178f9-83f9-4a55-ac00-8305f8b750b8 tempest-TestVolumeBootPattern-232608497 tempest-TestVolumeBootPattern-232608497-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 13:14:43.866808 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [req-f338f707-16a0-4b54-bae9-a4b1140d7b31 req-ef709fca-e493-4ef8-baf0-4531e111244b service nova] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 13:14:43.867467 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-a8d178f9-83f9-4a55-ac00-8305f8b750b8 tempest-TestVolumeBootPattern-232608497 tempest-TestVolumeBootPattern-232608497-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 13:14:43.867902 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-a8d178f9-83f9-4a55-ac00-8305f8b750b8 tempest-TestVolumeBootPattern-232608497 tempest-TestVolumeBootPattern-232608497-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 13:14:43.878331 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: INFO nova.api.openstack.compute.server_external_events [req-f338f707-16a0-4b54-bae9-a4b1140d7b31 req-ef709fca-e493-4ef8-baf0-4531e111244b service nova] Creating event network-changed:6aec8549-7ca3-4c26-b734-050efe27049d for instance 6ffe001e-4663-4c36-8a16-5cc57d821992 on hv-cinder-78447 Dec 14 13:14:43.883444 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: INFO nova.api.openstack.requestlog [req-f338f707-16a0-4b54-bae9-a4b1140d7b31 req-ef709fca-e493-4ef8-baf0-4531e111244b service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032681 Dec 14 13:14:43.884010 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: [pid: 116063|app: 0|req: 601/1177] 10.222.0.49 () {64 vars in 1317 bytes} [Tue Dec 14 13:14:43 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 14 13:14:43.895835 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.compute.api [None req-a8d178f9-83f9-4a55-ac00-8305f8b750b8 tempest-TestVolumeBootPattern-232608497 tempest-TestVolumeBootPattern-232608497-project] [instance: 6ffe001e-4663-4c36-8a16-5cc57d821992] Going to try to terminate instance {{(pid=116064) delete /opt/stack/nova/nova/compute/api.py:2614}} Dec 14 13:14:43.979602 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: INFO nova.api.openstack.requestlog [None req-a8d178f9-83f9-4a55-ac00-8305f8b750b8 tempest-TestVolumeBootPattern-232608497 tempest-TestVolumeBootPattern-232608497-project] 10.222.0.49 "DELETE /compute/v2.1/servers/6ffe001e-4663-4c36-8a16-5cc57d821992" status: 204 len: 0 microversion: 2.1 time: 0.130638 Dec 14 13:14:43.980598 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: [pid: 116064|app: 0|req: 577/1178] 10.222.0.49 () {58 vars in 1238 bytes} [Tue Dec 14 13:14:43 2021] DELETE /compute/v2.1/servers/6ffe001e-4663-4c36-8a16-5cc57d821992 => generated 0 bytes in 133 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Dec 14 13:14:43.989134 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.api.openstack.wsgi [None req-1f3f3ad7-576c-4225-8254-7251b78769ce tempest-TestVolumeBootPattern-232608497 tempest-TestVolumeBootPattern-232608497-project] Calling method '>' {{(pid=116063) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 13:14:43.990199 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.compute.api [None req-1f3f3ad7-576c-4225-8254-7251b78769ce tempest-TestVolumeBootPattern-232608497 tempest-TestVolumeBootPattern-232608497-project] [instance: 6ffe001e-4663-4c36-8a16-5cc57d821992] Fetching instance by UUID {{(pid=116063) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 13:14:43.996199 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-1f3f3ad7-576c-4225-8254-7251b78769ce tempest-TestVolumeBootPattern-232608497 tempest-TestVolumeBootPattern-232608497-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 13:14:43.996651 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-1f3f3ad7-576c-4225-8254-7251b78769ce tempest-TestVolumeBootPattern-232608497 tempest-TestVolumeBootPattern-232608497-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 13:14:43.997477 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-1f3f3ad7-576c-4225-8254-7251b78769ce tempest-TestVolumeBootPattern-232608497 tempest-TestVolumeBootPattern-232608497-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 13:14:43.997916 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-1f3f3ad7-576c-4225-8254-7251b78769ce tempest-TestVolumeBootPattern-232608497 tempest-TestVolumeBootPattern-232608497-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 13:14:44.142677 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.policy [None req-1f3f3ad7-576c-4225-8254-7251b78769ce tempest-TestVolumeBootPattern-232608497 tempest-TestVolumeBootPattern-232608497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94008a0d97204aff87f20bdeadbdd783', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b854de8019ad4a598587133ba362564b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116063) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 13:14:44.150760 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: INFO nova.api.openstack.requestlog [None req-1f3f3ad7-576c-4225-8254-7251b78769ce tempest-TestVolumeBootPattern-232608497 tempest-TestVolumeBootPattern-232608497-project] 10.222.0.49 "GET /compute/v2.1/servers/6ffe001e-4663-4c36-8a16-5cc57d821992" status: 200 len: 1576 microversion: 2.1 time: 0.165644 Dec 14 13:14:44.151635 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: [pid: 116063|app: 0|req: 602/1179] 10.222.0.49 () {58 vars in 1235 bytes} [Tue Dec 14 13:14:43 2021] GET /compute/v2.1/servers/6ffe001e-4663-4c36-8a16-5cc57d821992 => generated 1576 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 14 13:14:45.172928 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.api.openstack.wsgi [None req-d7b80cf9-90a3-49ed-93ed-b3ab9187d47e tempest-TestVolumeBootPattern-232608497 tempest-TestVolumeBootPattern-232608497-project] Calling method '>' {{(pid=116064) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 13:14:45.174099 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.compute.api [None req-d7b80cf9-90a3-49ed-93ed-b3ab9187d47e tempest-TestVolumeBootPattern-232608497 tempest-TestVolumeBootPattern-232608497-project] [instance: 6ffe001e-4663-4c36-8a16-5cc57d821992] Fetching instance by UUID {{(pid=116064) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 13:14:45.182001 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-d7b80cf9-90a3-49ed-93ed-b3ab9187d47e tempest-TestVolumeBootPattern-232608497 tempest-TestVolumeBootPattern-232608497-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 13:14:45.182456 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-d7b80cf9-90a3-49ed-93ed-b3ab9187d47e tempest-TestVolumeBootPattern-232608497 tempest-TestVolumeBootPattern-232608497-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 13:14:45.183232 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-d7b80cf9-90a3-49ed-93ed-b3ab9187d47e tempest-TestVolumeBootPattern-232608497 tempest-TestVolumeBootPattern-232608497-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 13:14:45.183660 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-d7b80cf9-90a3-49ed-93ed-b3ab9187d47e tempest-TestVolumeBootPattern-232608497 tempest-TestVolumeBootPattern-232608497-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 13:14:45.316742 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.policy [None req-d7b80cf9-90a3-49ed-93ed-b3ab9187d47e tempest-TestVolumeBootPattern-232608497 tempest-TestVolumeBootPattern-232608497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94008a0d97204aff87f20bdeadbdd783', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b854de8019ad4a598587133ba362564b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116064) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 13:14:45.324563 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: INFO nova.api.openstack.requestlog [None req-d7b80cf9-90a3-49ed-93ed-b3ab9187d47e tempest-TestVolumeBootPattern-232608497 tempest-TestVolumeBootPattern-232608497-project] 10.222.0.49 "GET /compute/v2.1/servers/6ffe001e-4663-4c36-8a16-5cc57d821992" status: 200 len: 1458 microversion: 2.1 time: 0.158309 Dec 14 13:14:45.325174 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: [pid: 116064|app: 0|req: 578/1180] 10.222.0.49 () {58 vars in 1235 bytes} [Tue Dec 14 13:14:45 2021] GET /compute/v2.1/servers/6ffe001e-4663-4c36-8a16-5cc57d821992 => generated 1458 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 14 13:14:45.965491 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.api.openstack.wsgi [req-651970e7-386e-4307-9a98-a8ab430a78ee req-db801710-8934-4bf5-9878-ddfde5a15fb3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6ffe001e-4663-4c36-8a16-5cc57d821992", "name": "network-vif-deleted", "tag": "6aec8549-7ca3-4c26-b734-050efe27049d"}]} {{(pid=116063) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 14 13:14:45.967253 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 14 13:14:45.967253 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: warnings.warn(msg) Dec 14 13:14:45.975475 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [req-651970e7-386e-4307-9a98-a8ab430a78ee req-db801710-8934-4bf5-9878-ddfde5a15fb3 service nova] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 13:14:45.975912 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [req-651970e7-386e-4307-9a98-a8ab430a78ee req-db801710-8934-4bf5-9878-ddfde5a15fb3 service nova] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 13:14:45.987768 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: INFO nova.api.openstack.compute.server_external_events [req-651970e7-386e-4307-9a98-a8ab430a78ee req-db801710-8934-4bf5-9878-ddfde5a15fb3 service nova] Creating event network-vif-deleted:6aec8549-7ca3-4c26-b734-050efe27049d for instance 6ffe001e-4663-4c36-8a16-5cc57d821992 on hv-cinder-78447 Dec 14 13:14:45.993700 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: INFO nova.api.openstack.requestlog [req-651970e7-386e-4307-9a98-a8ab430a78ee req-db801710-8934-4bf5-9878-ddfde5a15fb3 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031609 Dec 14 13:14:45.994309 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: [pid: 116063|app: 0|req: 603/1181] 10.222.0.49 () {64 vars in 1317 bytes} [Tue Dec 14 13:14:45 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 14 13:14:46.341794 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.api.openstack.wsgi [None req-9d4fa461-4552-4fda-b993-db7429ac4b7d tempest-TestVolumeBootPattern-232608497 tempest-TestVolumeBootPattern-232608497-project] Calling method '>' {{(pid=116064) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 13:14:46.342509 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.compute.api [None req-9d4fa461-4552-4fda-b993-db7429ac4b7d tempest-TestVolumeBootPattern-232608497 tempest-TestVolumeBootPattern-232608497-project] [instance: 6ffe001e-4663-4c36-8a16-5cc57d821992] Fetching instance by UUID {{(pid=116064) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 13:14:46.349294 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-9d4fa461-4552-4fda-b993-db7429ac4b7d tempest-TestVolumeBootPattern-232608497 tempest-TestVolumeBootPattern-232608497-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 13:14:46.349749 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-9d4fa461-4552-4fda-b993-db7429ac4b7d tempest-TestVolumeBootPattern-232608497 tempest-TestVolumeBootPattern-232608497-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 13:14:46.350543 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-9d4fa461-4552-4fda-b993-db7429ac4b7d tempest-TestVolumeBootPattern-232608497 tempest-TestVolumeBootPattern-232608497-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 13:14:46.350980 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-9d4fa461-4552-4fda-b993-db7429ac4b7d tempest-TestVolumeBootPattern-232608497 tempest-TestVolumeBootPattern-232608497-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 13:14:46.382252 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-9d4fa461-4552-4fda-b993-db7429ac4b7d tempest-TestVolumeBootPattern-232608497 tempest-TestVolumeBootPattern-232608497-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 13:14:46.382710 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-9d4fa461-4552-4fda-b993-db7429ac4b7d tempest-TestVolumeBootPattern-232608497 tempest-TestVolumeBootPattern-232608497-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 13:14:46.383159 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.objects.instance [None req-9d4fa461-4552-4fda-b993-db7429ac4b7d tempest-TestVolumeBootPattern-232608497 tempest-TestVolumeBootPattern-232608497-project] Lazy-loading 'fault' on Instance uuid 6ffe001e-4663-4c36-8a16-5cc57d821992 {{(pid=116064) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Dec 14 13:14:46.421878 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.policy [None req-9d4fa461-4552-4fda-b993-db7429ac4b7d tempest-TestVolumeBootPattern-232608497 tempest-TestVolumeBootPattern-232608497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94008a0d97204aff87f20bdeadbdd783', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b854de8019ad4a598587133ba362564b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116064) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 13:14:46.429350 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: INFO nova.api.openstack.requestlog [None req-9d4fa461-4552-4fda-b993-db7429ac4b7d tempest-TestVolumeBootPattern-232608497 tempest-TestVolumeBootPattern-232608497-project] 10.222.0.49 "GET /compute/v2.1/servers/6ffe001e-4663-4c36-8a16-5cc57d821992" status: 200 len: 1228 microversion: 2.1 time: 0.091121 Dec 14 13:14:46.429877 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: [pid: 116064|app: 0|req: 579/1182] 10.222.0.49 () {58 vars in 1235 bytes} [Tue Dec 14 13:14:46 2021] GET /compute/v2.1/servers/6ffe001e-4663-4c36-8a16-5cc57d821992 => generated 1228 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 14 13:14:47.015422 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Dec 14 13:14:47.016036 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: Tue Dec 14 13:14:47 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Dec 14 13:14:47.451398 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.api.openstack.wsgi [None req-a4390ec7-3fb2-4b3b-bcc4-04176c306553 tempest-TestVolumeBootPattern-232608497 tempest-TestVolumeBootPattern-232608497-project] Calling method '>' {{(pid=116063) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 13:14:47.452609 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.compute.api [None req-a4390ec7-3fb2-4b3b-bcc4-04176c306553 tempest-TestVolumeBootPattern-232608497 tempest-TestVolumeBootPattern-232608497-project] [instance: 6ffe001e-4663-4c36-8a16-5cc57d821992] Fetching instance by UUID {{(pid=116063) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 13:14:47.461987 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-a4390ec7-3fb2-4b3b-bcc4-04176c306553 tempest-TestVolumeBootPattern-232608497 tempest-TestVolumeBootPattern-232608497-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 13:14:47.462421 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-a4390ec7-3fb2-4b3b-bcc4-04176c306553 tempest-TestVolumeBootPattern-232608497 tempest-TestVolumeBootPattern-232608497-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 13:14:47.463190 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-a4390ec7-3fb2-4b3b-bcc4-04176c306553 tempest-TestVolumeBootPattern-232608497 tempest-TestVolumeBootPattern-232608497-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 13:14:47.463616 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-a4390ec7-3fb2-4b3b-bcc4-04176c306553 tempest-TestVolumeBootPattern-232608497 tempest-TestVolumeBootPattern-232608497-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 13:14:47.476814 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: INFO nova.api.openstack.wsgi [None req-a4390ec7-3fb2-4b3b-bcc4-04176c306553 tempest-TestVolumeBootPattern-232608497 tempest-TestVolumeBootPattern-232608497-project] HTTP exception thrown: Instance 6ffe001e-4663-4c36-8a16-5cc57d821992 could not be found. Dec 14 13:14:47.477421 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.api.openstack.wsgi [None req-a4390ec7-3fb2-4b3b-bcc4-04176c306553 tempest-TestVolumeBootPattern-232608497 tempest-TestVolumeBootPattern-232608497-project] Returning 404 to user: Instance 6ffe001e-4663-4c36-8a16-5cc57d821992 could not be found. {{(pid=116063) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 14 13:14:47.478230 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: INFO nova.api.openstack.requestlog [None req-a4390ec7-3fb2-4b3b-bcc4-04176c306553 tempest-TestVolumeBootPattern-232608497 tempest-TestVolumeBootPattern-232608497-project] 10.222.0.49 "GET /compute/v2.1/servers/6ffe001e-4663-4c36-8a16-5cc57d821992" status: 404 len: 111 microversion: 2.1 time: 0.033721 Dec 14 13:14:47.478717 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: [pid: 116063|app: 0|req: 604/1183] 10.222.0.49 () {58 vars in 1235 bytes} [Tue Dec 14 13:14:47 2021] GET /compute/v2.1/servers/6ffe001e-4663-4c36-8a16-5cc57d821992 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Dec 14 13:14:47.945021 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.api.openstack.wsgi [None req-2aba5213-1e48-456d-990d-c4702f4ce5fa tempest-TestVolumeBootPattern-232608497 tempest-TestVolumeBootPattern-232608497-project] Calling method '>' {{(pid=116064) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 13:14:47.945607 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.compute.api [None req-2aba5213-1e48-456d-990d-c4702f4ce5fa tempest-TestVolumeBootPattern-232608497 tempest-TestVolumeBootPattern-232608497-project] [instance: 0ae818b3-6456-4c1f-8ad2-0509dce1e575] Fetching instance by UUID {{(pid=116064) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 13:14:47.952137 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-2aba5213-1e48-456d-990d-c4702f4ce5fa tempest-TestVolumeBootPattern-232608497 tempest-TestVolumeBootPattern-232608497-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 13:14:47.952588 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-2aba5213-1e48-456d-990d-c4702f4ce5fa tempest-TestVolumeBootPattern-232608497 tempest-TestVolumeBootPattern-232608497-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 13:14:47.953469 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-2aba5213-1e48-456d-990d-c4702f4ce5fa tempest-TestVolumeBootPattern-232608497 tempest-TestVolumeBootPattern-232608497-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 13:14:47.953898 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG oslo_concurrency.lockutils [None req-2aba5213-1e48-456d-990d-c4702f4ce5fa tempest-TestVolumeBootPattern-232608497 tempest-TestVolumeBootPattern-232608497-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 13:14:47.969110 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: INFO nova.api.openstack.wsgi [None req-2aba5213-1e48-456d-990d-c4702f4ce5fa tempest-TestVolumeBootPattern-232608497 tempest-TestVolumeBootPattern-232608497-project] HTTP exception thrown: Instance 0ae818b3-6456-4c1f-8ad2-0509dce1e575 could not be found. Dec 14 13:14:47.969706 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.api.openstack.wsgi [None req-2aba5213-1e48-456d-990d-c4702f4ce5fa tempest-TestVolumeBootPattern-232608497 tempest-TestVolumeBootPattern-232608497-project] Returning 404 to user: Instance 0ae818b3-6456-4c1f-8ad2-0509dce1e575 could not be found. {{(pid=116064) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 14 13:14:47.970535 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: INFO nova.api.openstack.requestlog [None req-2aba5213-1e48-456d-990d-c4702f4ce5fa tempest-TestVolumeBootPattern-232608497 tempest-TestVolumeBootPattern-232608497-project] 10.222.0.49 "DELETE /compute/v2.1/servers/0ae818b3-6456-4c1f-8ad2-0509dce1e575" status: 404 len: 111 microversion: 2.1 time: 0.030467 Dec 14 13:14:47.971077 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: [pid: 116064|app: 0|req: 580/1184] 10.222.0.49 () {58 vars in 1238 bytes} [Tue Dec 14 13:14:47 2021] DELETE /compute/v2.1/servers/0ae818b3-6456-4c1f-8ad2-0509dce1e575 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Dec 14 13:14:47.982203 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.api.openstack.wsgi [None req-69d18807-5ead-4aeb-b655-feb6f03c2e30 tempest-TestVolumeBootPattern-232608497 tempest-TestVolumeBootPattern-232608497-project] Calling method '>' {{(pid=116063) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 13:14:47.983104 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.compute.api [None req-69d18807-5ead-4aeb-b655-feb6f03c2e30 tempest-TestVolumeBootPattern-232608497 tempest-TestVolumeBootPattern-232608497-project] [instance: 0ae818b3-6456-4c1f-8ad2-0509dce1e575] Fetching instance by UUID {{(pid=116063) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 13:14:47.992165 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-69d18807-5ead-4aeb-b655-feb6f03c2e30 tempest-TestVolumeBootPattern-232608497 tempest-TestVolumeBootPattern-232608497-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 13:14:47.992815 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-69d18807-5ead-4aeb-b655-feb6f03c2e30 tempest-TestVolumeBootPattern-232608497 tempest-TestVolumeBootPattern-232608497-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 13:14:47.994058 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-69d18807-5ead-4aeb-b655-feb6f03c2e30 tempest-TestVolumeBootPattern-232608497 tempest-TestVolumeBootPattern-232608497-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 13:14:47.994687 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG oslo_concurrency.lockutils [None req-69d18807-5ead-4aeb-b655-feb6f03c2e30 tempest-TestVolumeBootPattern-232608497 tempest-TestVolumeBootPattern-232608497-project] Lock "c72c70dc-282a-4dd4-bee2-2334d6bc15ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 13:14:48.011461 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: INFO nova.api.openstack.wsgi [None req-69d18807-5ead-4aeb-b655-feb6f03c2e30 tempest-TestVolumeBootPattern-232608497 tempest-TestVolumeBootPattern-232608497-project] HTTP exception thrown: Instance 0ae818b3-6456-4c1f-8ad2-0509dce1e575 could not be found. Dec 14 13:14:48.012041 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: DEBUG nova.api.openstack.wsgi [None req-69d18807-5ead-4aeb-b655-feb6f03c2e30 tempest-TestVolumeBootPattern-232608497 tempest-TestVolumeBootPattern-232608497-project] Returning 404 to user: Instance 0ae818b3-6456-4c1f-8ad2-0509dce1e575 could not be found. {{(pid=116063) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 14 13:14:48.012891 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: INFO nova.api.openstack.requestlog [None req-69d18807-5ead-4aeb-b655-feb6f03c2e30 tempest-TestVolumeBootPattern-232608497 tempest-TestVolumeBootPattern-232608497-project] 10.222.0.49 "GET /compute/v2.1/servers/0ae818b3-6456-4c1f-8ad2-0509dce1e575" status: 404 len: 111 microversion: 2.1 time: 0.036782 Dec 14 13:14:48.013412 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: [pid: 116063|app: 0|req: 605/1185] 10.222.0.49 () {58 vars in 1235 bytes} [Tue Dec 14 13:14:47 2021] GET /compute/v2.1/servers/0ae818b3-6456-4c1f-8ad2-0509dce1e575 => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Dec 14 13:14:49.322007 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: DEBUG nova.api.openstack.wsgi [None req-99fff42a-c96f-40ae-97a2-432f73897ddd tempest-TestVolumeBootPattern-232608497 tempest-TestVolumeBootPattern-232608497-project] Calling method '.version_select at 0x7f2ace6b1940>' {{(pid=116064) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 13:14:49.346365 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: INFO nova.api.openstack.requestlog [None req-99fff42a-c96f-40ae-97a2-432f73897ddd tempest-TestVolumeBootPattern-232608497 tempest-TestVolumeBootPattern-232608497-project] 10.222.0.49 "DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-878167248" status: 202 len: 0 microversion: 2.1 time: 0.027955 Dec 14 13:14:49.350070 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: [pid: 116064|app: 0|req: 581/1186] 10.222.0.49 () {58 vars in 1259 bytes} [Tue Dec 14 13:14:49 2021] DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-878167248 => generated 0 bytes in 29 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Dec 14 13:16:26.666557 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Dec 14 13:16:26.667683 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: Tue Dec 14 13:16:26 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Dec 14 13:16:35.283832 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Dec 14 13:16:35.284773 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: Tue Dec 14 13:16:35 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Dec 14 13:17:17.135836 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Dec 14 13:17:17.136517 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: Tue Dec 14 13:17:17 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Dec 14 13:18:07.033841 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Dec 14 13:18:07.034496 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: Tue Dec 14 13:18:07 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Dec 14 13:19:46.691223 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Dec 14 13:19:46.692150 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: Tue Dec 14 13:19:46 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Dec 14 13:19:55.308724 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Dec 14 13:19:55.309685 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: Tue Dec 14 13:19:55 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Dec 14 13:20:04.500500 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Dec 14 13:20:04.501296 dv-cinder-784477-10-iscsi devstack@n-api.service[116064]: Tue Dec 14 13:20:04 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Dec 14 13:20:05.902390 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Dec 14 13:20:05.903123 dv-cinder-784477-10-iscsi devstack@n-api.service[116063]: Tue Dec 14 13:20:05 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!!